> And understood a little on -O3 possibly increasing code size. I had thought that was more of a concern for tight environments than for most systems?

Increasing code size too much can result in hot functions not fitting in the icache, and that ultimately can make your program slower.