I actually had a hand-me-down C64 as a kid, so I couldn't agree more. It's a bit bizarre; the C64 and Apple II were around at about the same time, but the C64 had more of, well, everything, for a cheaper price. It sort of baffles the mind to me that Apple even stood a chance to them.
You aren't wrong, though the Apple ][ came out earlier, it had an extremely long lifespan, and coexisted with the C64 for many years. I remember playground debates about which was better.
Really I guess that the Apple ][ was a platform rather than just a single machine.
So you've got the original Apple ][ which a C64 would have been a much better machine than with the benefit of 5 years and super aggressive cost cutting. However you've also got the Apple iigs in that family.
I think I'd see that as a much better machine than the C64 (but obviously much more expensive too).
Eh, your memory isn't as wrong as you may think. The C=64 was released during the Apple II+/Apple IIe era, and frankly, both of those machines were barely improvements. To give you an idea, the biggest improvement offered by the IIe was... support for lower-case characters.
The Commodores genuinely were something special for the era.