Yes, that was the argument I remember reading. You put "system" stuff first, then /home if you did a separate partition for it, etc. Swap last because "hopefully you won't be swapping much anyway".
I also (vaguely) remember some people putting build partitions closer to the front.