These things are not mutually exclusive. Remembering numbers didn't hinder our ability to remember our contacts' names.

We don't know how brain exactly works, but I don't think we can now do some things better just because we are not using another function of our brains anymore.