The problem with cars in cities is not just the pollution, although that is a huge factor.
It is also the fact that they are grossly inefficient space-wise. The majority have only the driver (and maybe, maybe a single passenger) in an otherwise empty car. Congestion would be vastly reduced if we could get most of those people on public transport or bikes instead.