I've always liked the idea of smart cards, but I also wonder how I would use a smart card to simultaneously log in to a site from, say, my PC and phone. It seems like the card can only be plugged in one place.
Well your phone already has one smart card plugged into it all the time (assuming it's a GSM phone). Perhaps there's a clever way to leverage that as one factor in the authentication process.
That is, in fact, the point :)
Using cards with your phone is a serious pain in the neck still, either way.
You could always get an alternate token/card, so you have two you can use.