If self-driving cars are widely available, and they can drive everywhere a normal car can go, then you're not driving manually because you need to do so, you're driving manually because you like it, and the society isn't there to pay for your hobbies.
They won't be "widely available" because of the higher prices, just look at the EV market right now. You won't get a self-driving $2,000 clunker, and when you drive a $2,000 clunker you don't do it because you "like it", but because that's all that you can afford.
Did it happen for EVs in the here and now? Where can I find a SH EV clunker for $2,000? I'm talking about an EV with performances similar to those of a gasoline-based $2,000 clunker.
Otherwise, believing in "technological progress" as a potential solution is just just that, an irrational belief.
