My point is, if I see a car coming, I'm not going to cross the street and let it hit me. That's the reason parents teach their kids to look both ways before crossing the street. Some idiot driver, human or otherwise, may not be controlling their vehicle in a predictable manner. At 20mph, as a pedestrian I can make a good decision about crossing the street.
I feel much safer about an empty driverless car at 20mph on local roads than one full of passengers at highway speeds.
(20 mph is entirely made up, it could be higher or lower in relationship to actual human reaction times)
human drivers do that all the time from getting distracted with your handphone, falling asleep in the driving seat, driving while drunk or otherwise impaired. So it is not much different. But AI cars are likely to be better drivers 2-3 years from now than what they are today humans will either be the same or worse.