Why would that matter? I would totally "fire" (i.e. terminate the contract) a contractor that didn't work when I needed him/her to (i.e. that didn't get the job done). Why would Uber need to be any different?
The scenario you bring up is a 2-party scenario between a client (the passenger) and a service provider (the driver) while Uber claims to be in a 3-party scenario where they are a software-based logistics service in-between the passenger and the driver. Their entire legal argument is resting on the claim that they are merely facilitating the scheduling and the payment of the ride.
Incidentally, if it were a 2-party scenario where you required a specific contractor to be available on demand, you would probably be their legal employer. A mandated, regular schedule is indeed one the main tests when distinguishing between an employee and a contractor. I have worked as a software contractor in the US for over almost 15 years and the employers, especially the larger ones with proper HR departments, have been careful to define my work in terms of skills and deliverables, not hours worked.
A 3rd party logistics service can do the same thing. If my business is to connect customers with web developers, but one particular developer turns down nearly all the jobs I offer him, I'm going to stop wasting time sending him offers.
If I don't weed out people to make the connections as efficient as possible, I'm not doing very well at my job of handling the logistics.