> so phone requires you to specify the address every time which is significantly more friction.

For some restaurants this is not true, they save your (phone number -> address) mapping the first time you call, and in the future ask for confirmation whether the address is correct.