And when slow is the only option, people will wait.
Decent performance is table stakes outside of very special contexts, and software that can't manage it is bad.
Finding an exception doesn't make that stop being true in general.
Stable diffusion is not relatively slow, because it has no alternative that is noticeably faster.