> An end user today will expect that behavior

The average end user maybe. Not all endusers - for most videos I would rather wait than get a lower quality.