Rather the differences between protocols employed. Streaming video can be sent in chunks where latency doesn't matter that much (within certain tolerances, of course.) Realtime voice and video doesn't have that.
I’ve had other disconnections and sporadic complete DSL outages during the day. It might be there’s more traffic during the day when people are performing work duties from home.
Netflix might also be good enough at queuing up downloaded portions of the film ahead of time that the brief outages don’t affect the viewing experience.