I absolutely can, that's how I connect my ps4 to my uni accommodation internet as it's mschapv2 or smth the ps4 can't connect to. I know it's definitely using the wifi and not my mobile data as my data usage for the day is unchanged after I've downloaded a game.

Cheap Chinese android phone from 2020 (or maybe 2021 can't remember).