Not reliably. It can only drive Whisper quickly enough to appear real-time because of the GPU, and without that you're limited to the tiny/small/base models to get latency into single-digit seconds.

Edit to add: this might not be true since whisper-large-v3-turbo got released. I've not tried that on a pi 5 yet.