I've been thinking of something similar: a super lightweight (n)vim machine using Raspberry Pi (originally RaspPi Zero but performance went through the floor with my number of vim plugins, so likely a beefier one).

I think the lack of syntax highlighting is going to be the major hindrance for me moving forwards.