I realized after writing my post that you don't really need an entire system, just the x32 libraries (and not even those if you statically link your x32 application).