Go is less useful on older systems, since you have to go out and get the Go compiler/etc. and compile them yourself before you can compile anything else, whereas you can expect that all systems (not just recent ones) have a C compiler installed.

What's wrong with compiling elsewhere and transporting the binary there?

Also, there are builds of the compiler that one can use, you're not usually forced to compile the compiler.

What prevents limbmp from being statically linked in?

Licensing of libgmp does.