In terms of writing the code in Python vs C++ (or a compiled language), there is a good interesting post about this here: https://stackoverflow.com/questions/7931314/pycuda-vs-c-perf...