One great way to start is to use OpenCL libraries. We work on clMath (https://github.com/clMathLibraries) and ArrayFire (http://arrayfire.com) which are both easy to pick up. Once you get comfortable with libraries, you can start trying to write your own kernels, and you'll know which things you'll need to write that aren't already in a freely available library. Good luck!