The lecture series and reference material by David Silver: http://www0.cs.ucl.ac.uk/staff/d.silver/web/Teaching.html. You can then supplement that with "Spinning up in Deep RL" for more hands-on experiments.