Exercises for Reinforcement Learning book edition 2 by Dr. Richard Sutton.
These are only my attemps to the exercises, so there will be mistakes. I've sent them to Dr. Richard Sutton and got the correct solutions back, but I will not share them.
My reading notes for the book in case you are interested: http://www.mengliao.ca/articles.html (if the formulas are not displayed properly, simply refresh the page with a Ctrl+r)