A Step by Step Backpropagation Example | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

		A Step by Step Backpropagation Example (mattmazur.com)
		64 points by shawndumas on July 15, 2015 \| hide \| past \| favorite \| 2 comments

discardorama on July 15, 2015 | [–]

Every such example stops at vanilla backprop.

What I'd like to see (and which I think would be a lot more challenging) is: BPTT for a recurrent network. BP for an LSTM or GRU. Can someone do that?

jmount on July 15, 2015 | [–]

Backprop is fun. You may also enjoy a look at the generalization: reverse accumulation http://www.win-vector.com/blog/2010/07/gradients-via-reverse... .

Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact