Ways to learn an RNN

In video 7d, Hinton mentions that the Hessian Free Optimization is a good method to train an RNN. Is it also true for other second order methods or does the Hessian Free Optimization have some particularities that makes it more suitable?

Advertisements

0 Responses to “Ways to learn an RNN”



  1. Leave a Comment

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

w

Connecting to %s





%d bloggers like this: