Author of the publication

On the difficulty of training Recurrent Neural Networks

, , and . (2012)cite arxiv:1211.5063Comment: Improved description of the exploding gradient problem and description and analysis of the vanishing gradient problem.

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

 

Other publications of authors with the same name

Multiplicative Interactions and Where to Find Them., , , , , , , , and . ICLR, OpenReview.net, (2020)Identifying and attacking the saddle point problem in high-dimensional non-convex optimization, , , , , and . (2014)cite arxiv:1406.2572Comment: The theoretical review and analysis in this article draw heavily from arXiv:1405.4604 cs.LG.Revisiting Natural Gradient for Deep Networks, and . (2013)cite arxiv:1301.3584.Task Agnostic Continual Learning via Meta Learning., , , , , and . CoRR, (2019)Model compression via distillation and quantization., , and . ICLR (Poster), OpenReview.net, (2018)Malware classification with recurrent networks., , , , and . ICASSP, page 1916-1920. IEEE, (2015)Adapting Auxiliary Losses Using Gradient Similarity, , , , and . (2018)cite arxiv:1812.02224.Mix & Match Agent Curricula for Reinforcement Learning., , , , , , , and . ICML, volume 80 of Proceedings of Machine Learning Research, page 1095-1103. PMLR, (2018)Promoting Exploration in Memory-Augmented Adam using Critical Momenta., , , , , , , and . CoRR, (2023)Maxwell's Demon at Work: Efficient Pruning by Leveraging Saturation of Neurons., , , , , and . CoRR, (2024)