Author of the publication

Stabilizing Transformer Training by Preventing Attention Entropy Collapse.

, , , , , , , and . ICML, volume 202 of Proceedings of Machine Learning Research, page 40770-40803. PMLR, (2023)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

 

Other publications of authors with the same name

A New Benchmark and Progress Toward Improved Weakly Supervised Learning., and . BMVC, page 265. BMVA Press, (2018)Theory, Analysis, and Best Practices for Sigmoid Self-Attention., , , , , , , , , and 1 other author(s). CoRR, (2024)Lifelong generative modeling., , and . Neurocomputing, (2020)The Role of Entropy and Reconstruction in Multi-View Self-Supervised Learning., , , , , , , and . ICML, volume 202 of Proceedings of Machine Learning Research, page 29143-29160. PMLR, (2023)Variational Saccading: Efficient Inference for Large Resolution Images., , , , and . BMVC, page 119. BMVA Press, (2019)Large-Scale Nonlinear Variable Selection via Kernel Random Features., , , and . ECML/PKDD (2), volume 11052 of Lecture Notes in Computer Science, page 177-192. Springer, (2018)Finding signals in the void: Improving deep latent variable generative models via supervisory signals present within data.. University of Geneva, Switzerland, (2021)base-search.net (ftunivgeneve:oai:unige.ch:aou:unige:160342).Differentiable Approximation Bridges For Training Networks Containing Non-Differentiable Functions., and . CoRR, (2019)Kanerva++: Extending the Kanerva Machine With Differentiable, Locally Block Allocated Latent Memory., , and . ICLR, OpenReview.net, (2021)Continual Classification Learning Using Generative Models., , , and . CoRR, (2018)