Author of the publication

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Stabilizing Transformer Training by Preventing Attention Entropy Collapse.

S. Zhai, T. Likhomanenko, E. Littwin, D. Busbridge, J. Ramapuram, Y. Zhang, J. Gu, and J. Susskind. ICML, volume 202 of Proceedings of Machine Learning Research, page 40770-40803. PMLR, (2023)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

Dan Bauer

Marius Dan

Dan Wang

Dan Tidten

Dan Brüllmann

Other publications of authors with the same name

Stabilizing Transformer Training by Preventing Attention Entropy Collapse.S. Zhai, T. Likhomanenko, E. Littwin, D. Busbridge, J. Ramapuram, Y. Zhang, J. Gu, and J. Susskind. ICML, volume 202 of Proceedings of Machine Learning Research, page 40770-40803. PMLR, (2023)REALM: Robust Entropy Adaptive Loss Minimization for Improved Single-Sample Test-Time Adaptation.S. Seto, B. Theobald, F. Danieli, N. Jaitly, and D. Busbridge. WACV, page 2051-2060. IEEE, (2024)Theory, Analysis, and Best Practices for Sigmoid Self-Attention.J. Ramapuram, F. Danieli, E. Dhekane, F. Weers, D. Busbridge, P. Ablin, T. Likhomanenko, J. Digani, Z. Gu, A. Shidani and 1 other author(s). CoRR, (2024)The Role of Entropy and Reconstruction in Multi-View Self-Supervised Learning.B. Gálvez, A. Blaas, P. Rodríguez, A. Golinski, X. Suau, J. Ramapuram, D. Busbridge, and L. Zappella. ICML, volume 202 of Proceedings of Machine Learning Research, page 29143-29160. PMLR, (2023)Decoding Decoders: Finding Optimal Representation Spaces for Unsupervised Similarity Tasks.V. Zhelezniak, D. Busbridge, A. Shen, S. Smith, and N. Hammerla. ICLR (Workshop), OpenReview.net, (2018)Learning medical triage from clinicians using Deep Q-Learning.A. Buchard, B. Bouvier, G. Prando, R. Beard, M. Livieratos, D. Busbridge, D. Thompson, J. Richens, Y. Zhang, A. Baker and 3 other author(s). CoRR, (2020)Neural Temporal Point Processes For Modelling Electronic Health Records.J. Enguehard, D. Busbridge, A. Bozson, C. Woodcock, and N. Hammerla. ML4H@NeurIPS, volume 136 of Proceedings of Machine Learning Research, page 85-113. PMLR, (2020)Relational Graph Attention Networks.D. Busbridge, D. Sherburn, P. Cavallo, and N. Hammerla. CoRR, (2019)DUET: 2D Structured and Approximately Equivariant Representations.X. Suau, F. Danieli, T. Keller, A. Blaas, C. Huang, J. Ramapuram, D. Busbridge, and L. Zappella. ICML, volume 202 of Proceedings of Machine Learning Research, page 32749-32769. PMLR, (2023)Position Prediction as an Effective Pretraining Strategy.S. Zhai, N. Jaitly, J. Ramapuram, D. Busbridge, T. Likhomanenko, J. Cheng, W. Talbott, C. Huang, H. Goh, and J. Susskind. ICML, volume 162 of Proceedings of Machine Learning Research, page 26010-26027. PMLR, (2022)

BibSonomy

Disambiguation of "Busbridge, Dan"

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Stabilizing Transformer Training by Preventing Attention Entropy Collapse.

Please choose a person to relate this publication to

Dan Bauer

Marius Dan

Dan Wang

Dan Tidten

Dan Brüllmann

Other publications of authors with the same name

Disambiguation

BibSonomy

Disambiguation of "Busbridge, Dan"

copydeleteadd this publication to your clipboardcommunity posthistory of this postURLDOIBibTeXEndNoteAPAChicagoDIN 1505HarvardMSOffice XML Stabilizing Transformer Training by Preventing Attention Entropy Collapse.

Please choose a person to relate this publication to

Dan Bauer

Marius Dan

Dan Wang

Dan Tidten

Dan Brüllmann

Other publications of authors with the same name

Disambiguation

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Stabilizing Transformer Training by Preventing Attention Entropy Collapse.