Author of the publication

Don't Decay the Learning Rate, Increase the Batch Size

, , and . (2017)cite arxiv:1711.00489Comment: 11 pages, 7 figures.

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

 

Other publications of authors with the same name

Batch Normalization Biases Deep Residual Networks Towards Shallow Paths, and . (2020)cite arxiv:2002.10444.Decoding Decoders: Finding Optimal Representation Spaces for Unsupervised Similarity Tasks., , , , and . ICLR (Workshop), OpenReview.net, (2018)Monte Carlo Sort for unreliable human comparisons.. CoRR, (2016)ConvNets Match Vision Transformers at Scale., , , and . CoRR, (2023)A study on the plasticity of neural networks., , , , , , and . CoRR, (2021)Differentially Private Diffusion Models Generate Useful Synthetic Images., , , , , , , , , and . CoRR, (2023)Drawing Multiple Augmentation Samples Per Image During Training Efficiently Decreases Test Error., , , , and . CoRR, (2021)On the Origin of Implicit Regularization in Stochastic Gradient Descent., , , and . ICLR, OpenReview.net, (2021)Resurrecting Recurrent Neural Networks for Long Sequences., , , , , , and . ICML, volume 202 of Proceedings of Machine Learning Research, page 26670-26698. PMLR, (2023)Deep Transformers without Shortcuts: Modifying Self-attention for Faithful Signal Propagation., , , , , , and . ICLR, OpenReview.net, (2023)