Author of the publication

Monarch: Expressive Structured Matrices for Efficient and Accurate Training.

, , , , , , , , , and . ICML, volume 162 of Proceedings of Machine Learning Research, page 4690-4721. PMLR, (2022)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

 

Other publications of authors with the same name

Lsh-sampling Breaks the Computation Chicken-and-egg Loop in Adaptive Stochastic Gradient Estimation., , and . CoRR, (2019)SLIDE : In Defense of Smart Algorithms over Hardware Acceleration for Large-Scale Deep Learning Systems, , , , , and . (2019)cite arxiv:1903.03129Comment: Published at MLSys 2020.Efficient Streaming Language Models with Attention Sinks., , , , and . CoRR, (2023)Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions., , , , , , , , , and 4 other author(s). CoRR, (2023)Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models., , , , , , and . CoRR, (2021)Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding., , , , , , and . CoRR, (2024)Scatterbrain: Unifying Sparse and Low-rank Attention Approximation., , , , , and . CoRR, (2021)Learn To be Efficient: Build Structured Sparsity in Large Language Models., , , , and . CoRR, (2024)Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer., , , and . CoRR, (2023)SOLAR: Sparse Orthogonal Learned and Random Embeddings., , and . ICLR, OpenReview.net, (2021)