Author of the publication

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Reliable and Efficient In-Memory Fault Tolerance of Large Language Model Pretraining.

Y. Wang, S. Shi, X. He, Z. Tang, X. Pan, Y. Zheng, X. Wu, A. Zhou, B. He, and X. Chu. CoRR, (2023)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

Huili Shi

Lei Shi

Zhanjun Shi

Jian Shi

Renhu Shi

Other publications of authors with the same name

MG-WFBP: Efficient Data Communication for Distributed Synchronous SGD Algorithms.S. Shi, and X. Chu. CoRR, (2018)Communication-Efficient Distributed Deep Learning with Merged Gradient Sparsification on GPUs.S. Shi, Q. Wang, X. Chu, B. Li, Y. Qin, R. Liu, and X. Zhao. INFOCOM, page 406-415. IEEE, (2020)Mixed Precision Method for GPU-based FFT.S. Qi, X. Wang, and S. Shi. CSE, page 580-586. IEEE Computer Society, (2011)Reliable and Efficient In-Memory Fault Tolerance of Large Language Model Pretraining.Y. Wang, S. Shi, X. He, Z. Tang, X. Pan, Y. Zheng, X. Wu, A. Zhou, B. He, and X. Chu. CoRR, (2023)Towards Scalable Distributed Training of Deep Learning on Public Cloud Clusters.S. Shi, X. Zhou, S. Song, X. Wang, Z. Zhu, X. Huang, X. Jiang, F. Zhou, Z. Guo, L. Xie and 14 other author(s). MLSys, mlsys.org, (2021)Communication-Efficient Distributed Deep Learning: A Comprehensive Survey.Z. Tang, S. Shi, X. Chu, W. Wang, and B. Li. CoRR, (2020)Efficient Sparse-Dense Matrix-Matrix Multiplication on GPUs Using the Customized Sparse Storage Format.S. Shi, Q. Wang, and X. Chu. ICPADS, page 19-26. IEEE, (2020)PipeMoE: Accelerating Mixture-of-Experts through Adaptive Pipelining.S. Shi, X. Pan, X. Chu, and B. Li. INFOCOM, page 1-10. IEEE, (2023)Accelerating Distributed K-FAC with Efficient Collective Communication and Scheduling.L. Zhang, S. Shi, and B. Li. INFOCOM, page 1-10. IEEE, (2023)Layer-Wise Adaptive Gradient Sparsification for Distributed Deep Learning with Convergence Guarantees.S. Shi, Z. Tang, Q. Wang, K. Zhao, and X. Chu. ECAI, volume 325 of Frontiers in Artificial Intelligence and Applications, page 1467-1474. IOS Press, (2020)

BibSonomy

Disambiguation of "Shi, Shaohuai"

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Reliable and Efficient In-Memory Fault Tolerance of Large Language Model Pretraining.

Please choose a person to relate this publication to

Huili Shi

Lei Shi

Zhanjun Shi

Jian Shi

Renhu Shi

Other publications of authors with the same name

Disambiguation

BibSonomy

Disambiguation of "Shi, Shaohuai"

copydeleteadd this publication to your clipboardcommunity posthistory of this postURLDOIBibTeXEndNoteAPAChicagoDIN 1505HarvardMSOffice XML Reliable and Efficient In-Memory Fault Tolerance of Large Language Model Pretraining.

Please choose a person to relate this publication to

Huili Shi

Lei Shi

Zhanjun Shi

Jian Shi

Renhu Shi

Other publications of authors with the same name

Disambiguation

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Reliable and Efficient In-Memory Fault Tolerance of Large Language Model Pretraining.