Author of the publication

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices.

X. Zhao, B. Jia, H. Zhou, Z. Liu, S. Cheng, and Y. You. CoRR, (2024)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

Cheng-Yung Cheng

I-Fen Cheng

Ying Min Cheng

Xuerong Cheng

Yao Cheng

Other publications of authors with the same name

DSP: Dynamic Sequence Parallelism for Multi-Dimensional Transformers.X. Zhao, S. Cheng, Z. Zheng, Z. Yang, Z. Liu, and Y. You. CoRR, (2024)tcFFT: Accelerating Half-Precision FFT through Tensor Cores.B. Li, S. Cheng, and J. Lin. CoRR, (2021)HMS-Net: Hierarchical Multi-Scale Sparsity-Invariant Network for Sparse Depth Completion.Z. Huang, J. Fan, S. Cheng, S. Yi, X. Wang, and H. Li. IEEE Trans. Image Process., (2020)FTL: A Universal Framework for Training Low-Bit DNNs via Feature Transfer.K. Du, Y. Zhang, H. Guan, Q. Tian, Y. Wang, S. Cheng, and J. Lin. ECCV (25), volume 12370 of Lecture Notes in Computer Science, page 700-716. Springer, (2020)FastFold: Reducing AlphaFold Training Time from 11 Days to 67 Hours.S. Cheng, R. Wu, Z. Yu, B. Li, X. Zhang, J. Peng, and Y. You. CoRR, (2022)CUBE - Towards an Optimal Scaling of Cosmological N-body Simulations.S. Cheng, H. Yu, D. Inman, Q. Liao, Q. Wu, and J. Lin. CCGRID, page 685-690. IEEE, (2020)FastFold: Optimizing AlphaFold Training and Inference on GPU Clusters.S. Cheng, X. Zhao, G. Lu, J. Fang, T. Zheng, R. Wu, X. Zhang, J. Peng, and Y. You. PPoPP, page 417-430. ACM, (2024)HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices.X. Zhao, B. Jia, H. Zhou, Z. Liu, S. Cheng, and Y. You. CoRR, (2024)Liger: Interleaving Intra- and Inter-Operator Parallelism for Distributed Large Model Inference.J. Du, J. Wei, J. Jiang, S. Cheng, D. Huang, Z. Chen, and Y. Lu. PPoPP, page 42-54. ACM, (2024)ATP: Adaptive Tensor Parallelism for Foundation Models.S. Cheng, Z. Liu, J. Du, and Y. You. CoRR, (2023)

BibSonomy

Disambiguation of "Cheng, Shenggan"

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices.

Please choose a person to relate this publication to

Cheng-Yung Cheng

I-Fen Cheng

Ying Min Cheng

Xuerong Cheng

Yao Cheng

Other publications of authors with the same name

Disambiguation

BibSonomy

Disambiguation of "Cheng, Shenggan"

copydeleteadd this publication to your clipboardcommunity posthistory of this postURLDOIBibTeXEndNoteAPAChicagoDIN 1505HarvardMSOffice XML HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices.

Please choose a person to relate this publication to

Cheng-Yung Cheng

I-Fen Cheng

Ying Min Cheng

Xuerong Cheng

Yao Cheng

Other publications of authors with the same name

Disambiguation

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices.