Author of the publication

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.

S. Smith, M. Patwary, B. Norick, P. LeGresley, S. Rajbhandari, J. Casper, Z. Liu, S. Prabhumoye, G. Zerveas, V. Korthikanti, E. Zheng, R. Child, R. Aminabadi, J. Bernauer, X. Song, M. Shoeybi, Y. He, M. Houston, S. Tiwary, and B. Catanzaro. CoRR, (2022)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

Balakumar Vijayakrishnan

Vijay Divi

Vijay Singh

Preethi Vijayaraj

Bharadwaj Vijaysarathy

Other publications of authors with the same name

Efficient large-scale language model training on GPU clusters using megatron-LM.D. Narayanan, M. Shoeybi, J. Casper, P. LeGresley, M. Patwary, V. Korthikanti, D. Vainbrand, P. Kashinkunti, J. Bernauer, B. Catanzaro and 2 other author(s). SC, page 58. ACM, (2021)Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.S. Smith, M. Patwary, B. Norick, P. LeGresley, S. Rajbhandari, J. Casper, Z. Liu, S. Prabhumoye, G. Zerveas, V. Korthikanti and 10 other author(s). CoRR, (2022)Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning.Z. Yang, W. Ping, Z. Liu, V. Korthikanti, W. Nie, D. Huang, L. Fan, Z. Yu, S. Lan, B. Li and 6 other author(s). EMNLP (Findings), page 11844-11857. Association for Computational Linguistics, (2023)Towards energy-performance trade-off analysis of parallel applicationsV. Korthikanti. University of Illinois Urbana-Champaign, USA, (2011)Reducing Activation Recomputation in Large Transformer Models.V. Korthikanti, J. Casper, S. Lym, L. McAfee, M. Andersch, M. Shoeybi, and B. Catanzaro. MLSys, mlsys.org, (2023)Towards optimizing energy costs of algorithms for shared memory architectures.V. Korthikanti, and G. Agha. SPAA, page 157-165. ACM, (2010)Avoiding energy wastage in parallel applications.V. Korthikanti, and G. Agha. Green Computing Conference, page 149-163. IEEE Computer Society, (2010)Synthesizing geometry constructions.S. Gulwani, V. Korthikanti, and A. Tiwari. PLDI, page 50-61. ACM, (2011)Reasoning about MDPs as Transformers of Probability Distributions.V. Korthikanti, M. Viswanathan, G. Agha, and Y. Kwon. QEST, page 199-208. IEEE Computer Society, (2010)Energy-performance trade-off analysis of parallel algorithms for shared memory architectures.V. Korthikanti, and G. Agha. Sustain. Comput. Informatics Syst., 1 (3): 167-176 (2011)

BibSonomy

Disambiguation of "Korthikanti, Vijay"

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.

Please choose a person to relate this publication to

Balakumar Vijayakrishnan

Vijay Divi

Vijay Singh

Preethi Vijayaraj

Bharadwaj Vijaysarathy

Other publications of authors with the same name

Disambiguation

BibSonomy

Disambiguation of "Korthikanti, Vijay"

copydeleteadd this publication to your clipboardcommunity posthistory of this postURLDOIBibTeXEndNoteAPAChicagoDIN 1505HarvardMSOffice XML Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.

Please choose a person to relate this publication to

Balakumar Vijayakrishnan

Vijay Divi

Vijay Singh

Preethi Vijayaraj

Bharadwaj Vijaysarathy

Other publications of authors with the same name

Disambiguation

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.