Author of the publication

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization.

C. Hooper, S. Kim, H. Mohammadzadeh, M. Mahoney, Y. Shao, K. Keutzer, and A. Gholami. CoRR, (2024)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

Melvis Hooper

Mark Hooper

Kathleen R Hooper

John Derek Coleman

John Coleman Darnell

Other publications of authors with the same name

SM6: A 16nm System-on-Chip for Accurate and Noise-Robust Attention-Based NLP Applications : The 33rd Hot Chips Symposium - August 22-24, 2021.T. Tambe, E. Yang, G. Ko, Y. Chai, C. Hooper, M. Donato, P. Whatmough, A. Rush, D. Brooks, and G. Wei. HCS, page 1-13. IEEE, (2021)A 16-nm SoC for Noise-Robust Speech and NLP Edge AI Inference With Bayesian Sound Source Separation and Attention-Based DNNs.T. Tambe, E. Yang, G. Ko, Y. Chai, C. Hooper, M. Donato, P. Whatmough, A. Rush, D. Brooks, and G. Wei. IEEE J. Solid State Circuits, 58 (2): 569-581 (February 2023)Learned Best-Effort LLM Serving.S. Jha, C. Hooper, X. Liu, S. Kim, and K. Keutzer. CoRR, (2024)Full Stack Optimization of Transformer Inference: a Survey.S. Kim, C. Hooper, T. Wattanawong, M. Kang, R. Yan, H. Genc, G. Dinh, Q. Huang, K. Keutzer, M. Mahoney and 2 other author(s). CoRR, (2023)EdgeBERT: Optimizing On-Chip Inference for Multi-Task NLP.T. Tambe, C. Hooper, L. Pentecost, E. Yang, M. Donato, V. Sanh, A. Rush, D. Brooks, and G. Wei. CoRR, (2020)AI and Memory Wall.A. Gholami, Z. Yao, S. Kim, C. Hooper, M. Mahoney, and K. Keutzer. CoRR, (2024)Property-Aware Multi-Speaker Data Simulation: A Probabilistic Modelling Technique for Synthetic Data Generation.T. Park, H. Huang, C. Hooper, N. Koluguri, K. Dhawan, A. Jukic, J. Balam, and B. Ginsburg. CoRR, (2023)KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization.C. Hooper, S. Kim, H. Mohammadzadeh, M. Mahoney, Y. Shao, K. Keutzer, and A. Gholami. CoRR, (2024)SPEED: Speculative Pipelined Execution for Efficient Decoding.C. Hooper, S. Kim, H. Mohammadzadeh, H. Genc, K. Keutzer, A. Gholami, and Y. Shao. CoRR, (2023)A 12nm 18.1TFLOPs/W Sparse Transformer Processor with Entropy-Based Early Exit, Mixed-Precision Predication and Fine-Grained Power Management.T. Tambe, J. Zhang, C. Hooper, T. Jia, P. Whatmough, J. Zuckerman, M. dos Santos, E. Loscalzo, D. Giri, K. Shepard and 4 other author(s). ISSCC, page 342-343. IEEE, (2023)

BibSonomy

Disambiguation of "Hooper, Coleman"

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization.

Please choose a person to relate this publication to

Melvis Hooper

Mark Hooper

Kathleen R Hooper

John Derek Coleman

John Coleman Darnell

Other publications of authors with the same name

Disambiguation

BibSonomy

Disambiguation of "Hooper, Coleman"

copydeleteadd this publication to your clipboardcommunity posthistory of this postURLDOIBibTeXEndNoteAPAChicagoDIN 1505HarvardMSOffice XML KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization.

Please choose a person to relate this publication to

Melvis Hooper

Mark Hooper

Kathleen R Hooper

John Derek Coleman

John Coleman Darnell

Other publications of authors with the same name

Disambiguation

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization.