Author of the publication

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm.

S. Huang, D. Xu, I. Yen, Y. Wang, S. Chang, B. Li, S. Chen, M. Xie, S. Rajasekaran, H. Liu, and C. Ding. ACL (1), page 190-200. Association for Computational Linguistics, (2022)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

Shaoyi Cheng

Haishi Huang

Feiqing Huang

Zhida Huang

Haowei Huang

Other publications of authors with the same name

A length adaptive algorithm-hardware co-design of transformer on FPGA through sparse attention and dynamic pipelining.H. Peng, S. Huang, S. Chen, B. Li, T. Geng, A. Li, W. Jiang, W. Wen, J. Bi, H. Liu and 1 other author(s). DAC, page 1135-1140. ACM, (2022)AutoReP: Automatic ReLU Replacement for Fast Private Network Inference.H. Peng, S. Huang, T. Zhou, Y. Luo, C. Wang, Z. Wang, J. Zhao, X. Xie, A. Li, T. Geng and 4 other author(s). ICCV, page 5155-5165. IEEE, (2023)Accelerating Transformer-based Deep Learning Models on FPGAs using Column Balanced Block Pruning.H. Peng, S. Huang, T. Geng, A. Li, W. Jiang, H. Liu, S. Wang, and C. Ding. ISQED, page 142-148. IEEE, (2021)Accel-GCN: High-Performance GPU Accelerator Design for Graph Convolution Networks.X. Xie, H. Peng, M. Hasan, S. Huang, J. Zhao, H. Fang, W. Zhang, T. Geng, O. Khan, and C. Ding. ICCAD, page 1-9. IEEE, (2023)Towards Sparsification of Graph Neural Networks.H. Peng, D. Gurevin, S. Huang, T. Geng, W. Jiang, O. Khan, and C. Ding. ICCD, page 272-279. IEEE, (2022)E.T.: re-thinking self-attention for transformer models on GPUs.S. Chen, S. Huang, S. Pandey, B. Li, G. Gao, L. Zheng, C. Ding, and H. Liu. SC, page 25. ACM, (2021)Dynamic Sparse Training via Balancing the Exploration-Exploitation Trade-off.S. Huang, B. Lei, D. Xu, H. Peng, Y. Sun, M. Xie, and C. Ding. DAC, page 1-6. IEEE, (2023)HMC-TRAN: A Tensor-core Inspired Hierarchical Model Compression for Transformer-based DNNs on GPU.S. Huang, S. Chen, H. Peng, D. Manu, Z. Kong, G. Yuan, L. Yang, S. Wang, H. Liu, and C. Ding. ACM Great Lakes Symposium on VLSI, page 169-174. ACM, (2021)CoDG-ReRAM: An Algorithm-Hardware Co-design to Accelerate Semi-Structured GNNs on ReRAM.Y. Luo, P. Behnam, K. Thorat, Z. Liu, H. Peng, S. Huang, S. Zhou, O. Khan, A. Tumanov, C. Ding and 1 other author(s). ICCD, page 280-289. IEEE, (2022)Towards Lossless Head Pruning through Automatic Peer Distillation for Language Models.B. Li, Z. Wang, S. Huang, M. Bragin, J. Li, and C. Ding. IJCAI, page 5113-5121. ijcai.org, (2023)

BibSonomy

Disambiguation of "Huang, Shaoyi"

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm.

Please choose a person to relate this publication to

Shaoyi Cheng

Haishi Huang

Feiqing Huang

Zhida Huang

Haowei Huang

Other publications of authors with the same name

Disambiguation

BibSonomy

Disambiguation of "Huang, Shaoyi"

copydeleteadd this publication to your clipboardcommunity posthistory of this postURLDOIBibTeXEndNoteAPAChicagoDIN 1505HarvardMSOffice XML Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm.

Please choose a person to relate this publication to

Shaoyi Cheng

Haishi Huang

Feiqing Huang

Zhida Huang

Haowei Huang

Other publications of authors with the same name

Disambiguation

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm.