Exploring Smoothquant
Let's dive into the details surrounding Smoothquant.
- By Marie Zhussupova.
- SmoothQuant : run LLM on CPU
- SmoothQuant
- https://arxiv.org/abs/2211.10438.
- By Marie Zhussupova.
In-Depth Information on Smoothquant
SmoothQuant - Accurate and Efficient Post-Training Quantization for Large Language Models Large language models (LLMs) show excellent performance but are compute- and memory-intensive. Quantization can reduce ... Links : Subscribe: https://www.youtube.com/@Arxflix Twitter: https://x.com/arxflix LMNT: https://lmnt.com/ In this video, we look into SmoothQ Algorithm and Paper: Paper: https://arxiv.org/abs/2211.10438 Pseudocode Open Source ...
Seminar date : 2024.07.05 # Seminar contents Paper Review Seminar # Paper Title Xiao, Guangxuan, et al. "
That wraps up our extensive overview of Smoothquant.