Have you checked out our latest short course with Hugging Face, Quantization in Depth? You will get hands-on and build a quantizer in PyTorch that can compress the dense layers of any open source model, from 32 bits to 8 bits. Go beyond the basics of quantization and build a solid foundation to go into more advanced quantization methods. Explore the course now: https://hubs.la/Q02wpZmB0 | DeepLearning.AI

Have you used quantization with an open source machine learning library, and wondered how quantization works? How can you preserve model accuracy as you compress from 32 bits to 16, 8, or even 2 bits? In our new short course, Quantization in Depth, taught by Hugging Face's Marc Sun and Younes Belkada, you'll learn to implement variants of linear quantization, such as asymmetric and symmetric modes, from scratch. You'll also quantize at different granularities (per-tensor, per-channel, per-group)