Shrinking the Model: Quantization
- Convert model weights & activations from high-precision formats (like 32-bit floating point) to low-precision types (like 8-bit integers).
- Reducing bit precision lowers memory and energy costs while speeding up arithmetic, enabling efficient model execution on edge devices.
diagram / code / screenshot