Key Takeaways
Keep inference on device: faster, private, offline
Quantize before you ship: smaller, faster, cheaper
Use LoRA to specialise a tiny model for your domain