Key Takeaways
Keep inference
on device
: faster, private, offline
Quantize
before you ship: smaller, faster, cheaper
Use
LoRA
to specialise a
tiny model
for your domain