Topic: quantization

3 articles tagged quantization, newest first.

Published October 17, 2026
Quantization: How Large AI Models Fit on a Phone
A 70 billion parameter model needs 140 GB at FP16. At INT4, 35 GB is enough. Here is how the number drops without the model getting dumb.
Read more
Published October 13, 2026
LoRA: Fine-Tune a Huge Model Without Copying Its Weights
Since 2021, LoRA freezes the base weights and trains a small insert instead. Two years later QLoRA put a 65B model on one 48 GB GPU.
Read more
Published October 7, 2026
Why AI Token Prices Keep Falling While the Bill Still Grows
Gemini 4 Argon launched at $2 per million input tokens, half of Claude Opus 5.5. Why the price per token keeps falling while total spend keeps rising.
Read more