ROIpad ← Back to Search
github.com › issue comment

Comment on: Experiment: Fused Q·Centroid compressed attention for turbo3 decode

Repo: TheTom/turboquant_plus by TheTom
Posted: Mar 27, 2026
## M2 Pro Results Update: Batched Extract IS a Win True baseline comparison (same branch chain, same build): | Depth | q8_0 | Main (const LUT) | Batched extract | Bit-arithmetic | |-------|------|-----------------|-----------------|----------------| | short | 32.5 | 22.9 | **23.7 (+3.5%)** | 23.2 | | 8K | 22.1 | 10.95 | **13.7 (+25%)** | 11.6 | Earlier diagnostic (34.5 short) was a different build/context allocation — not comparable. **Batched extract gives +25% at 8K on M2 Pro.** The explicit bit field pre-extraction helps Metal's compiler schedule device reads ahead of ALU on older hardware. Next: profile where the remaining gap is (turbo3 0.62x vs q8_0 at 8K).
GitHub Issue