Comment on: Experiment: Fused Q·Centroid compressed attention for turbo3 decode
Repo: TheTom/turboquant_plus by TheTom
## M2 Pro Results Update: Batched Extract IS a Win
True baseline comparison (same branch chain, same build):
| Depth | q8_0 | Main (const LUT) | Batched extract | Bit-arithmetic |
|-------|------|-----------------|-----------------|----------------|
| short | 32.5 | 22.9 | **23.7 (+3.5%)** | 23.2 |
| 8K | 22.1 | 10.95 | **13.7 (+25%)** | 11.6 |
Earlier diagnostic (34.5 short) was a different build/context allocation — not comparable.
**Batched extract gives +25% at 8K on M2 Pro.** The explicit bit field pre-extraction helps Metal's compiler schedule device reads ahead of ALU on older hardware.
Next: profile where the remaining gap is (turbo3 0.62x vs q8_0 at 8K).
GitHub Issue
Parent Entity
State: Open • Comments: 6
SaaS Metrics