Comment on: Dual RTX 3090 (TP=2) vs single: a controlled A/B on your harness — +16-35%, DFlash2 residency, and the KV_MEM pin

No problem. I kept everything else the same and only made the .env changes you specified. I know you said C1 was all that is needed but I just ran the same bench script as it's nice for me to be able to compare in full. Still running the same commit from the previous run: https://github.com/syv-ai/qwen38-27b-rtx3090/commit/60daef8255b6757d9791955a44bce27df1658ea6 **LOOKUP=0 DFLASH_TOKENS=15 (otherwise exact same as previous .env)** | Cohort | Temp | Decode (tok/s) | e2e (tok/s) | Tokens/Step | Mean TTFT (ms) | |---|---|---|---|---|---| | C1 | default | 134.2 | 130.56 | 3.45 | 135.77 | | C2 | default | 178.7 | 161.62 | 3.19 | 188.14 | | C4 | default | 240.0 | 203.10 | 3.43 | 305.49 | | C8 | default | 257.2 | 205.92 | 3.13 | 721.15 | | C1 | greedy (T=0) | 130.5 | 126.02 | 3.30 | 140.17 | | C2 | greedy (T=0) | 191.2 | 166.35 | 3.32 | 185.53 | | C4 | greedy (T=0) | 243.8 | 208.12 | 3.45 | 288.03 | | C8 | greedy (T=0) | 289.2 | 231.50 | 3.49 | 730.25 | For this one I'm posting the ful...