Comment on: Dual RTX 3090 (TP=2) vs single: a controlled A/B on your harness — +16-35%, DFlash2 residency, and the KV_MEM pin

I've changed my configuration to roughly match your suggestions and (warm) benched at 250W and 275W. My numbers are significantly better than they were though a little lower than yours at C1. I suspect there may be some thermal throttling going on as I've not had this setup for long and probably need to tweak things. I'll also add that I'm fairly new to running local models and vLLM in general so please feel free to point out any rookie errors. Setup: - Ubuntu 26.04 - Docker deployment - 10920x, 128GB DDR4, Dual 3090 (EVGA Super FTW3), 16x PCIE3 for both cards, no nvlink, p2p driver patch - Commit: https://github.com/syv-ai/qwen38-27b-rtx3090/commit/60daef8255b6757d9791955a44bce27df1658ea6 My new .env: ```env VLLM_API_KEY=REMOVED CUDA_VISIBLE_DEVICES=0,1 GPU_UTIL=0.93 CTX=fast MAX_LEN=294912 MAX_SEQS=8 SPEC=dflash2 PREFIX_CACHE=1 VISION=1 KV_MEM= DFLASH_TOKENS=7 VLLM_ALLOW_LONG_MAX_MODEL_LEN=1 EXTRA_ARGS='--tensor-parallel-size 2 --disable-custom-all-reduce --hf-overrides {"t...