Comment on: turbo3/turbo4 cache produces garbled output on NVIDIA Blackwell GPU (RTX 5070 Laptop, compute capability 12.0)
Repo: TheTom/turboquant_plus by zekrom-vale
I got it to work fine on my 5070Ti. Here is my docker build files. This is not a laptop GPU and uses `nvidia/cuda:13.1.1-devel-ubuntu24.04`. It may be possible that the the 5070 laptop GPU has compatibility issues or the model does. However, TheDrummer_Cydonia-24B-v4.3-IQ4_XS and the 5070Ti does not have that major issue.
[docker-compose.yml](https://github.com/user-attachments/files/26382905/docker-compose.yml)
[Dockerfile.txt](https://github.com/user-attachments/files/26382913/Dockerfile.txt)
GitHub Issue
Parent Entity
State: Open • Comments: 1
SaaS Metrics