Could not start because of low RAM
syv-ai/qwen38-27b-rtx3090
Hi,
Main system ram is 16GB, using iGPU (-256MB) and freeing all rtx3090 vRAM.
However I tried swapon but could not workaround on the memory issue.
Question, is there a way to run it with such an small system RAM ?
(EngineCore pid=5555) INFO 08-24 16:26:46 [weight_utils.py:867] Filesystem type for checkpoints: EXT4. Checkpoint size: 15.87 GiB. Available RAM: 10.07 GiB.
(EngineCore pid=5555) INFO 08-24 16:26:46 [weight_utils.py:897] Auto-prefetch is disabled because the filesystem (EXT4) is not a recognized network FS (NFS/Lustre) and the checkpoint size (15.87 GiB) exceeds 90% of available RAM (10.07 GiB).
Loading safetensors checkpoint shards: 0% Completed | 0/8 [00:00
View on GitHub ↗
Other Comments / Reviews
SaaS Metrics