Running on WSL2 Ubuntu 22.04 fails
fikrikarim/parlor
First, thanks for this.
As litert still does not support native Windows, I tried to run it in WSL2 under Ubuntu 22.04.
```
lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 22.04.5 LTS
Release: 22.04
Codename: jammy
```
Nvidia and CUDA seem to be working OK. Also the GPU is set to be used in rendering.
```
glxinfo | grep "OpenGL renderer"
OpenGL renderer string: D3D12 (NVIDIA GeForce RTX 4080)
```
```
vulkaninfo | grep "deviceName"
WARNING: dzn is not a conformant Vulkan implementation, testing use only.
WARNING: dzn is not a conformant Vulkan implementation, testing use only.
deviceName = Microsoft Direct3D12 (NVIDIA GeForce RTX 4080 GPU)
deviceName = llvmpipe (LLVM 15.0.7, 256 bits)
deviceName = Microsoft Direct3D12 (Intel(R) Iris(R) Xe Graphics)
```
nvidia-smi works as expected and I can see the GPU.
I can run this command fine:
```
litert-lm run \
--from-huggingface-repo=litert-community/gemma-4-E2B-it-litert-lm \
gemma-4-E2B-it.litertlm \
--prompt="What is the capital of France?"
```
And I get a quick response:
`The capital of France is **Paris**.`
To get parlor up and running, I ran:
1. uv sync
in parlor's src directory, and I get the .venv setup OK.
2. uv run python server.py
causes an error. I'm including the output below.
It looks to me that the CPU engine backend (software rendering) is being loaded, instead of the GPU's.
```
nemisis...
View on GitHub ↗
Other Comments / Reviews
SaaS Metrics