Comment on: Running on WSL2 Ubuntu 22.04 fails
Repo: fikrikarim/parlor by fikrikarim
Thanks for the additional information.
Could you changing the `litert_lm.Backend` to be CPU on all backend on the `server.py`?
```python
engine = litert_lm.Engine(
MODEL_PATH,
backend=litert_lm.Backend.CPU,
vision_backend=litert_lm.Backend.CPU,
audio_backend=litert_lm.Backend.CPU,
)
```
If that works, then there's a problem with the GPU inference on your setup.
If you could isolate and reproduce the issue just on python `litert_lm` without additional stuff from this repo, perhaps it'd be better to report the issue or ask for support from the main [LiteRT-LM repo](https://github.com/google-ai-edge/LiteRT-LM)?
GitHub Issue
SaaS Metrics