Docker (WSL2)?
#5
by evilperson068 - opened
Hi bud, does it work on Windows Docker - WSL2? Thanks.
Doesnt appear to work on WSL2. I had launched the correct recipe but my GPU was only hitting around 200w instead of 600w on a 3 lane full context setup for my agents. Ended up doing some debugging and the pinned memory is unavailable and throughput doesn't scale across lanes (130 tokens/s total instead of each). Going back to the ninfer build instead for my single RTX PRO 6000