Skip to content

fix(mlx): run all of a runner's GPU work on one stream (fixes tensor-parallel stalls with fast synch) - #2391

Open
AlexCheema wants to merge 1 commit into
mainfrom
fix/run-mlx-on-one-gpu-stream
Open

AlexCheema wants to merge 1 commit into
mainfrom
fix/run-mlx-on-one-gpu-stream

fix(mlx): run all of a runner's GPU work on mlx-lm's generation stream

be9925b
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
Build and check (aarch64-linux)
succeeded Oct 4, 2026 in 2m 13s