Skip to content

Add parallelism_auto flag to automatically set dp, tp and micro batch size - #516

Closed
pefontana wants to merge 28 commits into
mainfrom
hardcode-parallelism-data
Closed

Add parallelism_auto flag to automatically set dp, tp and micro batch size#516
pefontana wants to merge 28 commits into
mainfrom
hardcode-parallelism-data

Merge branch 'main' into hardcode-parallelism-data

e1f7276
Select commit
Loading
Failed to load commit list.
Garnix CI / package expand-distro [x86_64-linux] succeeded Mar 3, 2026 in 8m 4s

package expand-distro [x86_64-linux]

package expand-distro [x86_64-linux] succeeded

Details

Last 100 lines of logs:

expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
expand-distro-0.2.0> +++ command cargo --version
expand-distro-0.2.0> cargo 1.93.0 (083ac5135 2025-12-15)
expand-distro-0.2.0> +++ command cargo build --release --message-format json-render-diagnostics --features python,parallelism --bin expand-distro
expand-distro-0.2.0>    Compiling bzip2-sys v0.1.13+1.0.8
expand-distro-0.2.0>    Compiling pyo3-build-config v0.24.2
expand-distro-0.2.0>    Compiling psyche-core v0.2.0 (/build/source/shared/core)
expand-distro-0.2.0>    Compiling psyche-tui v0.2.0 (/build/source/shared/tui)
expand-distro-0.2.0>    Compiling bzip2 v0.4.4
expand-distro-0.2.0>    Compiling zip v0.6.6
expand-distro-0.2.0>    Compiling pyo3-macros-backend v0.24.2
expand-distro-0.2.0>    Compiling pyo3-ffi v0.24.2
expand-distro-0.2.0>    Compiling pyo3 v0.24.2
expand-distro-0.2.0>    Compiling torch-sys v0.22.0 (https://github.com/jquesnelle/tch-rs.git?rev=dda507e05a776547a112b6854d1e611684f8c729#dda507e0)
expand-distro-0.2.0>    Compiling psyche-coordinator v0.2.0 (/build/source/shared/coordinator)
expand-distro-0.2.0>    Compiling psyche-metrics v0.2.0 (/build/source/shared/metrics)
expand-distro-0.2.0>    Compiling psyche-watcher v0.2.0 (/build/source/shared/watcher)
expand-distro-0.2.0>    Compiling pyo3-macros v0.24.2
expand-distro-0.2.0>    Compiling tch v0.22.0 (https://github.com/jquesnelle/tch-rs.git?rev=dda507e05a776547a112b6854d1e611684f8c729#dda507e0)
expand-distro-0.2.0>    Compiling pyo3-tch v0.22.0 (https://github.com/jquesnelle/tch-rs.git?rev=dda507e05a776547a112b6854d1e611684f8c729#dda507e0)
expand-distro-0.2.0>    Compiling psyche-modeling v0.2.0 (/build/source/shared/modeling)
expand-distro-0.2.0>    Compiling psyche-network v0.2.0 (/build/source/shared/network)
expand-distro-0.2.0>    Compiling psyche-python-extension-impl v0.2.0 (/build/source/python/extension-impl)
expand-distro-0.2.0>    Compiling psyche-data-provider v0.2.0 (/build/source/shared/data-provider)
expand-distro-0.2.0>    Compiling psyche-eval v0.2.0 (/build/source/shared/eval)
expand-distro-0.2.0>    Compiling psyche-client v0.2.0 (/build/source/shared/client)
expand-distro-0.2.0>    Compiling expand-distro v0.2.0 (/build/source/tools/rust-tools/expand-distro)
expand-distro-0.2.0>     Finished `release` profile [optimized] target(s) in 1m 03s
expand-distro-0.2.0> searching for bins/libs to install from cargo build log at cargoBuildLogyJWc.json
expand-distro-0.2.0> installing /build/source/target/release/expand-distro in postBuildInstallFromCargoBuildLogOutTempcxh/bin
expand-distro-0.2.0> searching for bins/libs complete
expand-distro-0.2.0> buildPhase completed in 1 minutes 7 seconds
expand-distro-0.2.0> Running phase: installPhase
expand-distro-0.2.0> stripping references to Rust toolchain
expand-distro-0.2.0> Rust toolchain at: /nix/store/h88fyzrg216pff3xyl9rqbbk4p0kjvg8-rust-default-1.93.0
expand-distro-0.2.0> stripping Rust toolchain references done
expand-distro-0.2.0> stripping references to cargoVendorDir from:
expand-distro-0.2.0> /nix/store/7sbmbrhfv500xy7zpjv5fz7x2xigmdh3-expand-distro-0.2.0/bin/expand-distro
expand-distro-0.2.0> stripping references done
expand-distro-0.2.0> Running phase: fixupPhase
expand-distro-0.2.0> shrinking RPATHs of ELF executables and libraries in /nix/store/7sbmbrhfv500xy7zpjv5fz7x2xigmdh3-expand-distro-0.2.0
expand-distro-0.2.0> shrinking /nix/store/7sbmbrhfv500xy7zpjv5fz7x2xigmdh3-expand-distro-0.2.0/bin/expand-distro
expand-distro-0.2.0> checking for references to /build/ in /nix/store/7sbmbrhfv500xy7zpjv5fz7x2xigmdh3-expand-distro-0.2.0...
expand-distro-0.2.0> patching script interpreter paths in /nix/store/7sbmbrhfv500xy7zpjv5fz7x2xigmdh3-expand-distro-0.2.0
expand-distro-0.2.0> stripping (with command strip and flags -S -p) in  /nix/store/7sbmbrhfv500xy7zpjv5fz7x2xigmdh3-expand-distro-0.2.0/bin
expand-distro-0.2.0> shrinking RPATHs of ELF executables and libraries in /nix/store/7sbmbrhfv500xy7zpjv5fz7x2xigmdh3-expand-distro-0.2.0
expand-distro-0.2.0> shrinking /nix/store/7sbmbrhfv500xy7zpjv5fz7x2xigmdh3-expand-distro-0.2.0/bin/expand-distro
expand-distro-0.2.0> autoFixElfFiles: using removeStubsFromRunpath to fix /nix/store/7sbmbrhfv500xy7zpjv5fz7x2xigmdh3-expand-distro-0.2.0/bin/expand-distro
View more details on Garnix CI