Add parallelism_auto flag to automatically set dp, tp and micro batch size - #516

psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> +++ command cargo --version
psyche-centralized-server-0.2.0> cargo 1.93.0 (083ac5135 2025-12-15)
psyche-centralized-server-0.2.0> +++ command cargo build --release --message-format json-render-diagnostics --features parallelism --bin psyche-centralized-server
psyche-centralized-server-0.2.0>    Compiling pyo3-build-config v0.24.2
psyche-centralized-server-0.2.0>    Compiling psyche-core v0.2.0 (/build/source/shared/core)
psyche-centralized-server-0.2.0>    Compiling psyche-tui v0.2.0 (/build/source/shared/tui)
psyche-centralized-server-0.2.0>    Compiling pyo3-macros-backend v0.24.2
psyche-centralized-server-0.2.0>    Compiling pyo3-ffi v0.24.2
psyche-centralized-server-0.2.0>    Compiling pyo3 v0.24.2
psyche-centralized-server-0.2.0>    Compiling psyche-coordinator v0.2.0 (/build/source/shared/coordinator)
psyche-centralized-server-0.2.0>    Compiling psyche-metrics v0.2.0 (/build/source/shared/metrics)
psyche-centralized-server-0.2.0>    Compiling psyche-watcher v0.2.0 (/build/source/shared/watcher)
psyche-centralized-server-0.2.0>    Compiling pyo3-macros v0.24.2
psyche-centralized-server-0.2.0>    Compiling pyo3-tch v0.22.0 (https://github.com/jquesnelle/tch-rs.git?rev=dda507e05a776547a112b6854d1e611684f8c729#dda507e0)
psyche-centralized-server-0.2.0>    Compiling psyche-modeling v0.2.0 (/build/source/shared/modeling)
psyche-centralized-server-0.2.0>    Compiling psyche-network v0.2.0 (/build/source/shared/network)
psyche-centralized-server-0.2.0>    Compiling psyche-data-provider v0.2.0 (/build/source/shared/data-provider)
psyche-centralized-server-0.2.0>    Compiling psyche-eval v0.2.0 (/build/source/shared/eval)
psyche-centralized-server-0.2.0>    Compiling psyche-client v0.2.0 (/build/source/shared/client)
psyche-centralized-server-0.2.0>    Compiling psyche-centralized-shared v0.2.0 (/build/source/architectures/centralized/shared)
psyche-centralized-server-0.2.0>    Compiling psyche-centralized-server v0.2.0 (/build/source/architectures/centralized/server)
psyche-centralized-server-0.2.0>     Finished `release` profile [optimized] target(s) in 19.66s
psyche-centralized-server-0.2.0> searching for bins/libs to install from cargo build log at cargoBuildLogLGyA.json
psyche-centralized-server-0.2.0> installing /build/source/target/release/psyche-centralized-server in postBuildInstallFromCargoBuildLogOutTempgjq/bin
psyche-centralized-server-0.2.0> searching for bins/libs complete
psyche-centralized-server-0.2.0> Running phase: installPhase
psyche-centralized-server-0.2.0> stripping references to Rust toolchain
psyche-centralized-server-0.2.0> Rust toolchain at: /nix/store/h88fyzrg216pff3xyl9rqbbk4p0kjvg8-rust-default-1.93.0
psyche-centralized-server-0.2.0> stripping Rust toolchain references done
psyche-centralized-server-0.2.0> stripping references to cargoVendorDir from:
psyche-centralized-server-0.2.0> /nix/store/j1w43ghxppi3llyj0zhpi9x2dm2x54qw-psyche-centralized-server-0.2.0/bin/psyche-centralized-server
psyche-centralized-server-0.2.0> stripping references done
psyche-centralized-server-0.2.0> Running phase: fixupPhase
psyche-centralized-server-0.2.0> shrinking RPATHs of ELF executables and libraries in /nix/store/j1w43ghxppi3llyj0zhpi9x2dm2x54qw-psyche-centralized-server-0.2.0
psyche-centralized-server-0.2.0> shrinking /nix/store/j1w43ghxppi3llyj0zhpi9x2dm2x54qw-psyche-centralized-server-0.2.0/bin/psyche-centralized-server
psyche-centralized-server-0.2.0> checking for references to /build/ in /nix/store/j1w43ghxppi3llyj0zhpi9x2dm2x54qw-psyche-centralized-server-0.2.0...
psyche-centralized-server-0.2.0> patching script interpreter paths in /nix/store/j1w43ghxppi3llyj0zhpi9x2dm2x54qw-psyche-centralized-server-0.2.0
psyche-centralized-server-0.2.0> stripping (with command strip and flags -S -p) in  /nix/store/j1w43ghxppi3llyj0zhpi9x2dm2x54qw-psyche-centralized-server-0.2.0/bin
psyche-centralized-server-0.2.0> shrinking RPATHs of ELF executables and libraries in /nix/store/j1w43ghxppi3llyj0zhpi9x2dm2x54qw-psyche-centralized-server-0.2.0
psyche-centralized-server-0.2.0> shrinking /nix/store/j1w43ghxppi3llyj0zhpi9x2dm2x54qw-psyche-centralized-server-0.2.0/bin/psyche-centralized-server
psyche-centralized-server-0.2.0> autoFixElfFiles: using removeStubsFromRunpath to fix /nix/store/j1w43ghxppi3llyj0zhpi9x2dm2x54qw-psyche-centralized-server-0.2.0/bin/psyche-centralized-server