Add parallelism_auto flag to automatically set dp, tp and micro batch size - #516

psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-local-testnet-0.2.0> +++ command cargo --version
psyche-centralized-local-testnet-0.2.0> cargo 1.93.0 (083ac5135 2025-12-15)
psyche-centralized-local-testnet-0.2.0> +++ command cargo build --release --message-format json-render-diagnostics --features parallelism --bin psyche-centralized-local-testnet
psyche-centralized-local-testnet-0.2.0>    Compiling psyche-centralized-local-testnet v0.2.0 (/build/source/architectures/centralized/local-testnet)
psyche-centralized-local-testnet-0.2.0>     Finished `release` profile [optimized] target(s) in 1.82s
psyche-centralized-local-testnet-0.2.0> searching for bins/libs to install from cargo build log at cargoBuildLogDSiu.json
psyche-centralized-local-testnet-0.2.0> installing /build/source/target/release/psyche-centralized-local-testnet in postBuildInstallFromCargoBuildLogOutTempsqo/bin
psyche-centralized-local-testnet-0.2.0> searching for bins/libs complete
psyche-centralized-local-testnet-0.2.0> Running phase: installPhase
psyche-centralized-local-testnet-0.2.0> stripping references to Rust toolchain
psyche-centralized-local-testnet-0.2.0> Rust toolchain at: /nix/store/h88fyzrg216pff3xyl9rqbbk4p0kjvg8-rust-default-1.93.0
psyche-centralized-local-testnet-0.2.0> stripping Rust toolchain references done
psyche-centralized-local-testnet-0.2.0> stripping references to cargoVendorDir from:
psyche-centralized-local-testnet-0.2.0> /nix/store/vfcsxbgdjna83z9x4r9vwnqv0hdynzcn-psyche-centralized-local-testnet-0.2.0/bin/psyche-centralized-local-testnet
psyche-centralized-local-testnet-0.2.0> stripping references done
psyche-centralized-local-testnet-0.2.0> Running phase: fixupPhase
psyche-centralized-local-testnet-0.2.0> shrinking RPATHs of ELF executables and libraries in /nix/store/vfcsxbgdjna83z9x4r9vwnqv0hdynzcn-psyche-centralized-local-testnet-0.2.0
psyche-centralized-local-testnet-0.2.0> shrinking /nix/store/vfcsxbgdjna83z9x4r9vwnqv0hdynzcn-psyche-centralized-local-testnet-0.2.0/bin/psyche-centralized-local-testnet
psyche-centralized-local-testnet-0.2.0> checking for references to /build/ in /nix/store/vfcsxbgdjna83z9x4r9vwnqv0hdynzcn-psyche-centralized-local-testnet-0.2.0...
psyche-centralized-local-testnet-0.2.0> patching script interpreter paths in /nix/store/vfcsxbgdjna83z9x4r9vwnqv0hdynzcn-psyche-centralized-local-testnet-0.2.0
psyche-centralized-local-testnet-0.2.0> stripping (with command strip and flags -S -p) in  /nix/store/vfcsxbgdjna83z9x4r9vwnqv0hdynzcn-psyche-centralized-local-testnet-0.2.0/bin
psyche-centralized-local-testnet-0.2.0> shrinking RPATHs of ELF executables and libraries in /nix/store/vfcsxbgdjna83z9x4r9vwnqv0hdynzcn-psyche-centralized-local-testnet-0.2.0
psyche-centralized-local-testnet-0.2.0> shrinking /nix/store/vfcsxbgdjna83z9x4r9vwnqv0hdynzcn-psyche-centralized-local-testnet-0.2.0/bin/psyche-centralized-local-testnet
psyche-centralized-local-testnet-0.2.0> autoFixElfFiles: using removeStubsFromRunpath to fix /nix/store/vfcsxbgdjna83z9x4r9vwnqv0hdynzcn-psyche-centralized-local-testnet-0.2.0/bin/psyche-centralized-local-testnet
psyche-book> structuredAttrs is enabled
psyche-book> Running phase: unpackPhase
psyche-book> unpacking source archive /nix/store/sacsd7f0vj78i1pc13vzh6b0ar4zfcyb-psyche-book
psyche-book> source root is psyche-book
psyche-book> Running phase: patchPhase
psyche-book> Running phase: updateAutotoolsGnuConfigScriptsPhase
psyche-book> Running phase: configurePhase
psyche-book> no configure script, doing nothing
psyche-book> Running phase: buildPhase
psyche-book>  INFO Book building has started
psyche-book> Warning: The mdbook-mermaid preprocessor was built against version 0.5.0 of mdbook, but we're being called from version 0.5.1
psyche-book>  INFO Running the html backend
psyche-book>  INFO HTML book written to `/build/psyche-book/book/html`
psyche-book>  INFO Running the linkcheck backend
psyche-book>  INFO Invoking the "linkcheck" renderer
psyche-book> warning: Potential incomplete link
psyche-book>   ┌─ development/python.md:3:3
psyche-book>   │
psyche-book> 3 │ > [!WARNING]
psyche-book>   │   ^^^^^^^^^^ Did you forget to define a URL for `!WARNING`?
psyche-book>   │
psyche-book>   = hint: declare the link's URL. For example: `[!WARNING]: http://example.com/`
psyche-book> 
psyche-book> Running phase: installPhase
psyche-book> Running phase: fixupPhase
psyche-book> shrinking RPATHs of ELF executables and libraries in /nix/store/apz86h7mkjkhnpgqma1s1m1wc63xhwk0-psyche-book
psyche-book> checking for references to /build/ in /nix/store/apz86h7mkjkhnpgqma1s1m1wc63xhwk0-psyche-book...
psyche-book> patching script interpreter paths in /nix/store/apz86h7mkjkhnpgqma1s1m1wc63xhwk0-psyche-book
validate-psyche-http-docs-caddyfile> 2026/03/03 19:21:29.061	INFO	using config from file	{"file": "./Caddyfile"}
validate-psyche-http-docs-caddyfile> 2026/03/03 19:21:29.062	INFO	adapted config to JSON	{"adapter": "caddyfile"}
validate-psyche-http-docs-caddyfile> Valid configuration