Skip to content

Add parallelism_auto flag to automatically set dp, tp and micro batch size - #516

Closed
pefontana wants to merge 28 commits into
mainfrom
hardcode-parallelism-data
Closed

Add parallelism_auto flag to automatically set dp, tp and micro batch size#516
pefontana wants to merge 28 commits into
mainfrom
hardcode-parallelism-data

Merge branch 'main' into hardcode-parallelism-data

e1f7276
Select commit
Loading
Failed to load commit list.
Garnix CI / nixosConfig psyche-http-devnet succeeded Mar 3, 2026 in 6m 16s

nixosConfig psyche-http-devnet

nixosConfig psyche-http-devnet succeeded

Details

Last 100 lines of logs:

these 31 derivations will be built:
  /nix/store/ajlsan68rj3ipdsyqrf0vaqdp371ammk-vendor-registry.drv
  /nix/store/j4np21ln9nh8c3h0dvgckkhj48adypgf-linkLockedDeps.drv
  /nix/store/21djzpmbwb62ns9y98xyf58nyhhvwlqb-vendor-cargo-deps.drv
  /nix/store/kp94vwrqk7hh1q35v7hxbhxkhbcn3v9l-psyche-deserialize-zerocopy-wasm-deps-0.2.0.drv
  /nix/store/zj9gfslifmawm7kjksnmar8im4kfz7gh-psyche-deserialize-zerocopy-wasm-0.2.0.drv
  /nix/store/6mk459ns2niyk23q0f977xf1gm51cp46-psyche-website-wasm.drv
  /nix/store/rvyhccm0j9069w6klvgkya9j5q7hcfb2-linkLockedDeps.drv
  /nix/store/viznrfz3gc1bdnrs6nl1hyy4i1xl6dwc-linkLockedDeps.drv
  /nix/store/z8g8mrzqwlijwrmnhwi2p4m84wqvdgjz-vendor-registry.drv
  /nix/store/61zmixwi0hkfzjkh67kyzpl449963dk5-vendor-cargo-deps.drv
  /nix/store/rk4ifv144k3znhph2z9jbrmkblzr13gq-source.drv
  /nix/store/lcywhna0fx2m5qkzd0a1y0c02x74wnc4-solana-idl-solana-coordinator-deps-0.2.0.drv
  /nix/store/nkj5g6y97i0p15b9ak8gxqsm2n3y6his-solana-coordinator-idl-0.drv
  /nix/store/vg4hmkkqpba7rimx54zb73ciqa6v7zkc-source.drv
  /nix/store/mxslc0i7n8h4p9f73f85y519zzk10kx3-solana-idl-solana-mining-pool-deps-0.2.0.drv
  /nix/store/vjxz1ai12fhnjq2k2ivz39fgq44cn8lr-solana-mining-pool-idl-0.drv
  /nix/store/j9bdp99cpjzrkmj7dswavgycvrfsmyrj-website-shared-1.0.0.drv
  /nix/store/48c9fy5pszx8rpjy3k06jw2jcbjm7xdv-website-backend-1.0.0.drv
  /nix/store/vaix5qpclhmlysdw3w9cyjsc9409gwxx-website-frontend-1.0.0.drv
  /nix/store/4dvhdib7d8ha5552jf4r8v5b0d9bs480-Caddyfile.drv
  /nix/store/4w7yrhb3wfjzvkx3khzcbxmzlr9qaiw8-stage-2-init.sh.drv
  /nix/store/jg64ry01js7jdpnn7fmh38zgkai7l4jc-unit-backend.service.drv
  /nix/store/wal1n8yqqa7mczb0ydg7kw8s36m811ia-Caddyfile-formatted.drv
  /nix/store/mqikh1zc6hxizzgkz39jsj38prcnbzmf-X-Reload-Triggers-caddy.drv
  /nix/store/q1mlymxd1ld8fjfmphipid5d5c9h8hyl-unit-caddy.service.drv
  /nix/store/ih6kzndwpffrd8v3hc9n4bl6p3fynw0h-system-units.drv
  /nix/store/7m6vif383c1v5n9kkdkbgcr32434413n-etc.drv
  /nix/store/dcf8q5qqm5kb3nfcj8kl7zfs4fgwiidk-boot.json.drv
  /nix/store/n5zgzd8kmnar82qd58ycw6z97vmymdsr-activate.drv
  /nix/store/pv0dybshsabgxf6n8wmdq64lgdimx4pf-perl-5.42.0-env.drv
  /nix/store/jlm84971sqvnpmd2pbpyrgz7h0nj19sc-nixos-system-nixos-26.05.20260121.88d3861.drv
these 52 paths will be fetched (15.21 MiB download, 88.91 MiB unpacked):
  /nix/store/8b0awqgjigp3x6y06jq0ndcmmf6jlr00-binaryen-125
  /nix/store/l751xw23rbbix9h3j6j8p91jm8s48gkv-cargo-git-https-github.com-arilotter-bitvec-d33a2437f810ee4229457dfd1137d807914671f8
  /nix/store/v41vzpxawzshad1137irrlqbf3g2pknx-cargo-git-https-github.com-arilotter-ts-rs.git-92ce1752227fec9bb868ad8f25b26f110a795099
  /nix/store/d1pa1j2lrsqbwif9wbv82lh7qddv0gml-cargo-git-https-github.com-coral-xyz-anchor.git-a7a23eea308440a9fa9cb79cee7bddd30ab163d5
  /nix/store/67vwdkhxkr5v3y1jniyzaadvid3sihrv-cargo-package-ahash-0.8.11
  /nix/store/4rcqlgh703y3is050jbqdn9j7j3nxmn9-cargo-package-anyhow-1.0.98
  /nix/store/98kzyhiny3hlkdcyy4w7zbk8anidpwyc-cargo-package-async-trait-0.1.83
  /nix/store/swrf85j9ppn5nl8dix2mxxms9bfjkd44-cargo-package-autocfg-1.4.0
  /nix/store/bancyd0805myzn7rxb5s3r1ljhpkac90-cargo-package-bitflags-2.6.0
  /nix/store/f31jgrf5l2ndpsd84n0vifgjazwgnz0n-cargo-package-borsh-1.5.3
  /nix/store/wwd993avgzrk5xjdivcb74h1imsbwm87-cargo-package-bumpalo-3.16.0
  /nix/store/3cd1kivcigxqvg5a4s3y1k02fgwzn691-cargo-package-chrono-0.4.38
  /nix/store/wvjghqh3sj6a6nia93iqxpj0xf6b9jvi-cargo-package-cpufeatures-0.2.16
  /nix/store/cn86im19f3pgjvzd34s1b9s5ssqb45m9-cargo-package-crunchy-0.2.2
  /nix/store/0z1ln61ppr426f97dxjh10ypyv736jm1-cargo-package-darling_core-0.20.10
  /nix/store/60kk43nqxyag3a2qal08vp47yrgsp07n-cargo-package-data-encoding-2.8.0
  /nix/store/78qaf8lzqd3c0nwkl1zza0m5fq1a0lgv-cargo-package-deranged-0.3.11
  /nix/store/wrz8rnl8pn6q2i7bs3v60nlnql2lj2nl-cargo-package-either-1.13.0
  /nix/store/gr2ljp51fzyq2q36x0l06a84kpjclmm1-cargo-package-equivalent-1.0.1
  /nix/store/rymid1slq0zsw8a5w4lb864kls7wx3xy-cargo-package-five8_core-0.1.1
  /nix/store/k0d2430l9wdifhai4bv5a4lcykjwm5jc-cargo-package-js-sys-0.3.74
  /nix/store/wjl81cl840cj6bvm08i4a56ifbkxj19g-cargo-package-num_enum-0.7.3
  /nix/store/igbimyrrhigarfiv0adqccj0c9krp8xx-cargo-package-num_enum_derive-0.7.3
  /nix/store/p6snn2bpxknim84ll6h7pw8j8a8073ld-cargo-package-openssl-0.10.68
  /nix/store/phcbh62s13h0drlx6l86ywlbdghh64gd-cargo-package-parking_lot_core-0.9.10
  /nix/store/pmgw84l7h9lzsab5fhhm8iwc574c7dr7-cargo-package-proc-macro-crate-3.2.0
  /nix/store/s1lzsc175mm29fyyh5q26s96l9ib2664-cargo-package-quote-1.0.37
  /nix/store/7f31ir36hjrngahz1sfybr83d2ygslfs-cargo-package-regex-1.11.1
  /nix/store/hwz2s54rlj27l98dib338ms1s0zy3a2r-cargo-package-regex-automata-0.4.9
  /nix/store/jc6wa27dbhifpkjqhb4895fxz5dvs154-cargo-package-regex-syntax-0.8.5
  /nix/store/9gaxp27rrqjjphr2r47a91q8c767fivq-cargo-package-semver-1.0.23
  /nix/store/yg0d9vrdb5zlfvpmwcv7rwhzc55q2lpm-cargo-package-serde_bytes-0.11.15
  /nix/store/ymsc79zirfryw5c7wq5kz67fpmclxxca-cargo-package-serde_derive-1.0.217
  /nix/store/j3wp3mgx2n6i19kafdwrn6yj3b982b92-cargo-package-serde_json-1.0.140
  /nix/store/l05hxiq7p4vpxm0sl3qrral0g4vwk59x-cargo-package-serde_spanned-0.6.8
  /nix/store/4bnbkg4v6fqgr5wjjvqgxpk0pks6jfqv-cargo-package-serde_with-3.11.0
  /nix/store/4jc2fphf5v95fjj32ryqpvzrwn6akw1y-cargo-package-serde_with_macros-3.11.0
  /nix/store/rnjnf8rn97c73crbyvw9zp5vb7vl0y7g-cargo-package-spl-discriminator-syn-0.2.0
  /nix/store/ijjdcpfiwdjrq5ypib6na4qzglsalspd-cargo-package-thiserror-impl-2.0.12
  /nix/store/4mks2kcjhkvx1sm5gm3x9ml08cwzbqdb-cargo-package-time-0.3.37
  /nix/store/lhn4x5dfg3xx582r7wfinv947q1q96ld-cargo-package-toml_edit-0.22.22
  /nix/store/7v3kqgqhzqprix0fmbkkggjajzrmpc8s-cargo-package-unicode-ident-1.0.14
  /nix/store/hl2my9d6a16g7l2j7228b17mhx5rdizy-cargo-package-wasi-0.11.0+wasi-snapshot-preview1
  /nix/store/pf8mgphkhs8169csskggsr025bnyn6yw-cargo-package-wasm-bindgen-0.2.97
  /nix/store/xf1nvzzwabmppn7c6gk0qgr8g1n5mxpg-cargo-package-wasm-bindgen-shared-0.2.97
  /nix/store/61df3vwy9vnx16ngjppgxarn9bcpsvbg-cargo-package-zerocopy-0.7.35
  /nix/store/ifhzvz7xp90p1mzfqa2gyvampdw7p9yq-cargo-package-zerocopy-derive-0.7.35
  /nix/store/p60gfq2vfqikc574w644p63a7wh9804k-cargo-package-zeroize-1.8.1
  /nix/store/dfn75p7igp6yzyzim0kb57lnl6j11k2h-check-sshd-config
  /nix/store/4w0spqkn44zlrys9y93x06h949dvcpj8-ensure-all-wrappers-paths-exist
  /nix/store/6r8hv0jpa2n34i2lxknsz6mgzgxwdg4j-make-binary-wrapper-hook
  /nix/store/361j7m41s23najg5wr7lwbkgwp6xjbb7-wasm-bindgen-cli-0.2.108