Skip to content

Add parallelism auto-detection from GCS via signed URLs - #620

Draft
pefontana wants to merge 2 commits into
run-down-signed-urlsfrom
gcs-parallelism_data
Draft

pefontana wants to merge 2 commits into
run-down-signed-urlsfrom
gcs-parallelism_data

Simplify parallelism auto-detection to GCS-only and add docs

380a6e4
Select commit
Loading
Failed to load commit list.
Garnix CI / check validate-psyche-http-caddyfile [x86_64-linux] succeeded Mar 6, 2026 in 8m 30s

check validate-psyche-http-caddyfile [x86_64-linux]

check validate-psyche-http-caddyfile [x86_64-linux] succeeded

Details

Last 100 lines of logs:

psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> ++++++ command cargo metadata --format-version 1 --no-deps
psyche-centralized-server-0.2.0> +++ command cargo --version
psyche-centralized-server-0.2.0> cargo 1.93.0 (083ac5135 2025-12-15)
psyche-centralized-server-0.2.0> +++ command cargo build --release --message-format json-render-diagnostics --features parallelism --bin psyche-centralized-server
psyche-centralized-server-0.2.0>    Compiling pyo3-build-config v0.24.2
psyche-centralized-server-0.2.0>    Compiling psyche-core v0.2.0 (/build/source/shared/core)
psyche-centralized-server-0.2.0>    Compiling psyche-tui v0.2.0 (/build/source/shared/tui)
psyche-centralized-server-0.2.0>    Compiling pyo3-macros-backend v0.24.2
psyche-centralized-server-0.2.0>    Compiling pyo3-ffi v0.24.2
psyche-centralized-server-0.2.0>    Compiling pyo3 v0.24.2
psyche-centralized-server-0.2.0>    Compiling psyche-coordinator v0.2.0 (/build/source/shared/coordinator)
psyche-centralized-server-0.2.0>    Compiling psyche-metrics v0.2.0 (/build/source/shared/metrics)
psyche-centralized-server-0.2.0>    Compiling psyche-watcher v0.2.0 (/build/source/shared/watcher)
psyche-centralized-server-0.2.0>    Compiling pyo3-macros v0.24.2
psyche-centralized-server-0.2.0>    Compiling pyo3-tch v0.22.0 (https://github.com/jquesnelle/tch-rs.git?rev=dda507e05a776547a112b6854d1e611684f8c729#dda507e0)
psyche-centralized-server-0.2.0>    Compiling psyche-modeling v0.2.0 (/build/source/shared/modeling)
psyche-centralized-server-0.2.0>    Compiling psyche-network v0.2.0 (/build/source/shared/network)
psyche-centralized-server-0.2.0>    Compiling psyche-data-provider v0.2.0 (/build/source/shared/data-provider)
psyche-centralized-server-0.2.0>    Compiling psyche-eval v0.2.0 (/build/source/shared/eval)
psyche-centralized-server-0.2.0>    Compiling psyche-client v0.2.0 (/build/source/shared/client)
psyche-centralized-server-0.2.0>    Compiling psyche-centralized-shared v0.2.0 (/build/source/architectures/centralized/shared)
psyche-centralized-server-0.2.0>    Compiling psyche-centralized-server v0.2.0 (/build/source/architectures/centralized/server)
psyche-centralized-server-0.2.0>     Finished `release` profile [optimized] target(s) in 54.44s
psyche-centralized-server-0.2.0> searching for bins/libs to install from cargo build log at cargoBuildLogD3J3.json
psyche-centralized-server-0.2.0> installing /build/source/target/release/psyche-centralized-server in postBuildInstallFromCargoBuildLogOutTempTiv/bin
psyche-centralized-server-0.2.0> searching for bins/libs complete
psyche-centralized-server-0.2.0> buildPhase completed in 58 seconds
psyche-centralized-server-0.2.0> Running phase: installPhase
psyche-centralized-server-0.2.0> stripping references to Rust toolchain
psyche-centralized-server-0.2.0> Rust toolchain at: /nix/store/h88fyzrg216pff3xyl9rqbbk4p0kjvg8-rust-default-1.93.0
psyche-centralized-server-0.2.0> stripping Rust toolchain references done
psyche-centralized-server-0.2.0> stripping references to cargoVendorDir from:
psyche-centralized-server-0.2.0> /nix/store/j073i91k1i921vblbgdxsqwj5v9l3dpw-psyche-centralized-server-0.2.0/bin/psyche-centralized-server
psyche-centralized-server-0.2.0> stripping references done
psyche-centralized-server-0.2.0> Running phase: fixupPhase
psyche-centralized-server-0.2.0> shrinking RPATHs of ELF executables and libraries in /nix/store/j073i91k1i921vblbgdxsqwj5v9l3dpw-psyche-centralized-server-0.2.0
psyche-centralized-server-0.2.0> shrinking /nix/store/j073i91k1i921vblbgdxsqwj5v9l3dpw-psyche-centralized-server-0.2.0/bin/psyche-centralized-server
psyche-centralized-server-0.2.0> checking for references to /build/ in /nix/store/j073i91k1i921vblbgdxsqwj5v9l3dpw-psyche-centralized-server-0.2.0...
psyche-centralized-server-0.2.0> patching script interpreter paths in /nix/store/j073i91k1i921vblbgdxsqwj5v9l3dpw-psyche-centralized-server-0.2.0
psyche-centralized-server-0.2.0> stripping (with command strip and flags -S -p) in  /nix/store/j073i91k1i921vblbgdxsqwj5v9l3dpw-psyche-centralized-server-0.2.0/bin
psyche-centralized-server-0.2.0> shrinking RPATHs of ELF executables and libraries in /nix/store/j073i91k1i921vblbgdxsqwj5v9l3dpw-psyche-centralized-server-0.2.0
psyche-centralized-server-0.2.0> shrinking /nix/store/j073i91k1i921vblbgdxsqwj5v9l3dpw-psyche-centralized-server-0.2.0/bin/psyche-centralized-server
psyche-centralized-server-0.2.0> autoFixElfFiles: using removeStubsFromRunpath to fix /nix/store/j073i91k1i921vblbgdxsqwj5v9l3dpw-psyche-centralized-server-0.2.0/bin/psyche-centralized-server
validate-psyche-http-caddyfile> 2026/03/06 15:47:52.820	INFO	using config from file	{"file": "./Caddyfile"}
validate-psyche-http-caddyfile> 2026/03/06 15:47:52.826	INFO	adapted config to JSON	{"adapter": "caddyfile"}
validate-psyche-http-caddyfile> Valid configuration