Skip to content

improve model debugging workflow - #611

Open
ethernet8023 wants to merge 8 commits into
mainfrom
train-refactor
Open

improve model debugging workflow#611
ethernet8023 wants to merge 8 commits into
mainfrom
train-refactor

modeling: work around noexec tmp dirs for triton cache

2be4669
Select commit
Loading
Failed to load commit list.
Garnix CI / check workspace-clippy [x86_64-linux] succeeded Mar 18, 2026 in 3m 4s

check workspace-clippy [x86_64-linux]

check workspace-clippy [x86_64-linux] succeeded

Details

Last 100 lines of logs:

psyche-workspace-clippy-0.2.0>     Checking hyper-rustls v0.24.2
psyche-workspace-clippy-0.2.0>     Checking reqwest v0.11.27
psyche-workspace-clippy-0.2.0>     Checking psyche-solana-treasurer v0.2.0 (/build/source/architectures/decentralized/solana-treasurer/programs/solana-treasurer)
psyche-workspace-clippy-0.2.0>     Checking psyche-deserialize-zerocopy-wasm v0.2.0 (/build/source/website/wasm)
psyche-workspace-clippy-0.2.0>     Checking pyo3-tch v0.22.0 (https://github.com/NousResearch/tch-rs.git?rev=dda507e05a776547a112b6854d1e611684f8c729#dda507e0)
psyche-workspace-clippy-0.2.0>     Checking psyche-sidecar v0.2.0 (/build/source/tools/rust-tools/psyche-sidecar)
psyche-workspace-clippy-0.2.0>     Checking psyche-modeling v0.2.0 (/build/source/shared/modeling)
psyche-workspace-clippy-0.2.0>     Checking hickory-resolver v0.25.2
psyche-workspace-clippy-0.2.0>     Checking hyper-rustls v0.27.7
psyche-workspace-clippy-0.2.0>     Checking hyper-tls v0.6.0
psyche-workspace-clippy-0.2.0>     Checking igd-next v0.16.2
psyche-workspace-clippy-0.2.0>     Checking axum v0.7.9
psyche-workspace-clippy-0.2.0>     Checking hyperlocal v0.9.1
psyche-workspace-clippy-0.2.0>     Checking bollard v0.18.1
psyche-workspace-clippy-0.2.0>     Checking solana-metrics v2.1.4
psyche-workspace-clippy-0.2.0>     Checking reqwest-middleware v0.2.5
psyche-workspace-clippy-0.2.0>     Checking reqwest v0.12.28
psyche-workspace-clippy-0.2.0>     Checking solana-rpc-client-api v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-program-runtime v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-connection-cache v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-accounts-db v2.1.4
psyche-workspace-clippy-0.2.0>     Checking portmapper v0.14.0
psyche-workspace-clippy-0.2.0>     Checking solana-vote-program v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-config-program v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-bpf-loader-program v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-system-program v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-address-lookup-table-program v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-compute-budget-program v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-zk-token-proof-program v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-zk-elgamal-proof-program v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-account-decoder v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-perf v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-stake-program v2.1.4
psyche-workspace-clippy-0.2.0>     Checking opentelemetry-http v0.28.0
psyche-workspace-clippy-0.2.0>     Checking pkarr v5.0.2
psyche-workspace-clippy-0.2.0>     Checking google-cloud-metadata v0.5.1
psyche-workspace-clippy-0.2.0>     Checking reqwest-middleware v0.4.2
psyche-workspace-clippy-0.2.0>     Checking hf-hub v0.3.2 (https://github.com/NousResearch/hf-hub.git?rev=269dc3df4e194f9071ddbdbd25ed90d4990f9262#269dc3df)
psyche-workspace-clippy-0.2.0>     Checking wandb v0.1.0 (https://github.com/NousResearch/wandb-rs.git?rev=db6118e3bf3526718c1097baecf36f564233a735#db6118e3)
psyche-workspace-clippy-0.2.0>     Checking solana-transaction-metrics-tracker v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-rpc-client v2.1.4
psyche-workspace-clippy-0.2.0>     Checking google-cloud-auth v0.17.2
psyche-workspace-clippy-0.2.0>     Checking solana-streamer v2.1.4
psyche-workspace-clippy-0.2.0>     Checking psyche-python-extension-impl v0.2.0 (/build/source/python/extension-impl)
psyche-workspace-clippy-0.2.0>     Checking opentelemetry-otlp v0.28.0
psyche-workspace-clippy-0.2.0>     Checking solana-loader-v4-program v2.1.4
psyche-workspace-clippy-0.2.0>     Checking iroh-relay v0.96.1
psyche-workspace-clippy-0.2.0>     Checking solana-builtins-default-costs v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-pubsub-client v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-transaction-status v2.1.4
psyche-workspace-clippy-0.2.0>     Checking psyche-centralized-local-testnet v0.2.0 (/build/source/architectures/centralized/local-testnet)
psyche-workspace-clippy-0.2.0>     Checking solana-runtime-transaction v2.1.4
psyche-workspace-clippy-0.2.0>     Checking logfire v0.4.0 (https://github.com/NousResearch/logfire-rust?rev=497574bff53f27db42ee4e581fea2658561c7833#497574bf)
psyche-workspace-clippy-0.2.0>     Checking solana-quic-client v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-udp-client v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-svm v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-cost-model v2.1.4
psyche-workspace-clippy-0.2.0>     Checking psyche-tui v0.2.0 (/build/source/shared/tui)
psyche-workspace-clippy-0.2.0>     Checking solana-rpc-client-nonce-utils v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-tpu-client v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-thin-client v2.1.4
psyche-workspace-clippy-0.2.0>     Checking psyche-watcher v0.2.0 (/build/source/shared/watcher)
psyche-workspace-clippy-0.2.0>     Checking solana-client v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-runtime v2.1.4
psyche-workspace-clippy-0.2.0>     Checking iroh v0.96.1
psyche-workspace-clippy-0.2.0>     Checking google-cloud-storage v0.24.0
psyche-workspace-clippy-0.2.0>     Checking anchor-client v0.30.1 (https://github.com/coral-xyz/anchor.git?rev=a7a23eea308440a9fa9cb79cee7bddd30ab163d5#a7a23eea)
psyche-workspace-clippy-0.2.0>     Checking psyche-solana-rpc v0.2.0 (/build/source/architectures/decentralized/solana-common)
psyche-workspace-clippy-0.2.0>     Checking solana-send-transaction-service v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-banks-server v2.1.4
psyche-workspace-clippy-0.2.0>     Checking solana-program-test v2.1.4
psyche-workspace-clippy-0.2.0>     Checking irpc-iroh v0.12.0
psyche-workspace-clippy-0.2.0>     Checking iroh-gossip v0.96.0
psyche-workspace-clippy-0.2.0>     Checking iroh-blobs v0.98.0
psyche-workspace-clippy-0.2.0>     Checking psyche-inference v0.2.0 (/build/source/shared/inference)
psyche-workspace-clippy-0.2.0>     Checking solana_toolbox_endpoint v0.4.4-solana-2.1.4
psyche-workspace-clippy-0.2.0>     Checking iroh-services v0.11.0
psyche-workspace-clippy-0.2.0>     Checking psyche-solana-tooling v0.2.0 (/build/source/architectures/decentralized/solana-tooling)
psyche-workspace-clippy-0.2.0>     Checking psyche-network v0.2.0 (/build/source/shared/network)
psyche-workspace-clippy-0.2.0>     Checking psyche-data-provider v0.2.0 (/build/source/shared/data-provider)
psyche-workspace-clippy-0.2.0>     Checking psyche-inference-node v0.2.0 (/build/source/architectures/inference-only/inference-node)
psyche-workspace-clippy-0.2.0>     Checking psyche-eval v0.2.0 (/build/source/shared/eval)
psyche-workspace-clippy-0.2.0>     Checking train v0.2.0 (/build/source/tools/rust-tools/train)
psyche-workspace-clippy-0.2.0>     Checking psyche-client v0.2.0 (/build/source/shared/client)
psyche-workspace-clippy-0.2.0>     Checking psyche-centralized-shared v0.2.0 (/build/source/architectures/centralized/shared)
psyche-workspace-clippy-0.2.0>     Checking psyche-solana-client v0.2.0 (/build/source/architectures/decentralized/solana-client)
psyche-workspace-clippy-0.2.0>     Checking psyche-decentralized-testing v0.2.0 (/build/source/architectures/decentralized/testing)
psyche-workspace-clippy-0.2.0>     Checking expand-distro v0.2.0 (/build/source/tools/rust-tools/expand-distro)
psyche-workspace-clippy-0.2.0>     Checking psyche-centralized-server v0.2.0 (/build/source/architectures/centralized/server)
psyche-workspace-clippy-0.2.0>     Checking psyche-centralized-client v0.2.0 (/build/source/architectures/centralized/client)
psyche-workspace-clippy-0.2.0>     Checking psyche-centralized-testing v0.2.0 (/build/source/architectures/centralized/testing)
psyche-workspace-clippy-0.2.0>     Finished `release` profile [optimized] target(s) in 22.56s
psyche-workspace-clippy-0.2.0> Running phase: installPhase
psyche-workspace-clippy-0.2.0> linking previous artifacts /nix/store/qdafq8dgzb0jxpynxgqc6mqh8vx3gl4b-psyche-workspace-deps-0.2.0/target.tar.zst to /nix/store/yi7lx2c75m40a4svlr90lw08jpyr40nv-psyche-workspace-clippy-0.2.0/target.tar.zst
psyche-workspace-clippy-0.2.0> /*stdin*\            : 35.16%   (   115 MiB =>   40.6 MiB, /nix/store/yi7lx2c75m40a4svlr90lw08jpyr40nv-psyche-workspace-clippy-0.2.0/target.tar.zst) 
psyche-workspace-clippy-0.2.0> Running phase: fixupPhase
psyche-workspace-clippy-0.2.0> shrinking RPATHs of ELF executables and libraries in /nix/store/yi7lx2c75m40a4svlr90lw08jpyr40nv-psyche-workspace-clippy-0.2.0
psyche-workspace-clippy-0.2.0> checking for references to /build/ in /nix/store/yi7lx2c75m40a4svlr90lw08jpyr40nv-psyche-workspace-clippy-0.2.0...
psyche-workspace-clippy-0.2.0> patching script interpreter paths in /nix/store/yi7lx2c75m40a4svlr90lw08jpyr40nv-psyche-workspace-clippy-0.2.0
psyche-workspace-clippy-0.2.0> shrinking RPATHs of ELF executables and libraries in /nix/store/yi7lx2c75m40a4svlr90lw08jpyr40nv-psyche-workspace-clippy-0.2.0