Add parallelism_auto flag to automatically set dp, tp and micro batch size - #516

psyche-http-mainnet> failed running package evaluation. If you have `nix` installed, you can reproduce the error locally by running: prlimit --as=8589934592 nix build /tmp/garnix-runs-9c82cf9bacb51818#nixosConfigurations.psyche-http-mainnet.config.system.build.toplevel --dry-run --json
psyche-http-mainnet> error (ignored): error: SQLite database '/home/nix-runner/.cache/nix/eval-cache-v5/8cae366bf47dfaef3081060b442e50c5aa80d97ceb2e424ff6e4478d195b6b24.sqlite' is busy
error: RPC failed; HTTP 500 curl 22 The requested URL returned error: 500
fatal: expected flush after ref listing
error:
       … while calling the 'head' builtin
         at /nix/store/m6ji2a8jp7w4ck7vvrjh4grs4p3n7r26-source/lib/attrsets.nix:1713:13:
         1712|           if length values == 1 || pred here (elemAt values 1) (head values) then
         1713|             head values
             |             ^
         1714|           else

       … while evaluating the attribute 'value'
         at /nix/store/m6ji2a8jp7w4ck7vvrjh4grs4p3n7r26-source/lib/modules.nix:1118:7:
         1117|     // {
         1118|       value = addErrorContext "while evaluating the option `${showOption loc}':" value;
             |       ^
         1119|       inherit (res.defsFinal') highestPrio;

       … while evaluating the option `system.build.toplevel':

       … while evaluating definitions from `/nix/store/m6ji2a8jp7w4ck7vvrjh4grs4p3n7r26-source/nixos/modules/system/activation/top-level.nix':

       … while evaluating the option `services.caddy.configFile':

       … while evaluating the option `services.caddy.virtualHosts."http://psyche-http-mainnet.*.psyche.nousresearch.garnix.me".extraConfig':

       … while evaluating definitions from `/nix/store/m6ji2a8jp7w4ck7vvrjh4grs4p3n7r26-source/flake.nix':

       (stack trace truncated; use '--show-trace' to show the full, detailed trace)

       error: Cannot find Git revision 'db6118e3bf3526718c1097baecf36f564233a735' in ref 'refs/heads/main' of repository 'https://github.com/NousResearch/wandb-rs.git'! Please make sure that the rev exists on the ref you've specified or add allRefs = true; to fetchGit.