Add parallelism_auto flag to automatically set dp, tp and micro batch size - #516

psyche-workspace-nextest-0.2.0>         PASS [   0.648s] (132/218) psyche-modeling device_utils::tests::test_parse_device
psyche-workspace-nextest-0.2.0>         PASS [   0.667s] (133/218) psyche-data-provider::weighted test_weighted_data_provider_equal_weights
psyche-workspace-nextest-0.2.0>         PASS [   0.671s] (134/218) psyche-modeling distro::tests::test_dct
psyche-workspace-nextest-0.2.0>         PASS [   0.587s] (135/218) psyche-modeling distro::tests::test_encode_2d
psyche-workspace-nextest-0.2.0>         PASS [   0.692s] (136/218) psyche-data-provider::weighted test_weighted_data_provider_exhaustive
psyche-workspace-nextest-0.2.0>         PASS [   0.709s] (137/218) psyche-data-provider::weighted test_weighted_data_provider_consistency
psyche-workspace-nextest-0.2.0>         PASS [   0.701s] (138/218) psyche-modeling distro::tests::test_decode_1d
psyche-workspace-nextest-0.2.0>         PASS [   0.708s] (139/218) psyche-modeling distro::tests::test_decompress_1d
psyche-workspace-nextest-0.2.0>         PASS [   0.726s] (140/218) psyche-modeling distro::tests::test_edge_cases
psyche-workspace-nextest-0.2.0>         PASS [   0.777s] (141/218) psyche-data-provider::weighted test_weighted_data_provider_unequal_weights
psyche-workspace-nextest-0.2.0>         PASS [   0.799s] (142/218) psyche-modeling device_utils::tests::test_get_device_for_rank_multiple_workers
psyche-workspace-nextest-0.2.0>         PASS [   0.820s] (143/218) psyche-data-provider weighted::http::export_bindings_weightedhttpprovidersconfig
psyche-workspace-nextest-0.2.0>         PASS [   0.802s] (144/218) psyche-modeling distro::tests::test_encode_1d
psyche-workspace-nextest-0.2.0>         PASS [   0.710s] (145/218) psyche-modeling distro::tests::test_get_divisors
psyche-workspace-nextest-0.2.0>         PASS [   0.823s] (146/218) psyche-data-provider::local loads_fineweb_subset
psyche-workspace-nextest-0.2.0>         PASS [   0.612s] (147/218) psyche-modeling distro::tests::test_get_prime_divisors
psyche-workspace-nextest-0.2.0>         PASS [   0.845s] (148/218) psyche-data-provider::preprocessed loads_hermes3_subset
psyche-workspace-nextest-0.2.0>         PASS [   0.664s] (149/218) psyche-modeling distro::tests::test_get_smaller_split
psyche-workspace-nextest-0.2.0>         PASS [   0.974s] (150/218) psyche-data-provider::http test_http_data_provider
psyche-workspace-nextest-0.2.0>         PASS [   1.033s] (151/218) psyche-modeling distro::tests::test_1bit_matches_non_quant
psyche-workspace-nextest-0.2.0>         PASS [   1.074s] (152/218) psyche-data-provider::local loads_dolma_subset
psyche-workspace-nextest-0.2.0>         PASS [   0.017s] (153/218) psyche-solana-authorizer test_id
psyche-workspace-nextest-0.2.0>         PASS [   1.111s] (154/218) psyche-data-provider weighted::http::tests::test_http_multi_data_provider
psyche-workspace-nextest-0.2.0>         PASS [   0.575s] (155/218) psyche-network download::scheduler::tests::test_remove_retry
psyche-workspace-nextest-0.2.0>         PASS [   0.684s] (156/218) psyche-network download::scheduler::tests::test_distro_max_retries_exceeded
psyche-workspace-nextest-0.2.0>         PASS [   0.665s] (157/218) psyche-network download::scheduler::tests::test_model_sharing_retry_respects_capacity
psyche-workspace-nextest-0.2.0>         PASS [   0.010s] (158/218) psyche-solana-coordinator test_id
psyche-workspace-nextest-0.2.0>         PASS [   0.635s] (159/218) psyche-network download::scheduler::tests::test_waiters_are_served_fifo
psyche-workspace-nextest-0.2.0>         PASS [   0.019s] (160/218) psyche-solana-mining-pool test_id
psyche-workspace-nextest-0.2.0>         PASS [   0.761s] (161/218) psyche-modeling distro::tests::test_idct
psyche-workspace-nextest-0.2.0>         PASS [   0.707s] (162/218) psyche-network download::scheduler::tests::test_distro_retry_not_immediately_due
psyche-workspace-nextest-0.2.0>         PASS [   0.030s] (163/218) psyche-solana-tooling::mod suites::memnet_coordinator_data_layout::run
psyche-workspace-nextest-0.2.0>         PASS [   0.702s] (164/218) psyche-network download::scheduler::tests::test_release_unblocks_waiter
psyche-workspace-nextest-0.2.0>         PASS [   0.656s] (165/218) psyche-network serializable_tensor::tests::test_roundtrip_bool_tensor1d
psyche-workspace-nextest-0.2.0>         PASS [   0.807s] (166/218) psyche-modeling distro::tests::test_signed_vals_reconstructs_original_sign
psyche-workspace-nextest-0.2.0>         PASS [   0.847s] (167/218) psyche-network download::scheduler::tests::test_config_retries_dont_consume_capacity
psyche-workspace-nextest-0.2.0>         PASS [   0.822s] (168/218) psyche-network download::scheduler::tests::test_model_sharing_never_exceeds_max_retries
psyche-workspace-nextest-0.2.0>         PASS [   0.843s] (169/218) psyche-network download::scheduler::tests::test_parameter_retries_are_immediate
psyche-workspace-nextest-0.2.0>         PASS [   0.696s] (170/218) psyche-network serializable_tensor::tests::test_roundtrip_bool_tensor_non_divisible_by_8
psyche-workspace-nextest-0.2.0>         PASS [   0.005s] (171/218) psyche-solana-treasurer test_id
psyche-workspace-nextest-0.2.0>         PASS [   0.747s] (172/218) psyche-network serializable_tensor::tests::test_roundtrip_tensor2d
psyche-workspace-nextest-0.2.0>         PASS [   0.870s] (173/218) psyche-network router::tests::test_shutdown
psyche-workspace-nextest-0.2.0>         PASS [   0.841s] (174/218) psyche-network serializable_tensor::tests::test_roundtrip_bool_tensor2d
psyche-workspace-nextest-0.2.0>         PASS [   0.983s] (175/218) psyche-network download::scheduler::tests::test_distro_retries_returned_and_removed
psyche-workspace-nextest-0.2.0>         PASS [   1.049s] (176/218) psyche-network download::scheduler::tests::test_capacity_grants_up_to_max
psyche-workspace-nextest-0.2.0>         PASS [   1.021s] (177/218) psyche-network download::scheduler::tests::test_distro_retries_dont_consume_capacity
psyche-workspace-nextest-0.2.0>         PASS [   0.213s] (178/218) psyche-solana-tooling::mod suites::memnet_treasurer_create_claim::run
psyche-workspace-nextest-0.2.0>         PASS [   0.596s] (179/218) psyche-solana-client::bin/psyche-solana-client network_identity::tests::test_network_identity_display
psyche-workspace-nextest-0.2.0>         PASS [   1.698s] (180/218) psyche-data-provider::http test_http_data_provider_shuffled
psyche-workspace-nextest-0.2.0>         PASS [   0.352s] (181/218) psyche-solana-tooling::mod suites::memnet_coordinator_init_free::run
psyche-workspace-nextest-0.2.0>         PASS [   0.320s] (182/218) psyche-solana-tooling::mod suites::memnet_mining_pool_live_freeze::run
psyche-workspace-nextest-0.2.0>         PASS [   1.038s] (183/218) psyche-network download::scheduler::tests::test_wait_for_capacity_errors_on_actor_shutdown
psyche-workspace-nextest-0.2.0>         PASS [   0.336s] (184/218) psyche-solana-tooling::mod suites::memnet_mining_pool_full_cycle::run
psyche-workspace-nextest-0.2.0>         PASS [   1.148s] (185/218) psyche-modeling distro::tests::test_large_numbers
psyche-workspace-nextest-0.2.0>         PASS [   0.396s] (186/218) psyche-solana-tooling::mod suites::memnet_authorizer_full_cycle::run
psyche-workspace-nextest-0.2.0>         PASS [   0.307s] (187/218) psyche-solana-tooling::mod suites::memnet_treasurer_create_update::run
psyche-workspace-nextest-0.2.0>         PASS [   0.941s] (188/218) psyche-network serializable_tensor::tests::test_roundtrip_tensor_manyd
psyche-workspace-nextest-0.2.0>         PASS [   0.964s] (189/218) psyche-network serializable_tensor::tests::test_roundtrip_tensor1d
psyche-workspace-nextest-0.2.0>         PASS [   1.004s] (190/218) psyche-network serializable_tensor::tests::test_roundtrip_bool_tensor_unusual_shape
psyche-workspace-nextest-0.2.0>         PASS [   0.446s] (191/218) psyche-solana-tooling::mod suites::memnet_mining_pool_cap_deposits::run
psyche-workspace-nextest-0.2.0>         PASS [   1.028s] (192/218) psyche-network serializable_tensor::tests::test_roundtrip_bool_tensor_manyd
psyche-workspace-nextest-0.2.0>         PASS [   0.582s] (193/218) psyche-solana-client::bin/psyche-solana-client network_identity::tests::test_network_identity_invalid_challenge
psyche-workspace-nextest-0.2.0>         PASS [   0.966s] (194/218) psyche-network serialized_distro::tests::test_roundtrip_distro_result_1bit
psyche-workspace-nextest-0.2.0>         PASS [   1.034s] (195/218) psyche-network serializable_tensor::tests::test_roundtrip_bool_tensor_single_element
psyche-workspace-nextest-0.2.0>         PASS [   0.811s] (196/218) psyche-solana-client::bin/psyche-solana-client network_identity::tests::test_network_identity_hash
psyche-workspace-nextest-0.2.0>         PASS [   0.628s] (197/218) psyche-solana-client::bin/psyche-solana-client network_identity::tests::test_network_identity_roundtrip
psyche-workspace-nextest-0.2.0>         PASS [   1.972s] (198/218) psyche-centralized-testing::integration_tests connect_single_node
psyche-workspace-nextest-0.2.0>         PASS [   0.690s] (199/218) psyche-solana-tooling::mod suites::memnet_treasurer_full_epoch::run
psyche-workspace-nextest-0.2.0>         PASS [   2.340s] (200/218) psyche-centralized-testing::integration_tests state_change_waiting_for_members_to_warmup
psyche-workspace-nextest-0.2.0>         PASS [   1.006s] (201/218) psyche-solana-tooling::mod suites::memnet_coordinator_full_round::run
psyche-workspace-nextest-0.2.0>         PASS [   2.490s] (202/218) psyche-modeling distro::tests::test_artifical_distro_results_roundtrip
psyche-workspace-nextest-0.2.0>         PASS [   2.533s] (203/218) psyche-inference vllm::tests::test_list_engines
psyche-workspace-nextest-0.2.0>         PASS [   1.354s] (204/218) psyche-solana-tooling::mod suites::memnet_coordinator_rewards::run
psyche-workspace-nextest-0.2.0>         PASS [   2.181s] (205/218) psyche-network router::tests::test_allowlist
psyche-workspace-nextest-0.2.0>         PASS [   3.141s] (206/218) psyche-centralized-testing::integration_tests state_change_shutdown_node_in_warmup
psyche-workspace-nextest-0.2.0>         PASS [   3.172s] (207/218) psyche-centralized-testing::integration_tests connect_multiple_nodes
psyche-workspace-nextest-0.2.0>         PASS [  16.709s] (208/218) psyche-centralized-testing::integration_tests state_change_waiting_for_members_to_round_witness
psyche-workspace-nextest-0.2.0>         PASS [  19.123s] (209/218) psyche-centralized-testing::integration_tests replace_node_and_complete_round
psyche-workspace-nextest-0.2.0>         PASS [  19.523s] (210/218) psyche-network test::test_retry_connection
psyche-workspace-nextest-0.2.0>         PASS [  21.588s] (211/218) psyche-centralized-testing::integration_tests state_change_waiting_for_members_to_round_train
psyche-workspace-nextest-0.2.0>         PASS [  22.594s] (212/218) psyche-network test::test_retry_connection_mid_download
psyche-workspace-nextest-0.2.0>         PASS [  24.141s] (213/218) psyche-centralized-testing::integration_tests shutdown_node_in_training_and_complete_round
psyche-workspace-nextest-0.2.0>         PASS [  31.157s] (214/218) psyche-centralized-testing::integration_tests validate_all_clients_participate_in_witness_bloom
psyche-workspace-nextest-0.2.0>         PASS [  42.292s] (215/218) psyche-centralized-testing::integration_tests finish_epoch
psyche-workspace-nextest-0.2.0>         PASS [  47.246s] (216/218) psyche-centralized-testing::integration_tests client_join_in_training
psyche-workspace-nextest-0.2.0>         SLOW [> 60.000s] (-------) psyche-centralized-testing::integration_tests two_clients_join_in_training_and_get_model_using_p2p
psyche-workspace-nextest-0.2.0>         SLOW [> 60.000s] (-------) psyche-centralized-testing::integration_tests client_join_in_training_and_get_model_using_p2p
psyche-workspace-nextest-0.2.0>         PASS [  82.864s] (217/218) psyche-centralized-testing::integration_tests client_join_in_training_and_get_model_using_p2p
psyche-workspace-nextest-0.2.0>         PASS [  87.924s] (218/218) psyche-centralized-testing::integration_tests two_clients_join_in_training_and_get_model_using_p2p
psyche-workspace-nextest-0.2.0> ------------
psyche-workspace-nextest-0.2.0>      Summary [  87.924s] 218 tests run: 218 passed (2 slow), 2 skipped
psyche-workspace-nextest-0.2.0> checkPhase completed in 3 minutes 16 seconds
psyche-workspace-nextest-0.2.0> Running phase: installPhase
psyche-workspace-nextest-0.2.0> linking previous artifacts /nix/store/avw926dbmmvh5r8hs0zfnm1n9q886zmg-psyche-workspace-deps-0.2.0/target.tar.zst to /nix/store/r05n8y2fk4km0bphyjn5l1h2pgpk96bw-psyche-workspace-nextest-0.2.0/target.tar.zst
psyche-workspace-nextest-0.2.0> /*stdin*\            : 30.47%   (   804 MiB =>    245 MiB, /nix/store/r05n8y2fk4km0bphyjn5l1h2pgpk96bw-psyche-workspace-nextest-0.2.0/target.tar.zst) 
psyche-workspace-nextest-0.2.0> Running phase: fixupPhase
psyche-workspace-nextest-0.2.0> shrinking RPATHs of ELF executables and libraries in /nix/store/r05n8y2fk4km0bphyjn5l1h2pgpk96bw-psyche-workspace-nextest-0.2.0
psyche-workspace-nextest-0.2.0> checking for references to /build/ in /nix/store/r05n8y2fk4km0bphyjn5l1h2pgpk96bw-psyche-workspace-nextest-0.2.0...
psyche-workspace-nextest-0.2.0> patching script interpreter paths in /nix/store/r05n8y2fk4km0bphyjn5l1h2pgpk96bw-psyche-workspace-nextest-0.2.0
psyche-workspace-nextest-0.2.0> shrinking RPATHs of ELF executables and libraries in /nix/store/r05n8y2fk4km0bphyjn5l1h2pgpk96bw-psyche-workspace-nextest-0.2.0