{ "_comment": [ "Measured locally with `bazel --nohome_rc test --config=embedded", "//cmd/bd:bd_embedded_test --local_test_jobs=8` alongside the storage-tier", "and conformance targets below (all four run in the same invocation, the", "same way bazel.yml's bazel-embedded tier runs its shards concurrently on", "one host) -- race, `-test.parallel=4`, tag filter `embedded`, run with the", "real committed 40-shard manifest (.github/scripts/embedded-cmd-test-shards.txt)", "so every one of the 242 TestEmbedded* functions that existed at capture time", "ran exactly once (local sandboxed execution only; no remote executor or", "cache flags were configured for this measurement run).", "", "Each value is that top-level test's own from Bazel's", "generated test.xml, NOT the enclosing . For this Go test", "binary / Bazel version, was found empirically to be a", "wall-clock-since-binary-start timestamp (it does not isolate a concurrently", "-run top-level test's own duration under -test.parallel=4), whereas", " matched the test binary's own `--- PASS: TestX (Ys)` line", "exactly. Do not switch this capture to without", "re-verifying that relationship for the toolchain in use at the time.", "", "F1 review correction (S1): an earlier pass of this file explained four", "outliers (TestEmbeddedUpdateConcurrent, TestEmbeddedCloseConcurrent,", "TestEmbeddedInitA, TestEmbeddedEpicCloseEligibleReason) as a", "\"queueing-delay\" artifact of Go's t.Parallel() clock starting before a", "test's parallel slot is granted, and shipped corrected-down weights on", "that theory. That explanation was WRONG and has been retracted: Go's", "testing package (testing.go's (*T).Parallel) adds the elapsed time to", "t.duration BEFORE blocking on the parallel-slot barrier, so queued-for-a-", "slot wait time is never counted in a test's own reported duration in the", "first place. The original large numbers were genuine CPU-bound running", "time under real resource contention (dozens of Bazel shards running", "concurrently on one host, each internally up to -test.parallel=4) -- this", "capture re-measures every test under exactly that condition (all 54", "cmd+storage+conformance shards running together, not solo) instead of", "mixing solo-measured corrections into a contended-capture baseline.", "", "Two of those four outliers (TestEmbeddedUpdateConcurrent,", "TestEmbeddedCloseConcurrent) are synthetic many-worker concurrency stress", "tests whose cost is dominated by serialized `bd` subprocess invocations", "behind the embedded engine's single-writer lock, not by -test.parallel", "contention; their recorded values below are post-fix estimates (measured", "value x 0.4) after cutting issuesPerWorker from 5 to 2 in both tests (see", "their doc comments in update_embedded_test.go / close_embedded_test.go) --", "pending a fresh capture to confirm. TestEmbeddedEpicCloseEligibleReason", "was split into TestEmbeddedEpicCloseEligibleReasonFlag (3 subtests) and", "TestEmbeddedEpicCloseEligibleReasonOutput (2 subtests); their recorded", "values are the measured combined total apportioned 3:2 by subtest count,", "also pending a fresh capture. TestEmbeddedInitA needed no further action:", "at ~196s under this consistent methodology it is close to but under the", "~200s single-test isolation threshold.", "", "Every test measuring at or above ~200s under this consistent load is", "pinned alone on its own shard in the generated manifest below (see that", "file's header); LPT bin-packing does this automatically as long as the", "weight is accurate, since no combination of lighter tests sums close to", "a ~200s+ single item without the packer preferring to isolate it.", "", "`seconds_per_init_fallback` is the weighted average seconds-per-init over", "every measured test in this file (sum of all durations / sum of all inits,", "where inits is discover_inits_cost()'s t.Run( count proxy), used only for a", "brand-new test with no entry yet (see", "scripts/ci/gen_embedded_cmd_shard_manifest.py's discover_inits_cost()).", "", "As with the proxied tier's duration file, these are a relative weight for", "LPT bin-packing, not an absolute SLA: within-shard -test.parallel=4", "overlap, farm noisy-neighbor effects, and future code changes all mean a", "shard's total packed cost is a planning estimate, not a guarantee." ], "seconds_per_init_fallback": 19.4828, "tests": { "TestEmbeddedAdminBlocked": 20.33, "TestEmbeddedAdminCompactReadOnlyAllowed": 21.99, "TestEmbeddedAdminCompactTier2Honesty": 25.2, "TestEmbeddedAutoImportFallback_ConflictSkip_DoesNotClobber": 28.23, "TestEmbeddedAutoImportFallback_ConflictSkip_EmptyDBImportsAll": 23.63, "TestEmbeddedAutoImportJSONLConcurrentWriter": 34.41, "TestEmbeddedAutoImportJSONLNoExplicitCommit": 64.27, "TestEmbeddedAutoImportJSONLSkipsNonEmpty": 27.53, "TestEmbeddedBackup": 162.68, "TestEmbeddedBackupConcurrent": 45.4, "TestEmbeddedBlocked": 35.34, "TestEmbeddedBlockedConcurrent": 51.71, "TestEmbeddedBlockedLabelFilters": 66.12, "TestEmbeddedBootstrap": 133.62, "TestEmbeddedBootstrapConcurrent": 23.4, "TestEmbeddedBranch": 128.64, "TestEmbeddedBranchConcurrent": 36.84, "TestEmbeddedChangeDirOverridesInheritedBeadsDir": 62.33, "TestEmbeddedChildren": 86.18, "TestEmbeddedChildrenConcurrent": 104.16, "TestEmbeddedClaimPools": 78.4, "TestEmbeddedCloseAlreadyClosed": 179.15, "TestEmbeddedCloseBasic": 158.81, "TestEmbeddedCloseConcurrent": 129.7, "TestEmbeddedCloseGuardsAndEpics": 105.86, "TestEmbeddedComments": 30.42, "TestEmbeddedCommentsCLI": 89.97, "TestEmbeddedCommentsCLIConcurrent": 38.85, "TestEmbeddedCompact": 166.61, "TestEmbeddedCompactConcurrent": 28.81, "TestEmbeddedCompactMisdatedChild": 33.71, "TestEmbeddedConfig": 83.45, "TestEmbeddedConfigConcurrent": 96.47, "TestEmbeddedConfigNoWorkspaceStoreFreeCommands": 6.09, "TestEmbeddedConfigValidateJSONNoWorkspaceWritesStdout": 0.35, "TestEmbeddedContext": 68.26, "TestEmbeddedContextConcurrent": 22.8, "TestEmbeddedContributorCreate": 166.08, "TestEmbeddedCount": 127.95, "TestEmbeddedCountConcurrent": 122.44, "TestEmbeddedCountIncludeEphemeral": 86.31, "TestEmbeddedCountIncludeInfra": 80.89, "TestEmbeddedCreateCommitPending": 41.89, "TestEmbeddedCreateConcurrent": 39.83, "TestEmbeddedCreateCrossRepo": 44.64, "TestEmbeddedCreateCrossRepoDryRunWithParent": 62.24, "TestEmbeddedCreateCrossRepoUninit": 45.69, "TestEmbeddedCreateCrossRepoWithParent": 80.27, "TestEmbeddedCreateDryRunCrossRepoDoesNotMigrateTarget": 48.57, "TestEmbeddedCreateDryRunDoesNotMigrate": 28.63, "TestEmbeddedCreateDryRunRepoDoesNotInitializeTarget": 24.56, "TestEmbeddedCreateFormCommitsLabelOnlyCreate": 31.46, "TestEmbeddedCreateGraphAndBulk": 114.91, "TestEmbeddedCreateJSONEchoesSubSecondTimestamps": 32.3, "TestEmbeddedCreateRepoFromNonBeadsCwd": 23.45, "TestEmbeddedCreateRepoProxiedTargetError": 45.4, "TestEmbeddedCreateRepoRelativeExistingWorkspaceUnaffected": 45.93, "TestEmbeddedCreateRepoRelativeUninitRefused": 24.13, "TestEmbeddedCreateScalarAndRelationships": 191.35, "TestEmbeddedCreateStorageClassBasic": 111.77, "TestEmbeddedCreateStorageClassBatchAndMisc": 163.68, "TestEmbeddedCreateStorageClassConflicts": 93.79, "TestEmbeddedCreateWithGitRemote": 25.17, "TestEmbeddedDefer": 92.03, "TestEmbeddedDeferAutoWake": 79.42, "TestEmbeddedDeferConcurrent": 121.28, "TestEmbeddedDelete": 122.43, "TestEmbeddedDeleteJSONDependencyErrorContract": 58.17, "TestEmbeddedDepA": 175.73, "TestEmbeddedDepAddWispSource": 58.14, "TestEmbeddedDepAndLinkBatchAutoCommitDoesNotAdvanceHead": 132.31, "TestEmbeddedDepB": 176.75, "TestEmbeddedDepBulkNoCycleCheckKeepsWholeGraphGate": 38.51, "TestEmbeddedDepConcurrent": 150.67, "TestEmbeddedDepListSingleIDWarnsOnDroppedExternalEdge": 66.98, "TestEmbeddedDepNoCycleCheck": 88.95, "TestEmbeddedDiff": 56.44, "TestEmbeddedDiffConcurrent": 68.69, "TestEmbeddedDirectCommitPathsBatchAutoCommitDoesNotAdvanceHead": 174.02, "TestEmbeddedDoltBlockedAndCommit": 59.12, "TestEmbeddedDoltConcurrent": 68.7, "TestEmbeddedDoltRemoteAndPush": 136.04, "TestEmbeddedDuplicate": 72.32, "TestEmbeddedDuplicateConcurrent": 69.38, "TestEmbeddedDuplicates": 173.68, "TestEmbeddedDuplicatesConcurrent": 59.24, "TestEmbeddedEpicCloseEligible": 149.47, "TestEmbeddedEpicCloseEligibleReasonFlag": 169.79, "TestEmbeddedEpicCloseEligibleReasonOutput": 113.2, "TestEmbeddedEpicConcurrent": 142.99, "TestEmbeddedEpicStatus": 95.11, "TestEmbeddedExplicitHierarchicalParentEdges": 65.84, "TestEmbeddedExportConcurrent": 44.93, "TestEmbeddedExportFlags": 130.38, "TestEmbeddedExportFormats": 115.36, "TestEmbeddedExternalCapabilityReadyAfterShip": 63.55, "TestEmbeddedExternalMutationPolicy": 116.06, "TestEmbeddedFederationConcurrent": 31.34, "TestEmbeddedFederationPeers": 146.53, "TestEmbeddedFederationStatus": 133.93, "TestEmbeddedFindDuplicates": 124.62, "TestEmbeddedFindDuplicatesConcurrent": 70.27, "TestEmbeddedFlatten": 161.6, "TestEmbeddedFlattenConcurrent": 32.13, "TestEmbeddedGC": 185.65, "TestEmbeddedGCConcurrent": 40.17, "TestEmbeddedGate": 181.85, "TestEmbeddedGateConcurrent": 66.94, "TestEmbeddedGateCreate": 123.16, "TestEmbeddedGateListScoped": 38.87, "TestEmbeddedGetDependencies": 59.85, "TestEmbeddedGraph": 81.16, "TestEmbeddedGraphConcurrent": 88.99, "TestEmbeddedHistory": 109.52, "TestEmbeddedHistoryConcurrent": 90.07, "TestEmbeddedHooks": 27.53, "TestEmbeddedHooksConcurrent": 23.45, "TestEmbeddedHuman": 97.66, "TestEmbeddedHumanConcurrent": 30.64, "TestEmbeddedImportClosedChildWhoseParentWasDeleted": 21.26, "TestEmbeddedImportConcurrent": 31.4, "TestEmbeddedImportFromSources": 124.38, "TestEmbeddedImportPromotedWispRoundtrip": 137.68, "TestEmbeddedImportUpsertAndPrefixSync": 111.37, "TestEmbeddedInfo": 41.38, "TestEmbeddedInfoConcurrent": 39.05, "TestEmbeddedInfoSuppressGitHooks": 33.35, "TestEmbeddedInitA": 196.25, "TestEmbeddedInitArtifactRouting": 22.67, "TestEmbeddedInitB": 145.22, "TestEmbeddedInitC": 23.58, "TestEmbeddedInitConcurrent": 47.95, "TestEmbeddedInitExplicitBeadsDirIsAuthoritative": 53.4, "TestEmbeddedInitGitBootstrapRouting": 158.28, "TestEmbeddedInitHooksRouting": 22.24, "TestEmbeddedInitRoleRouting": 125.08, "TestEmbeddedInitSelectedExcludeRouting": 153.06, "TestEmbeddedKV": 48.98, "TestEmbeddedKVConcurrent": 108.72, "TestEmbeddedLabelAddRemove": 138.68, "TestEmbeddedLabelConcurrent": 84.16, "TestEmbeddedLabelEditReports": 138.9, "TestEmbeddedLabelPropagateRename": 120.78, "TestEmbeddedLint": 82.71, "TestEmbeddedLintConcurrent": 75.72, "TestEmbeddedListComments": 51.81, "TestEmbeddedListConcurrent": 33.41, "TestEmbeddedListFiltering": 239.7, "TestEmbeddedListSearchAndOutput": 147.31, "TestEmbeddedMaxRowsDepTreeAndDuplicates": 97.69, "TestEmbeddedMaxRowsDoctorAndConfig": 90.88, "TestEmbeddedMaxRowsGraph": 159.26, "TestEmbeddedMaxRowsListBasic": 107.6, "TestEmbeddedMaxRowsListLimitInteraction": 192.0, "TestEmbeddedMaxRowsReady": 168.09, "TestEmbeddedMaxRowsReadyMerge": 78.54, "TestEmbeddedMemory": 130.17, "TestEmbeddedMemoryConcurrent": 95.43, "TestEmbeddedMigrate": 155.64, "TestEmbeddedMigrateConcurrent": 32.07, "TestEmbeddedOnboard": 25.75, "TestEmbeddedOnboardConcurrent": 22.91, "TestEmbeddedOpen_EmptyDatabaseRejected": 0.0, "TestEmbeddedOrphans": 40.45, "TestEmbeddedOrphansConcurrent": 65.99, "TestEmbeddedPreviewDoesNotConsumeVersionMarker": 29.99, "TestEmbeddedPrime": 32.69, "TestEmbeddedPrimeChangeDirDefaultTemplateMatchesTarget": 4.13, "TestEmbeddedPrimeChangeDirPrimesTarget": 6.83, "TestEmbeddedPrimeChangeDirRedirectNoticeFollowsTarget": 5.69, "TestEmbeddedPrimeConcurrent": 55.99, "TestEmbeddedPromote": 24.64, "TestEmbeddedPromoteCLI": 64.87, "TestEmbeddedPromoteCLIConcurrent": 67.99, "TestEmbeddedPruneDryRunAndFilters": 155.68, "TestEmbeddedPruneSafetyAndScope": 163.85, "TestEmbeddedPurgeBasics": 89.31, "TestEmbeddedPurgeConcurrent": 38.42, "TestEmbeddedPurgeFiltered": 131.05, "TestEmbeddedPurgeWispsPlaneRetention": 119.54, "TestEmbeddedQuery": 69.55, "TestEmbeddedQueryConcurrent": 79.23, "TestEmbeddedQuick": 108.95, "TestEmbeddedQuickConcurrent": 52.9, "TestEmbeddedQuickstart": 21.7, "TestEmbeddedQuickstartConcurrent": 24.95, "TestEmbeddedQuietFlagSuppressesSuccessOutput": 37.91, "TestEmbeddedReady": 148.56, "TestEmbeddedReadyClaimConcurrent": 37.22, "TestEmbeddedReadyConcurrent": 39.82, "TestEmbeddedRenamePrefixBasic": 111.8, "TestEmbeddedRenamePrefixConcurrent": 30.67, "TestEmbeddedRenamePrefixEdgeCases": 81.14, "TestEmbeddedReopen": 105.91, "TestEmbeddedReopenConcurrent": 112.14, "TestEmbeddedRestore": 137.93, "TestEmbeddedRestoreConcurrent": 0.0, "TestEmbeddedRoutedMutatingSiblingAssignTagDep": 156.88, "TestEmbeddedRoutedMutatingSiblingDeleteClose": 101.7, "TestEmbeddedRoutedSiblingWritesCommitTargetHead": 191.64, "TestEmbeddedSearch": 118.78, "TestEmbeddedSearchConcurrent": 98.05, "TestEmbeddedSetup": 52.64, "TestEmbeddedSetupConcurrent": 22.64, "TestEmbeddedShip": 71.62, "TestEmbeddedShipConcurrent": 101.01, "TestEmbeddedShowBasicsAndJSON": 118.13, "TestEmbeddedShowConcurrent": 150.5, "TestEmbeddedShowDetailAndCurrent": 135.15, "TestEmbeddedShowUnresolvableDeps": 59.52, "TestEmbeddedSquashWispMoleculeClearsRootEphemeral": 23.37, "TestEmbeddedStale": 90.45, "TestEmbeddedStaleConcurrent": 79.59, "TestEmbeddedStaleLabelFilters": 84.1, "TestEmbeddedState": 66.22, "TestEmbeddedStateConcurrent": 45.78, "TestEmbeddedStatus": 47.37, "TestEmbeddedStatusConcurrent": 79.04, "TestEmbeddedSupersede": 76.14, "TestEmbeddedSupersedeConcurrent": 72.31, "TestEmbeddedSwarm": 172.12, "TestEmbeddedSwarmConcurrent": 71.02, "TestEmbeddedTodo": 74.74, "TestEmbeddedTodoConcurrent": 30.6, "TestEmbeddedTypes": 46.4, "TestEmbeddedTypesAgreeWithCreate": 109.4, "TestEmbeddedTypesConcurrent": 29.96, "TestEmbeddedUnclaim": 130.59, "TestEmbeddedUndefer": 122.4, "TestEmbeddedUndeferConcurrent": 121.9, "TestEmbeddedUpdateBatchAutoCommitDoesNotAdvanceHead": 28.26, "TestEmbeddedUpdateConcurrent": 180.79, "TestEmbeddedUpdateFields": 142.3, "TestEmbeddedUpdateLifecycle": 150.21, "TestEmbeddedUpdateRoutedStoreCommitsTargetHead": 51.5, "TestEmbeddedVCCommitVariantsAndMerge": 105.56, "TestEmbeddedVCConcurrent": 56.84, "TestEmbeddedVCStatusAndCommit": 126.19, "TestEmbeddedVersion": 1.4, "TestEmbeddedVersionConcurrent": 1.48, "TestEmbeddedWhere": 55.16, "TestEmbeddedWhereConcurrent": 27.1 } }