* ci: F5 S2 Variant A nogo ownership for the integration configuration group No full Bazel lane validates the integration / doltserver-integration / doltserver-cmd configurations anymore (all three now pass --norun_validations). Instead bazel-integration gains a narrow "Nogo: integration library files" step that keeps full nogo (vet + golangci-lint) on the configuration's one non-test library package, //internal/testutil/integration, via `bazel build --config=integration --@rules_go//go/config:race --keep_going --output_groups=nogo_fix -- //internal/testutil/integration:integration`. This accepts a scoped coverage loss (f5-spec.md §3/§5 S2, Variant A): the 56 integration-tagged _test.go files (listed in tools/nogo/unvalidated_integration_tests.txt, derived from source by the new T4 test) no longer get a vet pass in any lane, since golangci-lint already skips all _test.go files repo-wide (.golangci.yml's run.tests: false) and no lane builds those test binaries with validations on. Verified directly with real `bazel build` runs: a planted vet finding in the library package still fails the new step; the same finding in an integration-tagged _test.go file no longer fails anything; a planted finding in a plain race-configuration library still fails bazel-test; and GoCompilePkg action keys for the integration configuration are identical with and without --norun_validations (it is a build-request option, not a configuration flag, so no farm cache invalidation). scripts/nogo_lint_policy_test.go: the nogoConfigurations table gains a "integ" row with an ownerIsNogoOnlyStep flag and a dedicated checkNogoOnlyStepRow, generalizing T1/T2/T5/T6 to cover an owner that is a narrow build step rather than a full lane; adds T4 (TestNogoIntegrationStepCoversItsConfiguration), which derives the step's expected target set from source via go/build's own tag matching instead of a hardcoded list. Also fixes four should-fix items from julianknutsen's review of #7482: 1. expandBazelrcConfig now follows `common:` lines and --config= tokens anywhere on a line, not just a first-position `build:`/`test:` one. 2. TestNogoRaceOwnerBuildsEverything now expands every config the owner job can reach (including shell-variable-gated ones like sole-run), not just the statically-named "ci". 3. The package-gate check now compares full key-flag fingerprints instead of substring-matching --@rules_go//go/config:race / --norun_validations. 4. tools/bazel/nogo_ownership.py now fails loudly (exit 2) when both the owner's and non-owners' action-key sets are empty, instead of reporting a vacuous pass. Each fix has new mutation-test coverage in TestNogoPolicyRejectsMutations (should-fixes 1-3) or nogo_ownership_test.py (should-fix 4). engdocs/LINTING.md and engdocs/CI_REQUIRED_CHECK_TOPOLOGY.md updated to remove the stale "integration still validates in all three lanes" claim and document the Variant A trade-off. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> * fix(ci): make T4's source scan work under Bazel, not just plain go test scripts:scripts_test only declares //:repo_other_files as data (every tracked file but Go and Markdown source, by design: a Go-only change should not re-run the CI/workflow policy tests). TestNogoIntegrationStep CoversItsConfiguration's source scan needs every non-test .go file, so under `bazel test //scripts:scripts_test` its runfiles tree had none and the scan always came back empty. Fixes: - scripts/BUILD.bazel: add //:repo_go_srcs to scripts_test's data, with a comment explaining why (this is the one test in the target that needs it). - integrationOnlyLibraryPackages: use bazelPolicyRoot(t) + repoFiles(t, ...) (the existing Bazel-safe, runfiles-aware file listing other policy tests in this package already use) instead of sourceRepoRoot(t) + filepath.WalkDir, which only sees what //scripts's own go_test target declares. Verified with real `bazel test --config=integration --@rules_go//go/config:race` and `--config=ci --@rules_go//go/config:race` runs of //scripts:scripts_test (both pass); CI caught the original gap (PR #7486's first push failed Bazel / integration and Bazel / test with exactly this). Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> * fix(bazel): address independent review + bee-ghosttrack findings on F5 S2 Variant A Independent review of #7486, must-fixes 1-7: pipefail on the nogo-only step's tee pipeline; exact source-scan equality check for tools/nogo/unvalidated_integration_tests.txt; expandBazelrcConfig follows common:-lines and non-first-position --config= tokens in both the Go policy test and nogo_ownership.py; mirrored nogo_ownership.py should-fix guarding against a non-owner action-key query silently matching nothing. Cost fix: split T4/T6's whole-repo .go source scan into its own go_test target (//scripts:nogo_integration_scan_test) so a Go-only change no longer re-runs all of scripts_test; extracted the shared bazelInvocations and ciWorkflow helpers into helper-only files so both targets can depend on them without violating the one-target-per-test-file partition rule. bee-ghosttrack review: checkNogoOnlyStepRow's own fingerprint now excludes test:-sourced .bazelrc lines pulled in via --config=X (buildOrCommonLines), since the nogo-only step is a `bazel build` invocation that never reads a test: line; added mutation s2i reproducing the gap this closes. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> * fix(nogo): pin integration nogo-only step's target, fingerprint its lane, add behavioral test Addresses the remaining should-fixes from the independent review of #7486: 1. TestNogoIntegrationStepScriptFailsWithoutMaskingBazelsExitCode (scripts/nogo_integration_step_script_test.go) extracts the real "Nogo: integration library files" step script from bazel.yml and runs it under plain `bash -e` (GitHub's actual run: semantics, no pipefail added) against a stub bazel, closing the gap a text-only pin can't: it catches rc=0 before `exit "$rc"`, `|| :`/`|| true` on the tee pipeline, or a missing/negated `set -o pipefail`, regardless of how the mutation is spelled. 2. The nogo-only step's target set is now pinned by exact go_library label, not just package: nogo_integration_scan_test.go derives the label(s) from source + BUILD.bazel and nogo_lint_policy_test.go pins them literally (its own go_test target has no //:repo_go_srcs). Both reject a `-//` exclusion pattern outright. 3. checkNonOwnerCommandLineAddsNoKeyFlag is now also applied to the integ row's owner's own full lane: under Variant A that lane validates nothing, so it is effectively a non-owner for this check's purpose, and must not override a key-affecting flag on its command line either. 4. Latent items: TestNoUnconditionalValidationOff now also scans .github/actions/setup-bazel/write-bazelrc.sh for run_validations (every line it emits lacks a :config suffix, so any occurrence would turn validation off everywhere with no owner lane to catch it). tools/bazel/nogo_ownership.py's docstring is corrected: it had said S2 was simply "out of scope," which is now stale since S2 has its own validating lane (the nogo-only step, checked statically); the script's dynamic aquery-based cross-check remains S1-only because S2's owner has no non-owner test lane building the same configuration to compare actions against. Skipped (not cheap / not reachable): - bazel-server-storage's `if:` not modeling an "integration" input: no such input exists to model; the gate is RBE-enabled-only by design, and resolving this requires understanding pr.yml's broader gating semantics, not a textual fix. - defaults.run.shell parsing: bazel.yml has no `defaults:` block today (confirmed by grep), so there is nothing to parse; the gap is latent only for a future change, not a live bug. - race-off scan's future-wrong-fix edge case: the review itself characterizes this as not reachable with today's file set. New mutation cases s2j/s2k/s2l in TestNogoPolicyRejectsMutations cover items 2 and 3. All mutation-verifications performed by hand-editing the real files, confirming FAIL, and reverting via Edit (never git stash/checkout). Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> --------- Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
33 lines
1.2 KiB
Go
33 lines
1.2 KiB
Go
package scripts_test
|
|
|
|
import "slices"
|
|
import "strings"
|
|
|
|
// bazelInvocations returns the arguments (after `bazel <verb>`) of every
|
|
// `bazel <verb>` command in a step's run script whose verb is in verbs. A
|
|
// command continued over several lines with a trailing backslash is one
|
|
// command: its continuation lines' arguments are included. Arguments stop at
|
|
// the first shell pipe or list operator.
|
|
//
|
|
// Helper-only file (no Test functions, like repo_helpers_test.go): shared by
|
|
// scripts_test's nogo_lint_policy_test.go and nogo_integration_scan_test.go's
|
|
// dedicated go_test target (independent review of #7486, cost fix), so each
|
|
// can declare only the data it reads without duplicating this parser.
|
|
func bazelInvocations(run string, verbs ...string) [][]string {
|
|
var out [][]string
|
|
for _, line := range strings.Split(strings.ReplaceAll(run, "\\\n", " "), "\n") {
|
|
fields := strings.Fields(line)
|
|
if len(fields) < 2 || fields[0] != "bazel" || !slices.Contains(verbs, fields[1]) {
|
|
continue
|
|
}
|
|
var args []string
|
|
for _, f := range fields[2:] {
|
|
if f == "|" || f == "||" || f == "&&" || f == ";" {
|
|
break
|
|
}
|
|
args = append(args, f)
|
|
}
|
|
out = append(out, args)
|
|
}
|
|
return out
|
|
}
|