Skip to content

feat(stovepipe): force full builds through ingest - #1074

Open
mnoah1 wants to merge 1 commit into
mainfrom
mnoah1/stovepipe-force-full-ingest
Open

mnoah1 wants to merge 1 commit into
mainfrom
mnoah1/stovepipe-force-full-ingest

Conversation

@mnoah1

@mnoah1 mnoah1 commented Nov 12, 2026 •

Copy link
Copy Markdown
Contributor

Why?

Older branches, such as staging test branches, can develop a large gap between the last validated commit and the current head.

In these cases, it can make more sense to trigger a full repository run at the latest head.

What?

Add force_full to ingest to select the full-repository strategy for the request at the current head. This also updates an existing accepted request for that head and preserves it through coalescing when newer heads arrive. The override applies only to that request; ingest returns InvalidArgument if it has already left accepted.

Test Plan

Controller, process, mapper, RPC handler and request-log suites passed, covering forced ingestion, coalescing, admission races, ineligible requests and preserved acceptance history.

make fmt lint check-tidy check-gazelle passed.

Revert Plan

Revert this PR.

Summary:
Allow Ingest to select full validation for its resolved request, including an existing accepted request waiting on the same head. Reject the override once the request has left accepted.

Persist the strategy before publishing, preserve explicit full requests during backlog coalescing, and honor the override through admission and CAS races. Strategy updates retain the original acceptance event and timestamp. The override stays on its selected request and adds no scheduling priority.

Test Plan:
TestIngestFullPreservesAcceptanceHistory verifies the real log materializer keeps the original acceptance; TestIngestFullRejectsStartedOrTerminalRequest covers ineligible requests; TestProcessForcedFullRequest covers newer heads, occupied capacity, and admission/supersession races.

Run locally:
./tool/bazel test //stovepipe/controller:go_default_test //stovepipe/controller/process:go_default_test //service/stovepipe/server/mapper:go_default_test //service/stovepipe/server/handler:go_default_test //stovepipe/core/requestlog:go_default_test --test_output=errors

Formatting, lint, dependency tidiness and Gazelle consistency checked with make fmt lint check-tidy check-gazelle.

Revert Plan:
Revert this PR.

API Changes:
Add the optional force_full boolean to IngestRequest. Omission preserves ordinary ingestion. Forcing a request past accepted returns InvalidArgument.
@mnoah1
mnoah1 marked this pull request as ready for review November 12, 2026 20:59
@mnoah1
mnoah1 requested review from a team, behinddwalls and sbalabanov as code owners November 12, 2026 20:59

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant