Skip to content

feat(review): fallback to local eval with expired artifacts #546

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

khaneliman
Copy link
Contributor

@khaneliman khaneliman commented Aug 2, 2025

Throw a custom exception when we a get 410 on fetching CI results and handle accordingly in the review process to fallback to local evaluation.

Closes #476

Dependent on #545 for CI, pulled these changes into separate branch so it doesn't hold that one up.


Just saw this in the associated issue

We should treat 410 the same way as 404.

Should i make the exception raised on 404, as well? My understanding was that 404 waits for a retry loop so that you can wait for an evaluation to finish. But, here we had an evaluation that did finish and we know it won't because it just expired so we just force a local retry.

Copy link
Collaborator

@GaetanLepage GaetanLepage left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a good idea. Diff LGTM

@khaneliman
Copy link
Contributor Author

If we just want a better message, this is what it looks like atm.

-> Fetching eval results from GitHub actions
https://github.com/NixOS/nixpkgs/pull/391575 failed to build:
GitHub artifact 3034442382 has expired or been removed
    * "try passing --eval local"
    * "try re-running GitHub CI"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

--eval github sometimes reports urllib.error.HTTPError: HTTP Error 410: Gone
4 participants