Skip to content

Conversation

Jabolol
Copy link
Contributor

@Jabolol Jabolol commented Aug 18, 2025

This PR closes #4800 and fixes the failing runs on dagster for the new open_collective/accounts asset. The errors were two:

Firstly, runs timed out in problematic segments. The API timed out with a 503 even when the retry config specified little entries. Since the problem is that some segments inherently timeout, the only thing we can do is log these segments and skip them. We log in Dagster's internal tables the segments that failed with useful metadata.

Secondly, some fields have integers over 64 bits, which are known to not work with our current DLT setup. We now convert these ones to strings if encountered.

Lastly, it modifies the docs to keep the graphql_factory documentation on par with the current setup.

Copy link

vercel bot commented Aug 18, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
kariba-network Ready Ready Preview Comment Aug 19, 2025 0:16am
oso-www Error Error Aug 19, 2025 0:16am

@ravenac95
Copy link
Member

@Jabolol you'll need to move this to the new asset directory. Also, I remove the relative imports in the original file, so I'd do that too.

@Jabolol
Copy link
Contributor Author

Jabolol commented Aug 19, 2025

@Jabolol you'll need to move this to the new asset directory. Also, I remove the relative imports in the original file, so I'd do that too.

Addressed!

Merged via the queue into main with commit 67a7c35 Aug 19, 2025
12 of 13 checks passed
@Jabolol Jabolol deleted the jabolol/open-collective-accounts-fix branch August 19, 2025 00:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Open Collective accounts job fails on Dagster
2 participants