Batch SCC repo_labor inserts to reduce occurrence of massive log lines#402
Open
MoralCode wants to merge 2 commits into
Open
Batch SCC repo_labor inserts to reduce occurrence of massive log lines#402MoralCode wants to merge 2 commits into
MoralCode wants to merge 2 commits into
Conversation
…f data Signed-off-by: Adrian Edwards <[email protected]>
this keeps memory use bounded and also reduces the size of the insert statement that is used Signed-off-by: Adrian Edwards <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This removes a debug print statement and performs database insertions from scc in chunks using the configured chunk size (if available) or 1000 rows as a fallback.
This PR fixes #401
Notes for Reviewers
Not yet extensively tested.
Signed commits
Generative AI disclosure
Please select one option:
If AI tools were used, please provide details below:
- What tools were used? Sonnet 4.6 Medium
- How were these tools used? diagnosis and tracing the issue
- Did you review these outputs before submitting this PR? only used for diagnosis. code was written by me by copying from other places in our code where we do similar batching.