Skip to content

fix: set maturity on parquet splits#6399

Open
mattmkim wants to merge 2 commits intomainfrom
matthew.kim/byoc-metrics-maturity-timestamp
Open

fix: set maturity on parquet splits#6399
mattmkim wants to merge 2 commits intomainfrom
matthew.kim/byoc-metrics-maturity-timestamp

Conversation

@mattmkim
Copy link
Copy Markdown
Contributor

@mattmkim mattmkim commented May 6, 2026

Description

We were not setting maturity value on splits in the metastore, so they were all being set to 0. Sets maturity value on the ingest/merge path on the uploader, similar to what logs does.

Need this for compaction, so we can fetch immature splits, and correctly designate when splits are no longer candidates for compaction.

How was this PR tested?

Describe how you tested this PR.

@mattmkim mattmkim requested review from a team as code owners May 6, 2026 18:19
@mattmkim
Copy link
Copy Markdown
Contributor Author

mattmkim commented May 6, 2026

@codex review

@mattmkim mattmkim changed the title set maturity on parquet splits fix: set maturity on parquet splits May 6, 2026
@chatgpt-codex-connector
Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Keep it up!

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants