Skip to content

Add arrow-flight test coverage for IPC compression#10097

Open
alamb wants to merge 1 commit into
apache:mainfrom
alamb:alamb/flight-compression-test-coverage
Open

Add arrow-flight test coverage for IPC compression#10097
alamb wants to merge 1 commit into
apache:mainfrom
alamb:alamb/flight-compression-test-coverage

Conversation

@alamb

@alamb alamb commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Follow-up while reviewing #10044.

Rationale for this change

While reviewing #10044 (which reworks the IPC writer's buffer handling), I found that the compressed IpcDataGenerator::encode path is not exercised by any test in the repository.

What changes are included in this PR?

This PR adds that missing coverage

Are these changes tested?

This PR is test-only.

Are there any user-facing changes?

No.

Round trips a batch through FlightDataEncoderBuilder with LZ4 and ZSTD
IPC body compression enabled, exercising the compressed
IpcDataGenerator::encode path that no existing arrow-flight or
arrow-ipc test covered.

Refactors verify_flight_round_trip to share its encode/decode/assert
logic via verify_flight_round_trip_with_options, and enables the
arrow-ipc lz4/zstd features as arrow-flight dev-dependencies.

Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>
@github-actions github-actions Bot added arrow Changes to the arrow crate arrow-flight Changes to the arrow-flight crate labels Jun 9, 2026
@alamb alamb marked this pull request as ready for review June 9, 2026 15:19

@Rich-T-kid Rich-T-kid left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think these test look good!
Would definitely be nice to have these for future arrow-flight optimizations

@alamb

alamb commented Jun 9, 2026

Copy link
Copy Markdown
Contributor Author

Thank you for the review @Rich-T-kid

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

arrow Changes to the arrow crate arrow-flight Changes to the arrow-flight crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants