PipeBench 0.2.3

What's Changed

• Add support for endpoints in test cases by @namles in #5
• Add sample file support to generator configuration and orchestration by @namles in #4
• Add Kafka (Redpanda) support: consume, round-trip, batch, and crash/restart cases by @yusufozturk in #6

New Contributors

• @namles made their first contribution in #5
• @yusufozturk made their first contribution in #6

Full Changelog: v0.2.2...v0.2.3

PipeBench 0.2.2

Full Changelog: v0.2.1...v0.2.2

PipeBench 0.2.1

Full Changelog: v0.2.0...v0.2.1

PipeBench 0.2.0

Full Changelog: v0.1.0...v0.2.0

PipeBench 0.1.0

PipeBench 0.1.0

Cross-compiled harness CLI for orchestrating data-pipeline benchmark runs.
Bench-* container images for the same revision live on Docker Hub:

• vmetric/bench-generator:sha-d53de2b
• vmetric/bench-receiver:sha-d53de2b
• vmetric/bench-collector:sha-d53de2b
• vmetric/pipebench:sha-d53de2b

Install

Download the archive that matches your OS/arch below, extract, and put
harness on your PATH. Verify the checksum against checksums.txt.

What's changed

Changelog

• 41b89f2: Active-window benchmark methodology, drop kubernetes mode (Yusuf Ozturk [email protected])
• 9b2da3f: Add axosyslog for 2xlarge (Yusuf Ozturk [email protected])
• 6a86992: Add axosyslog for 4xlarge (Yusuf Ozturk [email protected])
• bb130f0: Add c6a.metal (Yusuf Ozturk [email protected])
• 8a89c79: Add c7i.2xlarge tier with renamed test keys (Yusuf Ozturk [email protected])
• 455c1c8: Add c7i.2xlarge vector + vmetric results (Yusuf Ozturk [email protected])
• 3fba44d: Add fluentbit test result (Yusuf Ozturk [email protected])
• 433c350: Add fluentd results (Yusuf Ozturk [email protected])
• 0d73171: Add logstash results (Yusuf Ozturk [email protected])
• ae55e01: Add logstash results 2xlarge (Yusuf Ozturk [email protected])
• 6001988: Add vector results 8xlarge (Yusuf Ozturk [email protected])
• 57b2c56: Add vmetric c7i.8xlarge benchmark results + custom-tier injection fix (Yusuf Ozturk [email protected])
• 36e779d: Add xlarge results for vmetric (Yusuf Ozturk [email protected])
• 28016a7: Auto-scale generator connections by NumCPU when unset (Yusuf Ozturk [email protected])
• d01cf43: Bump google.golang.org/grpc in /containers/receiver (dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>)
• 42e6dc6: Delete scripts/fix_overdelivery directory (Yusuf Ozturk [email protected])
• 1877195: Delete web/results/custom directory (Yusuf Ozturk [email protected])
• 2f3191a: Document prebuilt images on Docker Hub (Yusuf Ozturk [email protected])
• 064ef31: Drain receiver until stable + drop generator/receiver per-line allocs (Yusuf Ozturk [email protected])
• 35d4f9d: Drop c7i.large tier (insufficient resources for benchmark) (Yusuf Ozturk [email protected])
• 2128192: Drop ratio number from failed correctness cells: just ✗ (Yusuf Ozturk [email protected])
• e56e7e3: Drop smoke-test jobs from CI (Yusuf Ozturk [email protected])
• 44f61b9: Empty-results subjects + over-delivery threshold + ranking fixes (Yusuf Ozturk [email protected])
• 0b7cea3: Fix correctness cell color when every subject failed (Yusuf Ozturk [email protected])
• 05276e0: Fix double newline in runTCPParallel generator path (Yusuf Ozturk [email protected])
• 5c3e317: Fix fluentd syslog configs, flag over-delivery, add --type filter (Yusuf Ozturk [email protected])
• 25cac07: Fix harness image namespace + add --all-tests flag (Yusuf Ozturk [email protected])
• 4635fa5: Fix logstash payload corruption, rename misleading tests, bump fluent-bit to 5.0 (Yusuf Ozturk [email protected])
• 26fb3ea: Fix markdownlint warnings and point header links at actual docs (Yusuf Ozturk [email protected])
• d53de2b: Fix the docker build (Yusuf Ozturk [email protected])
• c4d489e: Fix wrapped_json_correctness verdict + fluent-bit config (Yusuf Ozturk [email protected])
• 053f85e: Give the hardened collector access to the docker socket (Yusuf Ozturk [email protected])
• efab8d8: Harden helper container images for Docker Scout (Yusuf Ozturk [email protected])
• c4c8ec8: Ignore cribl-stream auth/ to prevent committing credentials (Yusuf Ozturk [email protected])
• 5a1d542: Initial PipeBench project import (Yusuf Ozturk [email protected])
• 0c192e1: Initial commit (Yusuf Ozturk [email protected])
• 1ca45ae: Logstash results (Yusuf Ozturk [email protected])
• 7c03106: Make SBOM/provenance flags opt-in via ATTEST=1 (Yusuf Ozturk [email protected])
• 0e37f30: Make collector failures diagnosable (Yusuf Ozturk [email protected])
• c526cb9: Mark over-delivered runs as failed in the UI (Yusuf Ozturk [email protected])
• c09d813: Match Go sort in UI: natural-sort hardware tiers client-side (Yusuf Ozturk [email protected])
• 140b46a: More results (Yusuf Ozturk [email protected])
• 9988a84: Narrow subject list to 6 enterprise-grade pipeline tools (Yusuf Ozturk [email protected])
• d4491a3: Natural-sort hardware tiers: xlarge before 2xlarge; metal last (Yusuf Ozturk [email protected])
• 44671e1: Netflow and OTLP support (Yusuf Ozturk [email protected])
• 032f8f3: New benchmarks (Yusuf Ozturk [email protected])
• 83ccc69: New results with more generators (Yusuf Ozturk [email protected])
• aedba17: Per-hardware results layout + persistence-correctness hardware fix + gitignore containers/vmetric/ (Yusuf Ozturk [email protected])
• 7ce3c49: Pin Dockerfiles to patch-level base tags (Yusuf Ozturk [email protected])
• e0d7de6: Remove accidentally-committed cribl-stream auth files (Yusuf Ozturk [email protected])
• e22d7f2: Remove containers/vmetric/ from repo (Yusuf Ozturk [email protected])
• 370e38d: Rename project from virtualmetric-bench to PipeBench (Yusuf Ozturk [email protected])
• 34eba70: Report ingest rate for blackhole tests instead of always 0 (Yusuf Ozturk [email protected])
• 42b1b19: Show over-delivery percentage next to ✗ in result cells (Yusuf Ozturk [email protected])
• 9845287: Split data output by hardware tier (Yusuf Ozturk [email protected])
• e5b5257: Strip explicit generator.connections; let auto-scale handle it (Yusuf Ozturk [email protected])
• b41715b: Strip remaining references to removed vendors (Yusuf Ozturk [email protected])
• fed0481: Switch to subject-file results layout + move results under web/ (Yusuf Ozturk [email protected])
• 751985c: Update fluentbit results (Yusuf Ozturk [email protected])
• fc6984a: Update fluentbit results (Yusuf Ozturk [email protected])
• 83be573: Update header title and JSONBench link (Yusuf Ozturk [email protected])
• dea70ff: Update link actions (Yusuf Ozturk [email protected])
• 4afa46a: Update logstash results (Yusuf Ozturk [email protected])
• a985667: Update options (Yusuf Ozturk [email protected])
• 60307d2: Update results (Yusuf Ozturk [email protected])
• 36f248a: Update results (Yusuf Ozturk [email protected])
• e5282ea: Update results (Yusuf Ozturk [email protected])
• b7e0efa: Update results (Yusuf Ozturk [email protected])
• 16f0b81: Update results (Yusuf Ozturk [email protected])
• 799a0fa: Update some results (Yusuf Ozturk [email protected])
• 9622d01: Update some results (Yusuf Ozturk [email protected])
• a93f4a3: Update some results (Yusuf Ozturk [email protected])
• bfee497: Update stats (Yusuf Ozturk [email protected])
• 5ea9353: Update subjects (Yusuf Ozturk [email protected])
• 4e79013: Update subjects (Yusuf Ozturk [email protected])
• dd47e34: Update the index (Yusuf Ozturk ...