Skip to content

Add (exclude_)where args to workload directive [AI]#1642

Open
douglasjacobsen wants to merge 1 commit into
GoogleCloudPlatform:developfrom
douglasjacobsen:workload-filters
Open

Add (exclude_)where args to workload directive [AI]#1642
douglasjacobsen wants to merge 1 commit into
GoogleCloudPlatform:developfrom
douglasjacobsen:workload-filters

Conversation

@douglasjacobsen

Copy link
Copy Markdown
Collaborator

This merge adds support for filtering experiments at the workload directive level. This can be used to silently reduce the possible experiment definitions, without creating errors.

Tests and documentation are added as well.

@douglasjacobsen douglasjacobsen added the enhancement New feature or request label Jun 25, 2026

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces internal filters for workloads using where and exclude_where arguments, allowing experiments to be conditionally dropped during workspace setup. It updates the workload definition, experiment rendering logic, and documentation, and adds corresponding unit and end-to-end tests. A review comment points out an unused capsys fixture in the end-to-end tests that should be removed.

Comment thread lib/ramble/ramble/test/end_to_end/workload_where_clauses.py
@ramble-pr-bot

ramble-pr-bot Bot commented Jun 25, 2026

Copy link
Copy Markdown

Ramble Performance Test Metrics

Results produced with commit: a4a5fe4

Test Name Outcome Duration (s) Most Recent Run (s) Last 5 Avg (s)
test_analyze_large_file passed 2.9025 2.9011 (93379c1) 2.9360
test_large_template_expansion passed 2.1362 2.1247 (93379c1) 2.1228
test_many_experiments passed 36.5839 36.5820 (93379c1) 36.0789
test_many_objects_defaults passed 19.8007 19.5860 (93379c1) 19.4379
test_matrix_filter_perf passed 1.6067 1.5942 (93379c1) 1.5979

@codecov

codecov Bot commented Jun 25, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 93.31%. Comparing base (93379c1) to head (a4a5fe4).
⚠️ Report is 2 commits behind head on develop.

Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #1642      +/-   ##
===========================================
+ Coverage    93.29%   93.31%   +0.01%     
===========================================
  Files          352      353       +1     
  Lines        34181    34251      +70     
===========================================
+ Hits         31889    31960      +71     
+ Misses        2292     2291       -1     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

This commit adds support for filtering experiments at the workload
directive level. This can be used to silently reduce the possible
experiment definitions, without creating errors.

Tests and documentation are added as well.
@douglasjacobsen douglasjacobsen marked this pull request as ready for review June 26, 2026 19:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant