Skip to content

Fix keyword matching for compound terms and improve eval quality#4

Merged
auxten merged 1 commit into
mainfrom
fix/issue-3-keyword-matching-and-eval-quality
Apr 3, 2026
Merged

Fix keyword matching for compound terms and improve eval quality#4
auxten merged 1 commit into
mainfrom
fix/issue-3-keyword-matching-and-eval-quality

Conversation

@auxten

@auxten auxten commented Apr 3, 2026

Copy link
Copy Markdown
Owner

Summary

  • Compound keyword matching: targetingkeywords/bulk now matches content containing targeting, keywords, and bulk separately
  • Eval prompt produces specific parameter suggestions (file, variable, current/suggested values) instead of generic advice
  • Long numeric IDs (8+ digits) masked in auto-research reports

Closes

Fixes #3

Test plan

  • 67/67 unit tests pass
  • 7/7 recall quality regression tests pass (zero regression)
  • Compound term splitting verified: targetingkeywords/bulk[targeting, keywords, bulk]

Addresses #3:

1. Keyword matching: compound terms like 'targetingkeywords/bulk' now
   match when all sub-parts (targeting, keywords, bulk) are found in
   content, even if the exact compound form differs (underscore vs
   camelCase vs slash-separated)

2. Eval prompt: now requires specific parameter names, file paths,
   current vs suggested values — prevents generic "adjust weights"
   suggestions

3. Privacy masking: long numeric IDs (8+ digits) now masked as
   [NUMERIC_ID] to prevent campaign/account ID leaks in GitHub issues
@auxten auxten merged commit 989600e into main Apr 3, 2026
3 checks passed
@auxten auxten deleted the fix/issue-3-keyword-matching-and-eval-quality branch April 3, 2026 03:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Auto-Research Report: 2026-04-03

1 participant