Skip to content

Make live-model use and deterministic fallback explicit#2

Merged
simaba merged 16 commits into
mainfrom
fix/assessment-provenance
Jul 2, 2026
Merged

Make live-model use and deterministic fallback explicit#2
simaba merged 16 commits into
mainfrom
fix/assessment-provenance

Conversation

@simaba

@simaba simaba commented Jul 1, 2026

Copy link
Copy Markdown
Owner

Assessment-provenance and usability hardening

  • introduces a provenance-aware assessment service that records whether output came from the live model or the deterministic fallback
  • records the selected model name or a safe fallback reason on AssessmentResult
  • makes fallback provenance visible in the role-aware summary and CLI output
  • adds --require-llm so CLI users can fail clearly instead of accepting a fallback when a live result is required
  • repairs the Tool Recommender import failure, replaces its fragile nested UI block with a smaller testable seven-question wizard, and adds rule-level tests
  • adds regression tests for missing-key fallback and strict mode
  • documents the two generation modes and their limits
  • adds monthly dependency-update automation

The deterministic fallback remains available for local demos and offline work; this change prevents it from being mistaken for a successful live-model response.

@simaba simaba marked this pull request as ready for review July 2, 2026 05:06
@simaba simaba merged commit a619319 into main Jul 2, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant