Skip to content

Added eval harness for requests about people. #16

Open
EcSky19 wants to merge 3 commits into
mainfrom
eval_harness
Open

Added eval harness for requests about people. #16
EcSky19 wants to merge 3 commits into
mainfrom
eval_harness

Conversation

@EcSky19

@EcSky19 EcSky19 commented Mar 16, 2026

Copy link
Copy Markdown
Contributor

Very janky memory storing and querying system

@EcSky19 EcSky19 left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't merge yet, need to figure out testing structure

Comment thread frontend/eval/cases.json
@@ -0,0 +1,27 @@
[
{
"query": "Tell me about John",

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we have last names or descriptors to have a better evaluation if we have two Johns?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants