-
Notifications
You must be signed in to change notification settings - Fork 70
Pull requests: NVIDIA-NeMo/Evaluator
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
fix: extract workspace tar before pre-apply verify diagnostics
#1129
opened Jul 24, 2026 by
mlazuka
Contributor
Loading…
feat: add compaction event log, fix turn counting
#1128
opened Jul 23, 2026 by
mlazuka
Contributor
Loading…
cp:
fix(harbor): local httpbin for the psf/requests SWE-B tasks (1120) into r0.4.0
cherry-pick
Run CICD
#1127
opened Jul 22, 2026 by
svcnvidia-nemo-ci
Loading…
fix: support local Slurm job lifecycle without SSH hostname
#1121
opened Jul 21, 2026 by
yingguo-trt
Loading…
feat: forward tools to model and harden managed Gym lifecycle
#1115
opened Jul 15, 2026 by
pachmu
Loading…
fix: native skills aime26
community-request
waiting-on-maintainers
Waiting on maintainers to respond
#1113
opened Jul 13, 2026 by
trantrieuvy
Loading…
fix(healthbench): update dataset loading URL to correct path
community-request
waiting-on-maintainers
Waiting on maintainers to respond
#1108
opened Jul 9, 2026 by
cris96spa
Loading…
fix(xstest): update CSV URL and rename ID field for consistency
community-request
waiting-on-maintainers
Waiting on maintainers to respond
#1107
opened Jul 9, 2026 by
cris96spa
Loading…
fix(triviaqa): update dataset loading path to use correct repository
community-request
waiting-on-maintainers
Waiting on maintainers to respond
#1104
opened Jul 9, 2026 by
cris96spa
Loading…
fix(judge): don't let an unparseable judge reply silently score 0
community-request
waiting-on-maintainers
Waiting on maintainers to respond
#1094
opened Jun 29, 2026 by
Vidhate
Loading…
feat: in-container local sandbox + reasoning-model scoring fixes
#1093
opened Jun 25, 2026 by
hychiang-git
Loading…
fix(adapters): add Qwen-safe turn_counter reminder modes
#1090
opened Jun 24, 2026 by
fsiino-nvidia
Loading…
feat: derive version from git tags via hatch-vcs
#1081
opened Jun 17, 2026 by
wprazuch
Contributor
Loading…
feat(benchmarks): add ToolSandbox multi-turn tool-use benchmark
CI
tests
#1018
opened May 18, 2026 by
wprazuch
Contributor
Loading…
experimental(slurm): add eval_ray_cluster multi-node bootstrap for agentic Gym evals
nemo-evaluator-launcher
tests
#1016
opened May 15, 2026 by
agronskiy
Collaborator
Loading…
ci: add GitLab container build config for dev/0.3.0 (public containers)
#1015
opened May 14, 2026 by
wprazuch
Contributor
Loading…
feat: harden NVCF endpoint handling
documentation
Improvements or additions to documentation
nemo-evaluator
nemo-evaluator-launcher
tests
#1008
opened May 12, 2026 by
manojkilaru97
Loading…
feat: add ATIF retrieved context metric
documentation
Improvements or additions to documentation
tests
#982
opened May 6, 2026 by
SandyChapman
•
Draft
feat: add shared metric contract for scorer functions
tests
#950
opened Apr 29, 2026 by
SandyChapman
Loading…
feat(tasks): Add RASB 26H1 evaluator integration
CI
community-request
documentation
Improvements or additions to documentation
nemo-evaluator
nemo-evaluator-launcher
tests
waiting-on-maintainers
Waiting on maintainers to respond
#943
opened Apr 27, 2026 by
pbelcak
Loading…
feat: add local no-docker mode for nemo-evaluator-launcher
community-request
documentation
Improvements or additions to documentation
nemo-evaluator-launcher
tests
waiting-on-customer
Waiting on the original author to respond
#786
opened Mar 1, 2026 by
mishana
Loading…
ProTip!
Exclude everything labeled
bug with -label:bug.