Skip to content

Pull requests: ARTPARK-SAHAI-ORG/calibrate

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort

Pull requests list

Resume eval-only runs and add --overwrite
#165 opened Aug 15, 2026 by dalmia Collaborator Loading…
Judge cost, resume, and decoupling
#161 opened Jul 28, 2026 by SanskritiM Collaborator Loading…
Remove interactive Ink UI; make the CLI flag-only
#158 opened Jul 16, 2026 by dalmia Collaborator Loading…
Use Cartesia ink-2 STT for English; keep ink-whisper for Hindi/Kannada
#152 opened Jul 15, 2026 by dalmia Collaborator Loading…
Add background-noise injection for voice simulations
#127 opened Jul 8, 2026 by dalmia Collaborator Loading…
Retry silent (empty-audio) TTS turns in the voice-agent simulator
#112 opened Jul 4, 2026 by dalmia Collaborator Loading…
Upgrade pipecat to 1.4.0 and fix voice-sim RTVI 2.0 bot-output parsing
#106 opened Jul 4, 2026 by dalmia Collaborator Loading…
Add ignore_case option for exact tool-call parameter matching
#86 opened Jun 11, 2026 by dalmia Collaborator Loading…
1 task done
Add row-level parallelism to STT/TTS evaluations
#78 opened Jun 10, 2026 by dalmia Collaborator Loading…
1 task
Make STT/TTS benchmark-level parallelism configurable
#77 opened Jun 10, 2026 by dalmia Collaborator Loading…
1 task
Run LLM benchmark models in parallel (+ configurable --benchmark-parallel)
#76 opened Jun 10, 2026 by dalmia Collaborator Loading…
1 task
Add configurable parallelism across STT, TTS, LLM benchmarks and simulations
#74 opened Jun 10, 2026 by dalmia Collaborator Loading…
6 of 7 tasks
Retry text agent calls on HTTP 500
#63 opened May 21, 2026 by SomehowLiving Loading…
STT: streaming-only providers, TTFT metric, row-level error handling
#60 opened May 12, 2026 by dalmia Collaborator Loading…
2
5
ProTip! What’s not been updated in a month: updated:<2026-07-20.