-
Notifications
You must be signed in to change notification settings - Fork 321
Pull requests: IBM/AssetOpsBench
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Update benchmark run configuration and lite profile
#533
opened Sep 7, 2026 by
ShuxinLin
Collaborator
Loading…
fix(llm): raise EmptyCompletionError instead of crashing on empty completions
External contribution
#520
opened Aug 19, 2026 by
virajsabhaya23
Loading…
4 of 5 tasks
fix(llm): fail on an empty completion where it happens, and make the cap overridable
External contribution
#512
opened Aug 14, 2026 by
arthapraha
Loading…
4 tasks done
docs(evaluation): what the public data supports — the scoreability section for #506, #507, #508, #509
External contribution
#510
opened Aug 14, 2026 by
arthapraha
Loading…
2 tasks done
fix(scorers): a digit inside a name is not a count
External contribution
#505
opened Aug 13, 2026 by
arthapraha
Loading…
4 tasks done
feat(evaluation): add reproducible accessible leaderboard charts
External contribution
#501
opened Aug 10, 2026 by
CurtisBaldwinson
Loading…
13 of 16 tasks
fix(eval): persist plan-execute token usage for cost/tokens reporting
#500
opened Aug 8, 2026 by
AmirF194
Contributor
Loading…
3 of 4 tasks
Persist Stirrup assistant reasoning in trajectories
#498
opened Jul 31, 2026 by
ShuxinLin
Collaborator
Loading…
4 of 5 tasks
Improve OpenAI agent routing and scenario-suite runs
#487
opened Jul 27, 2026 by
ShuxinLin
Collaborator
Loading…
Avoid IoT telemetry timeouts on large CouchDB streams
#481
opened Jul 24, 2026 by
ShuxinLin
Collaborator
Loading…
Uniform final answer via a record_final_answer MCP tool
#466
opened Jul 20, 2026 by
DhavalRepo18
Collaborator
Loading…
Make Plan-Execute recovery evidence-driven and safely bounded
#432
opened Jul 7, 2026 by
HemVadgama
Loading…
feat: DB context prefetching to eliminate planner discovery steps
#416
opened Jun 27, 2026 by
yassinejebbouri
Loading…
2 tasks
feat: LRU cache for FMSR and IoT sensor metadata lookups
#415
opened Jun 27, 2026 by
yassinejebbouri
Loading…
2 tasks
feat: parallel FMSR dispatch strategies for N×M LLM call bottleneck
#414
opened Jun 27, 2026 by
yassinejebbouri
Loading…
3 tasks
Relocating TSFM-Specifc CSV Files to CouchDB
External contribution
#406
opened Jun 23, 2026 by
jellyfishing2346
Contributor
Loading…
3 of 5 tasks
feat(eval): add abstention detection and comparison-aware scoring for 'static_json'
External contribution
#401
opened Jun 21, 2026 by
jatinkumar300403
Loading…
8 of 11 tasks
feat(robot-mcp): add robot inspection MCP server and CouchDB asset profiles
External contribution
#370
opened Jun 14, 2026 by
AnandMayank
Loading…
Previous Next
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.