Issues

• Provide preceding conversation context when grading a selected turn

  enhancement
  agentevals-dev/agentevals#253 · Filter by author erauner12 opened on Oct 12, 2026

• Support user-defined rubrics over a complete conversation

  enhancement
  agentevals-dev/agentevals#252 · Filter by author erauner12 opened on Oct 12, 2026

• Inspect the actual evaluated conversation from Run details

  enhancement
  agentevals-dev/agentevals#250 · Filter by author erauner12 opened on Oct 12, 2026

• Compare two saved Runs by eval case and metric

  enhancement
  agentevals-dev/agentevals#249 · Filter by author erauner12 opened on Oct 12, 2026

• Preserve eval-case and turn identity in saved Run results

  enhancement
  agentevals-dev/agentevals#248 · Filter by author erauner12 opened on Oct 12, 2026

• Weaver registry for the agentevals attributes and the evaluation event

  CIOTel
  agentevals-dev/agentevals#244 · Filter by author krisztianfekete opened on Oct 7, 2026

• Make google-adk an optional dependency

  ADK
  Task

  agentevals-dev/agentevals#243 · Filter by author krisztianfekete opened on Oct 7, 2026

• Move judge models off litellm

  techdebt
  Task

  agentevals-dev/agentevals#242 · Filter by author krisztianfekete opened on Oct 7, 2026
  2

• GenAI revamp: OTel native trace ingestion and evaluation

  ADKagentevals-evaluator-sdkenhancementOTelOTelGenAIUI
  Task

  agentevals-dev/agentevals#236 · Filter by author krisztianfekete opened on Oct 6, 2026
  

• Feature request: EvalPort import/export for eval sets and ResultSets

  agentevals-dev/agentevals#206 · Filter by author adhabnr-ux opened on Aug 31, 2026

• [CI] Cover UI

  CIgood first issue
  Task

  agentevals-dev/agentevals#176 · Filter by author krisztianfekete opened on Jul 10, 2026

• Persisting annotations

  enhancementneeds-design
  Feature

  agentevals-dev/agentevals#163 · Filter by author krisztianfekete opened on Jul 2, 2026
  1

• support running X eval cases against Y traces

  agentevals-dev/agentevals#151 · Filter by author peterj opened on May 15, 2026
  1

• Eliminate duplicated trace parsing between frontend and backend

  CLItechdebtUI
  agentevals-dev/agentevals#130 · Filter by author krisztianfekete opened on Apr 30, 2026

• Make it possible to edit tool calls in Trace Editor

  enhancementgood first issueUI
  agentevals-dev/agentevals#121 · Filter by author krisztianfekete opened on Apr 15, 2026

• Add LlamaIndex zero code example

  good first issue
  agentevals-dev/agentevals#94 · Filter by author krisztianfekete opened on Apr 1, 2026
  2

• Add AWS AgentCore zero code example

  good first issue
  agentevals-dev/agentevals#93 · Filter by author krisztianfekete opened on Apr 1, 2026
  1

• Support BYO evals on the UI

  enhancementneeds-designquestionUI
  agentevals-dev/agentevals#87 · Filter by author krisztianfekete opened on Apr 1, 2026

• Feature — MCP-based trace source for observability backends

  enhancementneeds-design
  agentevals-dev/agentevals#67 · Filter by author henrikrexed opened on Mar 26, 2026
  10

• Add zero-code examples for CrewAI and Anthropic Claude agents

  good first issue
  agentevals-dev/agentevals#41 · Filter by author YaMachinu opened on Mar 20, 2026
  3