Skip to content

[codex] upgrade GEPA and add observability benchmark - #3

Merged
ASRagab merged 2 commits into
mainfrom
codex/gepa-011-observability
Jul 5, 2026
Merged

[codex] upgrade GEPA and add observability benchmark#3
ASRagab merged 2 commits into
mainfrom
codex/gepa-011-observability

Conversation

@ASRagab

@ASRagab ASRagab commented Jul 5, 2026

Copy link
Copy Markdown
Owner

Summary

  • Upgrade GEPA to 0.1.1 and constrain LiteLLM to versions past the affected supply-chain window.
  • Make optimizer evaluator execution parallel by default while preserving serial mode with --no-parallel and documenting worker tuning.
  • Add the optimization observability benchmark workflow, scorer scripts, strict report checks, OpenSpec specs/archive entries, and tests.

Validation

  • git diff --check
  • uv run python scripts/check.py --skip-smoke
    • 326 passed, 8 skipped
    • score checks passed for skills/generate-evaluator/SKILL.md, evaluator-cookbook.md, and skills/optimization-guide/SKILL.md

Notes

  • Draft PR because this branch includes a dependency lockfile update and new benchmark workflow that may deserve maintainer review before marking ready.

@ASRagab
ASRagab marked this pull request as ready for review July 5, 2026 11:02
@ASRagab
ASRagab merged commit 6d39367 into main Jul 5, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant