Skip to content

[eval] Repair TaskTrove v4.8 campaign contracts - #142

Merged
penfever merged 6 commits into
mainfrom
agent/tasktrove-v48-remediation
Sep 1, 2026
Merged

[eval] Repair TaskTrove v4.8 campaign contracts#142
penfever merged 6 commits into
mainfrom
agent/tasktrove-v48-remediation

Conversation

@penfever

@penfever penfever commented Sep 1, 2026

Copy link
Copy Markdown
Collaborator

Repair the adversarial verifier so malformed reward output fails closed, and
raise the C++, PHP-large, and PHP-v2 task memory limits to 4096 MB. Add the
reproducible TaskTrove v4.8 assembly and publication paths used for the repaired
sources.

Track the GLM 5.2, Qwen3.5-122B, and Qwen3-Coder campaign configurations needed
to reproduce the v4.8 evaluations. Remove the unsupported Qwen3-Coder vLLM swap
argument. Warm resumes now delete and refire trials terminated by Together
service unavailability or agent SIGKILL instead of preserving them as completed
infrastructure failures.

Benjamin Feuer added 6 commits September 1, 2026 05:31
Classify Together service-unavailable failures as retryable infrastructure errors. Build and validate four versioned TaskTrove replacements: adversarial and PHP verifier fixes, plus explicit 4 GiB memory requirements for C++, PHP-large, and PHP-v2. Add guarded v4.8 assembly and publication tooling.
@penfever penfever added the agent-generated Created by an autonomous coding agent label Sep 1, 2026
@penfever
penfever merged commit 5d4e619 into main Sep 1, 2026
2 checks passed
@penfever
penfever deleted the agent/tasktrove-v48-remediation branch September 1, 2026 11:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

agent-generated Created by an autonomous coding agent

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant