Skip to content

chore(tickets): File harness-design findings - #1185

Merged
JeanMertz merged 1 commit into
mainfrom
swot
Sep 20, 2026
Merged

JeanMertz merged 1 commit into
mainfrom
swot

Conversation

@JeanMertz

Copy link
Copy Markdown
Collaborator

docs/ticket/ gains a record of what the coding-harness study at arXiv:2609.20804 establishes, how each of its three ablated components (planning, action space, context management) maps onto JP's turn loop, and a SWOT drawn from the comparison. Six proposal tickets follow from it and are linked from its closing section.

The comparison's sharpest finding is that JP runs the jp query path with no context management at all: jp_llm::window::truncate_to_fit has two production call sites, jp_llm::title and jp_cli's inquiry backend, and neither is the query path. git log -S confirms it arrived with the inquiry work and was never wired to query, so the absence is original rather than a regression. That gap is filed separately from the compaction proposal it surfaced, because it holds whether or not RFD D50 ever lands.

The remaining proposals cover bounded tool output (promote RFD D24), staged elision before summarization in RFD D50, per-response token usage as a conversation event, a turn-scoped cycle cap with identical-call streak detection, and an open question about whether a plan belongs in conversation history. The usage ticket is ranked ahead of the tuning work it enables: JP records no token counts today, so every other proposal here is currently unfalsifiable.

`docs/ticket/` gains a record of what the coding-harness study at
arXiv:2609.20804 establishes, how each of its three ablated components
(planning, action space, context management) maps onto JP's turn loop,
and a SWOT drawn from the comparison. Six proposal tickets follow from
it and are linked from its closing section.

The comparison's sharpest finding is that JP runs the `jp query` path
with no context management at all: `jp_llm::window::truncate_to_fit` has
two production call sites, `jp_llm::title` and `jp_cli`'s inquiry
backend, and neither is the query path. `git log -S` confirms it arrived
with the inquiry work and was never wired to `query`, so the absence is
original rather than a regression. That gap is filed separately from the
compaction proposal it surfaced, because it holds whether or not RFD D50
ever lands.

The remaining proposals cover bounded tool output (promote RFD D24),
staged elision before summarization in RFD D50, per-response token usage
as a conversation event, a turn-scoped cycle cap with identical-call
streak detection, and an open question about whether a plan belongs in
conversation history. The usage ticket is ranked ahead of the tuning
work it enables: JP records no token counts today, so every other
proposal here is currently unfalsifiable.

Signed-off-by: Jean Mertz <git@jeanmertz.com>
@JeanMertz
JeanMertz merged commit 44e8a12 into main Sep 20, 2026
20 checks passed
@JeanMertz
JeanMertz deleted the swot branch September 20, 2026 05:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant