Repository navigation
feat(one-reason): add explicit Jev routing with LLM compatibility - #12
Merged
Merged
Conversation
Support decision-only Jev evaluation via ONE_REASON_PROVIDER=typesafe|gateway with OpenAI-style base URL + API key + model config. TypeSafe calls POST /systemone; Gateway uses the fetchable /evaluation-model surface from @ai-sdk/gateway (no ai@7 bump). Examples map to noul/choice/score questions.
Jev only handles decision-shaped examples (boolean/choice/score/$jev). Summary/free-text synthesis auto-falls back to the LLM path when PROVIDER is typesafe|gateway. Add optional reason(prompt, example, options?) with mode auto|jev|llm, explicit questions, state, and booleanThreshold.
Collaborator
Author
Hybrid Jev / LLM fallbackAddressed the feedback that summary-style Product story: Jev = control-node judgments; summary/synthesis stays on LLM (auto-fallback under Changes (915f940):
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds optional TypeSafe Jev decision routing to
@one-agent/reasonwhile preserving the historical LLM default.Final behavior
modeormode: "llm": always uses the existing LLM path.mode: "jev": decision-shaped examples use Jev; free-text examples or unavailable Jev fall back to LLM.autois not a public mode.ONE_REASON_JEV_ENABLED=0disables Jev availability.Example schema mapping
boolean-> Jevnoul/ Gatewaybooleannumber-> JevscoreScore ranges can be declared explicitly:
The Jev request uses at most 10 levels and maps the returned score back into the declared range. Invalid ranges and more than 10 custom criteria fail locally before a network request.
Providers
POST {baseURL}/systemonePOST {baseURL}/evaluation-modelVerification