Skip to content

About

Session-qualified reuse and soft-protected state eviction.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

stateaxis-session-lifecycle

Extension ID: org.vllm-hust.stateaxis-session-lifecycle

Session-qualified reuse and soft-protected state eviction.

This repository is the independent MOD boundary for StateAxis issue #11. Version 0.2.0 is an active Manifest 0.3 contract for the existing StateAxis generation-safe session lifecycle mechanism. It remains default-off and may only be enabled by Extension Manager/ECPA with the exact research-manifest digest.

Evidence boundary

Status: historical mixed, active experimental, not performance-qualified.

In the preserved Qwen2.5-14B capacity-pressure 3+3 cell, recomputed prompt tokens fell from 12 to 0 and protected-root hits rose from 0 to 3. Logical throughput improved by 0.506% and TPOT P99 improved 5.53%, while TTFT P99 regressed 1.76%. The preregistered recomputation/no-TPOT-regression acceptance predicate passed, but serving latency remained mixed. That result predates this active revision and is not a general performance claim.

The compact machine-readable bundle is under evidence/issue11-session-pressure-20260815-r3/, including the authoritative R3c correction and the rejected unmatched-denominator result. Negative, failed, and inconclusive results are retained. Microbenchmarks and component results must not be restated as online end-to-end gains.

Install and inspect

python -m pip install .
vllm-hust-ext extension inspect org.vllm-hust.stateaxis-session-lifecycle
vllm-hust-ext extension check org.vllm-hust.stateaxis-session-lifecycle

Discovery alone does not enable the MOD. The admitted ON contract fixes the session and holder bounds, generation binding, transactional holder updates, idle-close rules, shared-state lifetime, deterministic soft-protection policy, leased-state exclusion, and fail-closed behavior. StateAxis rejects direct activation that lacks the pinned MOD identity.

Activate through Extension Manager

export VLLM_HUST_EXT_CONFIG=evidence/ecpa-contract-20261011/manager-config.json
vllm-hust-ext extension check org.vllm-hust.stateaxis-session-lifecycle
vllm-hust-ext extension plan org.vllm-hust.stateaxis-session-lifecycle
vllm-hust-ext run --dry-run -- /path/to/native_state_engine ...

Rollback is omission: remove the MOD from the Manager plan. The StateAxis default then allocates no session tables and uses no session-aware pressure authority.

Validate

python -m pip install -e '.[test]'
pytest -q

Maintainer: Shuhao Zhang (Tony), directly responsible; no advisor is declared.

About

Session-qualified reuse and soft-protected state eviction.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages