Alpenglow, VM, Performance Enhancements and bug fixes - #293

Merged

NeerajGodiyal merged 194 commits into

alpenglow-devfrom

7layer/streaming-execution-overlap

Sep 25, 2026

Commits on Sep 16, 2026

Update Narya to latest Zen 5 verification optimizations
7layermagik
committed
b9a1fa9
Overlap Turbine signature verification with shred arrival
7layermagik
committed
9803f16
Document Zen 5 streaming verification and execution contention results
7layermagik
committed
9a85ada
Avoid rebuilding cached shred component buffers at completion
7layermagik
committed
a8aff5a
Reduce completion ordering and root work; bundle ready verification groups
7layermagik
committed
9265ee9
Make streaming tests independent of FEC acceleration
7layermagik
committed
f184535
Allocate each prepared component transaction view once
7layermagik
committed
0063cfb
Document standalone streaming validation and live trial scope
7layermagik
committed
7c5bcc3
Avoid redundant shred retention sweeps at an unchanged frontier
7layermagik
committed
d0cf70b
Document retention benchmark and post-deployment FAST measurements
7layermagik
committed
331ce3f
Prepare transaction message identities during shred arrival
7layermagik
committed
314c48c
Record native deployment and initial live identity timing results
7layermagik
committed
addabea
Discover independent complete batches and preserve bounded prefetch reset ownership
7layermagik
committed
2e0824b
Document isolated PR validation and retain relevant benchmark evidence
7layermagik
committed
7593722
Normalize benchmark document formatting
7layermagik
committed
ef927bd
Recover safely from inconsistent entry identities and own streaming config
7layermagik
committed
7934bac
Reuse relay peer scratch and packet storage with explicit ownership
7layermagik
committed
406317b
turbine: reserve verifier admission for completion
7layermagik
committed
d5c44ec
review: clarify ownership and archive investigation artifacts
7layermagik
committed
be807ff
docs: keep review specifications and archive operational notes
7layermagik
committed
33efc88
Advance replay progress without waiting for certificate verification
7layermagik
committed
fd829f6
Cache observer statistics until certificate or replay inputs change
7layermagik
committed
ad2cd47
Verify certificates outside the pool mutex and reuse verified BLS points
7layermagik
committed
343a661
Document isolated PR validation and retain relevant benchmark evidence
7layermagik
committed
5133813
Use bounded multi-scalar aggregation for larger vote batches
7layermagik
committed
45fcf66
Preserve scalar verification on single-thread runtimes
7layermagik
committed
623dcfd
alpenglow: reconcile only pending observer certificates during replay
7layermagik
committed
4927628
review: clarify ownership and archive investigation artifacts
7layermagik
committed
efcb294
docs: validate archive links and formatting
7layermagik
committed
f253465
alpenglow: prioritize reward flushes and reuse vote dedupe keys
7layermagik
committed
3f074ed
turbine: integrate two-FEC components, generation, and recovery atomically
7layermagik
committed
5ca27a9
blockprod: report entry transaction serialization failures
7layermagik
committed
039ebd6
Integrate reviewed validator performance changes for combined testing
7layermagik
committed
9db7dcb
Move transaction-status checkpoint encoding off the replay loop
7layermagik
committed
28e3238
Expire transaction-status groups in batches on durable promotion
7layermagik
committed
f1a15c2
Record native Zen 5 expiry benchmark results
7layermagik
committed
852aae9
Document isolated PR validation and retain relevant benchmark evidence
7layermagik
committed
6e52789
Prepare transaction-status deltas during block execution
7layermagik
committed
6c31ff5
Include raw status-publication benchmark and validation logs
7layermagik
committed
c241d6b
Reuse immutable node encodings across status checkpoints
7layermagik
committed
fe54faa
Document native checkpoint encoding measurements
7layermagik
committed
f9f2f64
replay: preflight fold batch eligibility before copying account writes
7layermagik
committed
b8a3aed
replay: retire completed rewards bookkeeping after durable promotion
7layermagik
committed
3f97e9c
replay: reuse ancestor validation for unchanged status cache
7layermagik
committed
cb34ddc
replay: partition large transaction status index updates
7layermagik
committed
c1f864f
review: defer status-map partitioning and archive investigation artifacts
7layermagik
committed
b8df19d
docs: keep review specifications and archive operational notes
7layermagik
committed
f164274
docs: validate archive links and formatting
7layermagik
committed
ced869c
replay: rebind disappeared status groups and randomize encoding checks
7layermagik
committed
939aa26
replay: rebind disappeared status groups and randomize encoding checks
7layermagik
committed
065ee9e
turbine: authenticate recovered shreds against the signed FEC tree
7layermagik
committed
9112978
Improve leader packing and add near-limit synthetic block tests
7layermagik
committed
b006f95
Document current-base leader benchmarks and finalized load results
7layermagik
committed
828e001
Bound scheduler transaction references in both priority heaps
7layermagik
committed
ea5a182
Document scheduler retention tradeoffs and near-limit block results
7layermagik
committed
185673d
turbine: authenticate recovered shreds against the signed FEC tree
7layermagik
committed
5925338
turbine: queue spool completion hints outside block delivery
7layermagik
committed
72a3b51
Document isolated PR validation and retain relevant benchmark evidence
7layermagik
committed
cfb00cd
docs: record spool deployment results and remaining verification tails
7layermagik
committed
273d580
docs: keep review specifications and archive operational notes
7layermagik
committed
a22ccd5
docs: keep spool recovery contract and archive operational notes
7layermagik
committed
c35485c
docs: validate archive links and formatting
7layermagik
committed
bcc4725
docs: validate archive links and formatting
7layermagik
committed
bd396ec
test: use public component serialization in leader round trip
7layermagik
committed
3937072
leader: precheck buffer admission before transaction preparation
7layermagik
committed
25a8b69
turbine: warn when completion fencing prevents spool deletion
7layermagik
committed
f2acfb4
turbine: warn when completion fencing prevents spool deletion
7layermagik
committed
c757ea8
leader: precheck buffer admission before transaction preparation
7layermagik
committed
5ef7a22
sbpf: reject overflow in contiguous virtual memory ranges
7layermagik
committed
b552ee9
sealevel: remove SHA-256 syscall descriptor and digest allocations
7layermagik
committed
ace6e26
test: measure captured SHA loop and document Zen 5 acceleration
7layermagik
committed
d855141
sbpf: cut per-instruction overhead in the interpreter (~2x on SPL Token transfer)

claude
authored and
7layermagik
committed
ef418c7
sbpf: add interpreter benchmarks and a differential test corpus

claude
authored and
7layermagik
committed
b9e723a
sealevel: add native program micro-benchmarks (System transfer, Vote TowerSync)

claude
authored and
7layermagik
committed
be48dcc
test: update VASA stack registers for fixed-size interpreter state
7layermagik
committed
9589709
test: benchmark verified token arithmetic and CPI workloads with warm programs
7layermagik
committed
ee5234b
docs: record individual-program and matched Alpenglow replay measurements
7layermagik
committed
1ca6112
sealevel: copy, compare and fill VM memory without temporaries or byte loops

claude
authored and
7layermagik
committed
cbef964
lthash: vectorize MixIn/MixOut with AVX2 on amd64

claude
authored and
7layermagik
committed
ff5b10a
test: preserve zero-length memory validation and repair VM fixtures
7layermagik
committed
6c2490e
test: cover unaligned and aliased AVX2 hash lanes
7layermagik
committed
8764903
sbpf: account for resolved call targets in program cache cost
7layermagik
committed
b03afad
test: retain syscall differential coverage and execution reproduction guide
7layermagik
committed
e53c1f3
test: trim execution benchmark experiments and documentation
7layermagik
committed
05ca7ae
replay: record FullToReplayed, the vote-path latency replay controls

claude
authored and
7layermagik
committed
8cdb0cf
replay: make block execution resumable (open / execute group / finalize)

claude
authored and
7layermagik
committed
411e8b0
turbine: streaming feed of decoded batches for replay

claude
authored and
7layermagik
committed
400dc65
sealevel/replay: let a speculative bank defer its process-global side effects

claude
authored and
7layermagik
committed
ad9f734
replay: streaming execution of turbine blocks while their shreds arrive

claude
authored and
7layermagik
committed
607724b
replay: keep every transaction of the group-equivalence fixture processable

claude
authored and
7layermagik
committed
1467778
turbine: stream feed test verifies with the identity-producing verifier

claude
authored and
7layermagik
committed
580d529
replay: streaming finalize keeps ownership of its bank until the tail commits

claude
authored and
7layermagik
committed
b85caf9
replay: lifecycle equivalence test — streamed bank equals whole-block bank

claude
authored and
7layermagik
committed
ad50511
block: PreparedTransactionMessageIdentities.Rebind for stream-owned copies

claude
authored and
7layermagik
committed
88373b1
replay: streams execute their own transaction copies; block objects stay pristine

claude
authored and
7layermagik
committed
a64efd6
block: make execution copies and their identities one operation

claude
authored and
7layermagik
committed
1347b87
turbine/replay: real-feed lifecycle gate; recover a dropped header wake-up

claude
authored and
7layermagik
committed
ebc5806
replay: stream direct children across unresolved slot gaps
7layermagik
committed
bc4ac81
turbine: wake repair promptly for new priority slots
7layermagik
committed
188b903
replay: streaming open timeline — what held a child's stream, and why a block ran whole

claude
authored and
7layermagik
committed
7a2386d
replay: streaming per-group record — verifier waits, execution after the last shred, group sizes

claude
authored and
7layermagik
committed
cb63e0c
replay: correct streaming timing attribution
7layermagik
committed
b87bd57
replay: refresh ready batches before streaming group dispatch
7layermagik
committed
cfbdec7
replay: retain account loader metrics across streaming groups
7layermagik
committed
d0f8237
turbine: trace completion-critical shred sources and repair sends
7layermagik
committed
61aaeaa

Commits on Sep 20, 2026

Commits on Sep 22, 2026

rewards: preserve credits on inactive Alpenglow stakes
smcio
committed
fda34f6
replay: checkpoint reward windows only after verified completion
smcio
committed
2d0ea6f
docs: remove epoch 116 incident report
smcio
committed
c1f7134

Commits on Sep 24, 2026

Merge remote-tracking branch 'origin/alpenglow-dev' into 7layer/pr-certificate-delivery
7layermagik
committed
74d110c
Fix Alpenglow Votor certificate compatibility with Firedancer
7layermagik
committed
3973850
Merge remote-tracking branch 'origin/alpenglow-dev' into 7layer/pr-turbine-ingestion
7layermagik
committed
680cb47
rewards: preserve credits on inactive Alpenglow stakes

smcio
authored and
7layermagik
committed
008258f
replay: retire completed rewards bookkeeping after durable promotion
7layermagik
committed
5bfcdd6
replay: checkpoint reward windows only after verified completion

smcio
authored and
7layermagik
committed
35d73a7
alpenglow: isolate bounded peer delivery from vote persistence
7layermagik
committed
0a86a01
docs: remove epoch 116 incident report

smcio
authored and
7layermagik
committed
0fe2fc1
Merge branch '7layer/pr-turbine-ingestion' into 7layer/pr-leader-packing
7layermagik
committed
1e52065
Merge independent epoch-recovery correctness prerequisite
7layermagik
committed
72f6a69
alpenglow: separate opt-in signing reservations and ordered history persistence
7layermagik
committed
318ddb2
Merge branch '7layer/pr-certificate-delivery' into 7layer/review-performance-foundation
7layermagik
committed
4166afa
Merge branch '7layer/pr-vote-persistence' into 7layer/review-performance-foundation
7layermagik
committed
bdada66
Integrate leader packing with opt-in voting persistence
7layermagik
committed
eaf4c41
Integrate replay checkpoints and epoch correctness
7layermagik
committed
2170cd3
fix: preserve boolean flag defaults and explicit config overrides
7layermagik
committed
fd4ae2f
fix: own retained vote deque storage before pooled reuse
7layermagik
committed
c7d9f6c
sbpf: reject overflow in contiguous virtual memory ranges
7layermagik
committed
8a424ba
sealevel: remove SHA-256 syscall descriptor and digest allocations
7layermagik
committed
c12362b
test: measure captured SHA loop and document Zen 5 acceleration
7layermagik
committed
bb23409
sbpf: cut per-instruction overhead in the interpreter (~2x on SPL Token transfer)

claude
authored and
7layermagik
committed
de8ea09
sbpf: add interpreter benchmarks and a differential test corpus

claude
authored and
7layermagik
committed
faa0cb0
sealevel: add native program micro-benchmarks (System transfer, Vote TowerSync)

claude
authored and
7layermagik
committed
daf2acf
test: update VASA stack registers for fixed-size interpreter state
7layermagik
committed
929471b
test: benchmark verified token arithmetic and CPI workloads with warm programs
7layermagik
committed
3d31a10
docs: record individual-program and matched Alpenglow replay measurements
7layermagik
committed
8401d57
sealevel: copy, compare and fill VM memory without temporaries or byte loops

claude
authored and
7layermagik
committed
d8fd064
lthash: vectorize MixIn/MixOut with AVX2 on amd64

claude
authored and
7layermagik
committed
7c8cfa3
test: preserve zero-length memory validation and repair VM fixtures
7layermagik
committed
928f920
test: cover unaligned and aliased AVX2 hash lanes
7layermagik
committed
fdbc019
sbpf: account for resolved call targets in program cache cost
7layermagik
committed
5c7a83a
test: retain syscall differential coverage and execution reproduction guide
7layermagik
committed
ad31b3d
test: trim execution benchmark experiments and documentation
7layermagik
committed
1ac8878
sbpf: restore v2 memory opcodes and differential coverage
7layermagik
committed
23a67db
sbpf: guard pooled write tracking beyond bitmap capacity
7layermagik
committed
b182b33
sealevel: match Agave zero-length memory copy behavior
7layermagik
committed
9585fa4
sealevel: track sibling header writes in pooled VM memory
7layermagik
committed
52a1aad
Reconcile streaming with regrouped performance prerequisites
7layermagik
committed
4df8387
fix: preserve boolean flag defaults and explicit config overrides
7layermagik
committed
915f619
fix: own retained vote deque storage before pooled reuse
7layermagik
committed
cb360c4
sbpf: reject overflow in contiguous virtual memory ranges
7layermagik
committed
be7a914
sealevel: remove SHA-256 syscall descriptor and digest allocations
7layermagik
committed
584791f
test: measure captured SHA loop and document Zen 5 acceleration
7layermagik
committed
f944a0e
sbpf: cut per-instruction overhead in the interpreter (~2x on SPL Token transfer)

claude
authored and
7layermagik
committed
75db2e0
sbpf: add interpreter benchmarks and a differential test corpus

claude
authored and
7layermagik
committed
5b8f33f
sealevel: add native program micro-benchmarks (System transfer, Vote TowerSync)

claude
authored and
7layermagik
committed
3f0ec6c
test: update VASA stack registers for fixed-size interpreter state
7layermagik
committed
e8dcadc
test: benchmark verified token arithmetic and CPI workloads with warm programs
7layermagik
committed
203e105
docs: record individual-program and matched Alpenglow replay measurements
7layermagik
committed
1f4a69b
sealevel: copy, compare and fill VM memory without temporaries or byte loops

claude
authored and
7layermagik
committed
2361bc9
lthash: vectorize MixIn/MixOut with AVX2 on amd64

claude
authored and
7layermagik
committed
32e149e
test: preserve zero-length memory validation and repair VM fixtures
7layermagik
committed
bfddc29
test: cover unaligned and aliased AVX2 hash lanes
7layermagik
committed
4ad9805
sbpf: account for resolved call targets in program cache cost
7layermagik
committed
1ca0fb3
test: retain syscall differential coverage and execution reproduction guide
7layermagik
committed
a6f3586
test: trim execution benchmark experiments and documentation
7layermagik
committed
14c5404
sbpf: restore v2 memory opcodes and differential coverage
7layermagik
committed
1992ab4
sbpf: guard pooled write tracking beyond bitmap capacity
7layermagik
committed
a520264
sealevel: match Agave zero-length memory copy behavior
7layermagik
committed
3830a18
sealevel: track sibling header writes in pooled VM memory
7layermagik
committed
a317eb6
Group replay checkpoints, epoch recovery and streaming over execution
7layermagik
committed
1762cf1