Expose entity-aware owner oplog attribution by vigoo · Pull Request #3816 · golemcloud/golem

vigoo · 2026-09-02T12:47:10Z

Summary

attribute every public owner-oplog entry to either the agent or an entity invocation, including the entity kind, name, start index, call mode, safe operation metadata, and root-to-parent ancestry
persist and validate initiation-time entity anchors for durable asynchronous work, retries, card workflows, streams, and sessions while preserving physical oplog order and page/search independence
expose attribution through protobuf, REST, and the existing CLI text/structured output, with regenerated schemas and documentation
render safe secret audit metadata without plaintext and keep tool stdout as a live, non-durable attachment

This PR is stacked on #3787 while the tool invocation implementation is still open. Once #3787 merges, this branch can be retargeted to main without changing the GOL-38 diff.

Validation

cargo clippy for all affected packages and targets with -D warnings
cargo test -p golem-worker-executor --lib — 1,369 passed
focused owner-oplog attribution, debugging-service, and card recovery integration tests
CLI renderer, oplog, structured-output, and schema suites
cross-package cargo check
OpenAPI drift, docs lint/format, Rust format, JSON schema, and diff checks

Resolves GOL-38

Amp-Thread-ID: https://ampcode.com/threads/T-01a05674-075d-72eb-888b-20e8037e82b1 Co-authored-by: Amp <amp@ampcode.com> # Conflicts: # golem-worker-executor-test-utils/src/lib.rs # golem-worker-executor/src/durable_host/concurrent/call.rs # golem-worker-executor/src/durable_host/concurrent/mod.rs # golem-worker-executor/src/durable_host/p3/http/response_body.rs # sdks/moonbit/golem_sdk/tool/pkg.generated.mbti # sdks/moonbit/golem_sdk_example1/golem.yaml # sdks/moonbit/golem_sdk_tools/lib/tools_emit.mbt # sdks/scala/codegen/src/main/scala/golem/codegen/rpc/ToolRpcCodegen.scala # sdks/scala/codegen/src/test/scala/golem/codegen/pipeline/CodegenPipelineSpec.scala # sdks/scala/core/js/src/main/scala/golem/runtime/tool/ToolImplementationRuntime.scala # sdks/scala/model/src/main/scala/golem/tool/ToolClient.scala # sdks/scala/model/src/main/scala/golem/tool/ToolInvoke.scala # sdks/scala/model/src/main/scala/golem/tool/ToolStreams.scala # sdks/scala/model/src/test/scala/golem/tool/ToolClientSpec.scala

Amp-Thread-ID: https://ampcode.com/threads/T-01a05674-075d-72eb-888b-20e8037e82b1 Co-authored-by: Amp <amp@ampcode.com> # Conflicts: # sdks/moonbit/golem_sdk/gen/interface/golem/tool/guest/ffi.mbt # sdks/moonbit/golem_sdk/gen/interface/golem/tool/guest/top.mbt # sdks/moonbit/golem_sdk/interface/golem/tool/host/ffi.mbt # sdks/moonbit/golem_sdk/interface/golem/tool/host/pkg.generated.mbti # sdks/moonbit/golem_sdk/interface/golem/tool/host/top.mbt # sdks/moonbit/golem_sdk_example1/golem_moonbit_examples/golem_tool_clients.mbt # sdks/moonbit/golem_sdk_example1/golem_moonbit_examples/golem_tools.mbt # sdks/moonbit/golem_sdk_tools/lib/tools_emit.mbt # sdks/moonbit/golem_sdk_tools/lib/tools_emit_test.mbt

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Co-authored-by: Amp <amp@ampcode.com> Amp-Thread-ID: https://ampcode.com/threads/T-01a05c93-262e-732e-902f-51e42c9c5f02

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Amp-Thread-ID: https://ampcode.com/threads/T-01a057c1-5f47-7614-a794-1ec9b88631f0 Co-authored-by: Amp <amp@ampcode.com>

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com> # Conflicts: # cli/golem-cli/tests/app/agents.rs # golem-worker-executor-test-utils/src/lib.rs # golem-worker-executor/src/durable_host/filesystem/mod.rs # golem-worker-executor/src/durable_host/mod.rs # golem-worker-executor/src/durable_host/p3/filesystem.rs # golem-worker-executor/src/services/active_agents/mod.rs # golem-worker-executor/src/services/linear_memory.rs # golem-worker-executor/src/worker/instance.rs # golem-worker-executor/src/worker/mod.rs # golem-worker-executor/src/workerctx/default.rs # sdks/scala/core/js/src/main/scala/golem/host/SchemaWireInterop.scala # sdks/scala/model/src/main/scala/golem/schema/AgentStream.scala # sdks/scala/model/src/main/scala/golem/tool/ToolMiddleware.scala # sdks/scala/model/src/test/scala/golem/schema/AgentStreamSpec.scala

…plog Amp-Thread-ID: https://ampcode.com/threads/T-01a0665b-0718-710b-9d2a-3ba4b7b30fd9 Co-authored-by: Amp <amp@ampcode.com> # Conflicts: # golem-common/src/base_model/oplog/mod.rs # golem-common/src/model/oplog/mod.rs # golem-common/src/model/oplog/protobuf.rs # golem-worker-executor-test-utils/src/lib.rs # golem-worker-executor/src/durable_host/filesystem/mod.rs # golem-worker-executor/src/durable_host/mod.rs # golem-worker-executor/src/durable_host/p3/filesystem.rs # golem-worker-executor/src/model/public_oplog/mod.rs # golem-worker-executor/src/model/public_oplog/wit.rs # golem-worker-executor/src/services/active_agents/mod.rs # golem-worker-executor/src/worker/instance.rs # golem-worker-executor/src/worker/mod.rs # golem-worker-executor/src/worker/status.rs # golem-worker-executor/src/workerctx/default.rs

Co-authored-by: Amp <amp@ampcode.com> Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3

…aware-oplog Amp-Thread-ID: https://ampcode.com/threads/T-01a0665b-0718-710b-9d2a-3ba4b7b30fd9 Co-authored-by: Amp <amp@ampcode.com> # Conflicts: # golem-worker-executor/src/worker/invocation_loop.rs

Amp-Thread-ID: https://ampcode.com/threads/T-01a071b1-c8d9-755a-be64-f42bc2ea6216 Co-authored-by: Amp <amp@ampcode.com> # Conflicts: # .github/workflows/ci.yaml # golem-worker-executor-test-utils/src/agent_deployments_service.rs # golem-worker-executor-test-utils/src/dsl_impl.rs # golem-worker-executor-test-utils/src/lib.rs # golem-worker-executor/src/durable_host/concurrent/call.rs # golem-worker-executor/src/durable_host/entity.rs # golem-worker-executor/src/durable_host/mod.rs # golem-worker-executor/src/durable_host/tool/mod.rs # golem-worker-executor/src/durable_host/tool/operation.rs # golem-worker-executor/src/model/public_oplog/mod.rs # golem-worker-executor/src/model/public_oplog/tests.rs # golem-worker-executor/src/services/active_agents/mod.rs # golem-worker-executor/src/worker/entity_invocation.rs # golem-worker-executor/tests/tool_streaming.rs # sdks/moonbit/golem_sdk/interface/golem/tool/host/ffi.mbt # sdks/moonbit/golem_sdk_example1/golem_moonbit_examples/golem_tools.mbt # sdks/moonbit/golem_sdk_tools/lib/tools_emit.mbt # test-components/agent-sdk-rust/golem.yaml # test-components/build-components.sh

netlify · 2026-09-05T13:53:52Z

✅ Deploy Preview for golemcloud canceled.

Name	Link
🔨 Latest commit	`fe5f3cf`
🔍 Latest deploy log	https://app.netlify.com/projects/golemcloud/deploys/6aa2c101034ae30009edaa89

Amp-Thread-ID: https://ampcode.com/threads/T-01a0860a-6be6-735d-8507-8cf29763fc89 Co-authored-by: Amp <amp@ampcode.com>

vigoo and others added 30 commits August 28, 2026 09:51

Initial tool invoke implementation

5a4da94

Rebased on streaming invocation

f49e119

Fixes

361d28a

Fix

0fcea91

Missing files

b85fb8c

Fixes

42b8930

Merge branch 'main' into tool-invoke

7d976b0

Fixes

9ec594c

Merge branch 'main' into tool-invoke

621b75a

restore the sdk-path helper tests dropped from helpers.rs

84b06b1

drop the unreachable stdout arms from decode_client_result

8deed15

skip empty stdout chunks in the ts guest writer

d57498b

stop retaining the moved tool-stdin handle in the ts pump

f86a418

skip empty stdout chunks and handle unknown failure tags in scala

15ed2ce

cancel the started invocation when declared stdout is missing

144aec6

skip empty stdin chunks and release an unstarted byte_stream source

c79580c

release tool input and stdin when start fails to encode

0db4ec8

fail read_all on a stdout failure item instead of skipping it

91672cd

stop writing an empty successful stdin item

f05d74b

publish staged stdout on the cancelled no-body tool terminal

ab2a296

notify waiters when an unaccepted tool operation is removed

2ab7ca5

record validated tool invoke integration base

ce9df52

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Keep tool stream operation cancellation non-terminal

7c65004

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Preserve replay claim payload failures

49ceaec

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Keep concurrent tool attempt replay identity stable

778dcba

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Make tool operation lease cleanup race-free

24cafcf

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Centralize no-body attachment publication

001fe82

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Expose entity attribution in agent oplogs

e25255b

Co-authored-by: Amp <amp@ampcode.com> Amp-Thread-ID: https://ampcode.com/threads/T-01a05c93-262e-732e-902f-51e42c9c5f02

vigoo and others added 15 commits September 3, 2026 02:42

Fix Rust started tool invocation observers

773ac28

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Handle TypeScript tool results lazily

854d043

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Fix MoonBit tool stream lifecycle

04c5a0d

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Preserve TypeScript tool stream failures

cfece71

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Finish tool stream contract conformance

9a79fd7

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Add Scala streaming method support

31a7569

Amp-Thread-ID: https://ampcode.com/threads/T-01a057c1-5f47-7614-a794-1ec9b88631f0 Co-authored-by: Amp <amp@ampcode.com>

Test Scala streaming lifecycle semantics

2df530c

Amp-Thread-ID: https://ampcode.com/threads/T-01a057c1-5f47-7614-a794-1ec9b88631f0 Co-authored-by: Amp <amp@ampcode.com>

Preserve Scala declared tool errors during collection

a4d3480

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Separate Scala middleware stream handles

8e59ef4

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Fix Scala tool invocation ownership

fd4f726

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Record final tool invocation verification

3ddb277

Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3 Co-authored-by: Amp <amp@ampcode.com>

Fix post-merge CI failures

8c9dcc3

Co-authored-by: Amp <amp@ampcode.com> Amp-Thread-ID: https://ampcode.com/threads/T-01a05ccc-8015-76b8-aa82-6d36e4210bc3

Merge remote-tracking branch 'origin/tool-invoke' into gol-38-entity-…

e75a694

…aware-oplog Amp-Thread-ID: https://ampcode.com/threads/T-01a0665b-0718-710b-9d2a-3ba4b7b30fd9 Co-authored-by: Amp <amp@ampcode.com> # Conflicts: # golem-worker-executor/src/worker/invocation_loop.rs

This comment has been minimized.

Sign in to view

Base automatically changed from tool-invoke to main September 5, 2026 10:49

vigoo requested a review from a team September 5, 2026 10:49

vigoo and others added 4 commits September 9, 2026 13:46

Merge origin/main into gol-38-entity-aware-oplog

eece2d9

Amp-Thread-ID: https://ampcode.com/threads/T-01a0860a-6be6-735d-8507-8cf29763fc89 Co-authored-by: Amp <amp@ampcode.com>

Merge latest origin/main into gol-38-entity-aware-oplog

33b8a14

Fix local server shard manager test fixture

3d57ccf

Amp-Thread-ID: https://ampcode.com/threads/T-01a0860a-6be6-735d-8507-8cf29763fc89 Co-authored-by: Amp <amp@ampcode.com>

Merge latest origin/main into gol-38-entity-aware-oplog

b3f74e3

noise64 reviewed Sep 10, 2026

View reviewed changes

Comment thread golem-common/src/model/oplog/mod.rs

Comment thread golem-worker-executor/src/model/public_oplog/mod.rs Outdated

Fix entity-aware replay divergence detection

fe5f3cf

Amp-Thread-ID: https://ampcode.com/threads/T-01a0860a-6be6-735d-8507-8cf29763fc89 Co-authored-by: Amp <amp@ampcode.com>

noise64 approved these changes Sep 11, 2026

View reviewed changes

vigoo merged commit 9b3f5dc into main Sep 11, 2026
69 checks passed

vigoo deleted the gol-38-entity-aware-oplog branch September 11, 2026 09:28

github-actions Bot locked and limited conversation to collaborators Sep 11, 2026

Navigation Menu

Uh oh!

Expose entity-aware owner oplog attribution - #3816

Expose entity-aware owner oplog attribution#3816
vigoo merged 52 commits into
mainfrom
gol-38-entity-aware-oplog

vigoo commented Sep 2, 2026

Uh oh!

This comment has been minimized.

netlify Bot commented Sep 5, 2026 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

vigoo commented Sep 2, 2026

Summary

Validation

Uh oh!

This comment has been minimized.

netlify Bot commented Sep 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Deploy Preview for golemcloud canceled.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

netlify Bot commented Sep 5, 2026 •

edited

Loading