You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Streamed Anthropic thinking content_block_start has no signature field #645
A streamed thinking block's content_block_start on /v1/messages is {"type":"thinking","thinking":""}, with no signature. _open_thinking() (server/anthropic_api.py) never sets it, and _event() serializes with exclude_none=True. The Anthropic SDK types ThinkingBlock.signature as a required str. The non-streaming response and the closing signature_delta already send "".
Tested in the 1080 Ti deployment branch, rebuilt today on main 9c635a1 (torch 2.14.1+cu126, Triton 3.8, GTX 1080 Ti sm_61, Qwen3.8-Flash-Next-NVFP4 at 262K): a streamed /v1/messages request with thinking now opens with {"type":"thinking","thinking":"","signature":""}, and tool-call round trips pass on /v1/messages with and without thinking. tests/server/test_anthropic_api.py passes.
Activity
gdevenyi commentedon Oct 13, 2026
Tested in the 1080 Ti deployment branch, rebuilt today on main 9c635a1 (torch 2.14.1+cu126, Triton 3.8, GTX 1080 Ti sm_61, Qwen3.8-Flash-Next-NVFP4 at 262K): a streamed
/v1/messagesrequest with thinking now opens with{"type":"thinking","thinking":"","signature":""}, and tool-call round trips pass on/v1/messageswith and without thinking.tests/server/test_anthropic_api.pypasses.