You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
/v1/chat/completions returns 400 for the OpenAI developer role #646
/v1/chat/completions passes message roles through unchanged, so a developer message (sent by Codex and other current OpenAI clients) reaches apply_chat_template. Qwen3.8-Flash-Next's template raises Unexpected message role., which comes back as 400 could not encode request: Unexpected message role.. /v1/responses already folds developer into the system message (server/responses_api.py:263). The same error was reported in #376 for another model; that issue is closed and main still fails.
Tested in the 1080 Ti deployment branch, rebuilt today on main 9c635a1 (torch 2.14.1+cu126, Triton 3.8, GTX 1080 Ti sm_61, Qwen3.8-Flash-Next-NVFP4 at 262K): main's tokenizer-side merge of mapped developer messages is in, plus the server-side ordering/image check (tests/tokenizer/test_tokenize.py, tests/server/test_mm_input.py pass).
Activity
gdevenyi commentedon Oct 13, 2026
Tested in the 1080 Ti deployment branch, rebuilt today on main 9c635a1 (torch 2.14.1+cu126, Triton 3.8, GTX 1080 Ti sm_61, Qwen3.8-Flash-Next-NVFP4 at 262K): main's tokenizer-side merge of mapped developer messages is in, plus the server-side ordering/image check (
tests/tokenizer/test_tokenize.py,tests/server/test_mm_input.pypass).