[dependabot]

Bumps the pip group with 1 update in the /examples/llm_compression/onnx/smollm2_360m_fp8 directory: transformers.
Bumps the pip group with 1 update in the /examples/llm_compression/onnx/tiny_llama directory: transformers.
Bumps the pip group with 1 update in the /examples/llm_compression/onnx/tiny_llama_scale_estimation directory: transformers.
Bumps the pip group with 1 update in the /examples/llm_compression/openvino/smollm2_360m_adaptive_codebook directory: transformers.
Bumps the pip group with 1 update in the /examples/llm_compression/openvino/smollm2_360m_codebook directory: transformers.
Bumps the pip group with 1 update in the /examples/llm_compression/openvino/smollm2_360m_fp8 directory: transformers.
Bumps the pip group with 1 update in the /examples/llm_compression/openvino/tiny_llama directory: transformers.
Bumps the pip group with 1 update in the /examples/llm_compression/openvino/tiny_llama_find_hyperparams directory: transformers.
Bumps the pip group with 1 update in the /examples/llm_compression/openvino/tiny_llama_synthetic_data directory: transformers.
Bumps the pip group with 1 update in the /examples/llm_compression/torch/distillation_qat_with_lora directory: transformers.
Bumps the pip group with 1 update in the /examples/llm_compression/torch/downstream_qat_with_nls directory: transformers.
Bumps the pip group with 1 update in the /examples/llm_compression/torch_fx/tiny_llama directory: transformers.
Bumps the pip group with 1 update in the /tests/openvino directory: transformers.
Bumps the pip group with 1 update in the /tests/post_training directory: transformers.
Bumps the pip group with 1 update in the /tests/torch directory: transformers.

Updates transformers from 5.5.0 to 5.10.1

Release notes

Sourced from transformers's releases.

Release v5.10.1

v5.10.0 was yanked as we publish on a corrupted branch. Sorry everyone, this happens when we rush a release!!!

New Model additions

Gemma4 unified+ Gemma4 MTP

Gemma 4 12B Unified is an encoder-free multimodal model with pretrained and instruction-tuned variants. Unlike standard Gemma 4, which uses dedicated encoder towers, Gemma 4 12B Unified projects raw inputs directly into the language model's embedding space through lightweight linear pipelines. This results in a simpler architecture while maintaining strong multimodal performance.

Key differences from standard Gemma 4:

• No Vision Tower: Raw pixel patches are projected directly into LM space via a Dense + LayerNorm pipeline with factorized 2D positional embeddings, replacing the vision encoder.
• No Audio Tower: Raw 16 kHz waveform samples are chunked into fixed-length frames and projected through a simple RMSNorm → Linear pipeline, replacing the mel spectrogram + Conformer encoder.
• Shared Multimodal Pipeline: Both vision and audio use the same Gemma4UnifiedMultimodalEmbedder (RMSNorm → Linear) for the final projection to text hidden space.

You can find the original Gemma 4 12B Unified checkpoints under the Gemma 4 release.

• who needs encoders? (#46385) by @​douglas-reid @​sgerrard @​vasqu @​molbap

Sapiens2

Sapiens2 is a family of high-resolution vision transformers pretrained on ~1 billion curated human images, designed for human-centric computer vision tasks including pose estimation, body-part segmentation, surface normal estimation, and pointmap estimation. The models scale from 0.4B to 5B parameters and train at native 1K resolution, with hierarchical 4K variants for extended spatial reasoning. Sapiens2 achieves substantial improvements over its predecessor with +4 mAP in pose estimation, +24.3 mIoU in body-part segmentation, and 45.6% error reduction in normal estimation.

Links: Documentation | Paper

• Add Sapiens2 Model (#45919) by @​guarin in #45919

DeepSeek-OCR-2

DeepSeek-OCR-2 is an OCR-specialized vision-language model built on a distinctive architecture that combines a SAM ViT-B vision encoder with a Qwen2 hybrid attention encoder, connected through an MLP projector to a DeepSeek-V2 Mixture-of-Experts (MoE) language model. The model features a hybrid attention mechanism that applies bidirectional attention over image tokens and causal attention over query tokens, enabling efficient and accurate document understanding. It supports both plain OCR tasks and grounding capabilities with coordinate-aware output for document conversion to markdown format.

Links: Documentation

• Add Deepseek-OCR-2 model (#45075) by @​thisisiron in #45075

Mellum

Mellum is a code-focused Mixture-of-Experts language model developed by JetBrains. It is derived from the Qwen3-MoE architecture with per-layer-type RoPE and interleaved sliding window attention. The model has 12B total parameters with 2.5B active parameters per token, using 64 routed experts with 8 activated per token across 28 layers.

Links: Documentation

• feat: Add support for JetBrains' Mellum v2 code generation model (#46112) by @​shadeMe in #46112

Breaking changes

The Gemma4 vision pooler now casts inputs to float32 before scaling to prevent float16 overflow (inf saturation) with large checkpoints, which may cause minor numerical differences in outputs for users running Gemma-4 vision models in float16.

• 🚨 Fix float16 overflow in Gemma4 vision pooler (#46277) by @​Bluear7878

Audio Language Models (ALMs) now have a dedicated base model class without a language modeling head, aligning them with the design of Vision Language Models (VLMs); users relying on the previous model class structure should update their code to use the new base model class where appropriate.

• 🚨 [ALM] Add base model without head (#45534) by @​eustlb

... (truncated)

Commits

• 90c3ae5 Patch because we had to yank 5.10 because the release branch was not up to date
• 0bd94b3 v5.10.0
• 1423d22 who needs encoders? (#46385)
• 50eb20a Fix dsv4 dequant + tp/ep (#46378)
• 74464e8 Fix wrong changes produced by style/repo. check bot (#46371)
• 1b8ec34 Fix path traversal when saving Bark voice preset embeddings (#46237)
• e820678 Add Sapiens2 Model (#45919)
• 595721c Pass library_name/version to Hub calls via a shared HfApi (#46318)
• 0f0036c docs: update ACL Anthology URL in CITATION.cff (#46352)
• fa6c830 DeepGEMM BF16 + mixed FP8/FP4 + MegaMoE + refactor (#45634)
• Additional commits viewable in compare view

Updates transformers from 5.5.0 to 5.10.1

Release notes

Sourced from transformers's releases.

Release v5.10.1

v5.10.0 was yanked as we publish on a corrupted branch. Sorry everyone, this happens when we rush a release!!!

New Model additions

Gemma4 unified+ Gemma4 MTP

Gemma 4 12B Unified is an encoder-free multimodal model with pretrained and instruction-tuned variants. Unlike standard Gemma 4, which uses dedicated encoder towers, Gemma 4 12B Unified projects raw inputs directly into the language model's embedding space through lightweight linear pipelines. This results in a simpler architecture while maintaining strong multimodal performance.

Key differences from standard Gemma 4:

• No Vision Tower: Raw pixel patches are projected directly into LM space via a Dense + LayerNorm pipeline with factorized 2D positional embeddings, replacing the vision encoder.
• No Audio Tower: Raw 16 kHz waveform samples are chunked into fixed-length frames and projected through a simple RMSNorm → Linear pipeline, replacing the mel spectrogram + Conformer encoder.
• Shared Multimodal Pipeline: Both vision and audio use the same Gemma4UnifiedMultimodalEmbedder (RMSNorm → Linear) for the final projection to text hidden space.

You can find the original Gemma 4 12B Unified checkpoints under the Gemma 4 release.

• who needs encoders? (#46385) by @​douglas-reid @​sgerrard @​vasqu @​molbap

Sapiens2

Sapiens2 is a family of high-resolution vision transformers pretrained on ~1 billion curated human images, designed for human-centric computer vision tasks including pose estimation, body-part segmentation, surface normal estimation, and pointmap estimation. The models scale from 0.4B to 5B parameters and train at native 1K resolution, with hierarchical 4K variants for extended spatial reasoning. Sapiens2 achieves substantial improvements over its predecessor with +4 mAP in pose estimation, +24.3 mIoU in body-part segmentation, and 45.6% error reduction in normal estimation.

Links: Documentation | Paper

• Add Sapiens2 Model (#45919) by @​guarin in #45919

DeepSeek-OCR-2

DeepSeek-OCR-2 is an OCR-specialized vision-language model built on a distinctive architecture that combines a SAM ViT-B vision encoder with a Qwen2 hybrid attention encoder, connected through an MLP projector to a DeepSeek-V2 Mixture-of-Experts (MoE) language model. The model features a hybrid attention mechanism that applies bidirectional attention over image tokens and causal attention over query tokens, enabling efficient and accurate document understanding. It supports both plain OCR tasks and grounding capabilities with coordinate-aware output for document conversion to markdown format.

Links: Documentation

• Add Deepseek-OCR-2 model (#45075) by @​thisisiron in #45075

Mellum

Mellum is a code-focused Mixture-of-Experts language model developed by JetBrains. It is derived from the Qwen3-MoE architecture with per-layer-type RoPE and interleaved sliding window attention. The model has 12B total parameters with 2.5B active parameters per token, using 64 routed experts with 8 activated per token across 28 layers.

Links: Documentation

• feat: Add support for JetBrains' Mellum v2 code generation model (#46112) by @​shadeMe in #46112

Breaking changes

The Gemma4 vision pooler now casts inputs to float32 before scaling to prevent float16 overflow (inf saturation) with large checkpoints, which may cause minor numerical differences in outputs for users running Gemma-4 vision models in float16.

• 🚨 Fix float16 overflow in Gemma4 vision pooler (#46277) by @​Bluear7878

Audio Language Models (ALMs) now have a dedicated base model class without a language modeling head, aligning them with the design of Vision Language Models (VLMs); users relying on the previous model class structure should update their code to use the new base model class where appropriate.

• 🚨 [ALM] Add base model without head (#45534) by @​eustlb

... (truncated)

Commits

• 90c3ae5 Patch because we had to yank 5.10 because the release branch was not up to date
• 0bd94b3 v5.10.0
• 1423d22 who needs encoders? (#46385)
• 50eb20a Fix dsv4 dequant + tp/ep (#46378)
• 74464e8 Fix wrong changes produced by style/repo. check bot (#46371)
• 1b8ec34 Fix path traversal when saving Bark voice preset embeddings (#46237)
• e820678 Add Sapiens2 Model (#45919)
• 595721c Pass library_name/version to Hub calls via a shared HfApi (#46318)
• 0f0036c docs: update ACL Anthology URL in CITATION.cff (#46352)
• fa6c830 DeepGEMM BF16 + mixed FP8/FP4 + MegaMoE + refactor (#45634)
• Additional commits viewable in compare view

Updates transformers from 5.5.0 to 5.10.1

Release notes

Sourced from transformers's releases.

Release v5.10.1

v5.10.0 was yanked as we publish on a corrupted branch. Sorry everyone, this happens when we rush a release!!!

New Model additions

Gemma4 unified+ Gemma4 MTP

Gemma 4 12B Unified is an encoder-free multimodal model with pretrained and instruction-tuned variants. Unlike standard Gemma 4, which uses dedicated encoder towers, Gemma 4 12B Unified projects raw inputs directly into the language model's embedding space through lightweight linear pipelines. This results in a simpler architecture while maintaining strong multimodal performance.

Key differences from standard Gemma 4:

• No Vision Tower: Raw pixel patches are projected directly into LM space via a Dense + LayerNorm pipeline with factorized 2D positional embeddings, replacing the vision encoder.
• No Audio Tower: Raw 16 kHz waveform samples are chunked into fixed-length frames and projected through a simple RMSNorm → Linear pipeline, replacing the mel spectrogram + Conformer encoder.
• Shared Multimodal Pipeline: Both vision and audio use the same Gemma4UnifiedMultimodalEmbedder (RMSNorm → Linear) for the final projection to text hidden space.

You can find the original Gemma 4 12B Unified checkpoints under the Gemma 4 release.

• who needs encoders? (#46385) by @​douglas-reid @​sgerrard @​vasqu @​molbap

Sapiens2

Sapiens2 is a family of high-resolution vision transformers pretrained on ~1 billion curated human images, designed for human-centric computer vision tasks including pose estimation, body-part segmentation, surface normal estimation, and pointmap estimation. The models scale from 0.4B to 5B parameters and train at native 1K resolution, with hierarchical 4K variants for extended spatial reasoning. Sapiens2 achieves substantial improvements over its predecessor with +4 mAP in pose estimation, +24.3 mIoU in body-part segmentation, and 45.6% error reduction in normal estimation.

Links: Documentation | Paper

• Add Sapiens2 Model (#45919) by @​guarin in #45919

DeepSeek-OCR-2

DeepSeek-OCR-2 is an OCR-specialized vision-language model built on a distinctive architecture that combines a SAM ViT-B vision encoder with a Qwen2 hybrid attention encoder, connected through an MLP projector to a DeepSeek-V2 Mixture-of-Experts (MoE) language model. The model features a hybrid attention mechanism that applies bidirectional attention over image tokens and causal attention over query tokens, enabling efficient and accurate document understanding. It supports both plain OCR tasks and grounding capabilities with coordinate-aware output for document conversion to markdown format.

Links: Documentation

• Add Deepseek-OCR-2 model (#45075) by @​thisisiron in #45075

Mellum

Mellum is a code-focused Mixture-of-Experts language model developed by JetBrains. It is derived from the Qwen3-MoE architecture with per-layer-type RoPE and interleaved sliding window attention. The model has 12B total parameters with 2.5B active parameters per token, using 64 routed experts with 8 activated per token across 28 layers.

Links: Documentation

• feat: Add support for JetBrains' Mellum v2 code generation model (#46112) by @​shadeMe in #46112

Breaking changes

The Gemma4 vision pooler now casts inputs to float32 before scaling to prevent float16 overflow (inf saturation) with large checkpoints, which may cause minor numerical differences in outputs for users running Gemma-4 vision models in float16.

• 🚨 Fix float16 overflow in Gemma4 vision pooler (#46277) by @​Bluear7878

Audio Language Models (ALMs) now have a dedicated base model class without a language modeling head, aligning them with the design of Vision Language Models (VLMs); users relying on the previous model class structure should update their code to use the new base model class where appropriate.

• 🚨 [ALM] Add base model without head (#45534) by @​eustlb

... (truncated)

Commits

• 90c3ae5 Patch because we had to yank 5.10 because the release branch was not up to date
• 0bd94b3 v5.10.0
• 1423d22 who needs encoders? (#46385)
• 50eb20a Fix dsv4 dequant + tp/ep (#46378)
• 74464e8 Fix wrong changes produced by style/repo. check bot (#46371)
• 1b8ec34 Fix path traversal when saving Bark voice preset embeddings (#46237)
• e820678 Add Sapiens2 Model (#45919)
• 595721c Pass library_name/version to Hub calls via a shared HfApi (#46318)
• 0f0036c docs: update ACL Anthology URL in CITATION.cff (#46352)
• fa6c830 DeepGEMM BF16 + mixed FP8/FP4 + MegaMoE + refactor (#45634)
• Additional commits viewable in compare view

Updates transformers from 5.5.0 to 5.10.1

Release notes

Sourced from transformers's releases.

Release v5.10.1

v5.10.0 was yanked as we publish on a corrupted branch. Sorry everyone, this happens when we rush a release!!!

New Model additions

Gemma4 unified+ Gemma4 MTP

Gemma 4 12B Unified is an encoder-free multimodal model with pretrained and instruction-tuned variants. Unlike standard Gemma 4, which uses dedicated encoder towers, Gemma 4 12B Unified projects raw inputs directly into the language model's embedding space through lightweight linear pipelines. This results in a simpler architecture while maintaining strong multimodal performance.

Key differences from standard Gemma 4:

• No Vision Tower: Raw pixel patches are projected directly into LM space via a Dense + LayerNorm pipeline with factorized 2D positional embeddings, replacing the vision encoder.
• No Audio Tower: Raw 16 kHz waveform samples are chunked into fixed-length frames and projected through a simple RMSNorm → Linear pipeline, replacing the mel spectrogram + Conformer encoder.
• Shared Multimodal Pipeline: Both vision and audio use the same Gemma4UnifiedMultimodalEmbedder (RMSNorm → Linear) for the final projection to text hidden space.

You can find the original Gemma 4 12B Unified checkpoints under the Gemma 4 release.

• who needs encoders? (#46385) by @​douglas-reid @​sgerrard @​vasqu @​molbap

Sapiens2

Sapiens2 is a family of high-resolution vision transformers pretrained on ~1 billion curated human images, designed for human-centric computer vision tasks including pose estimation, body-part segmentation, surface normal estimation, and pointmap estimation. The models scale from 0.4B to 5B parameters and train at native 1K resolution, with hierarchical 4K variants for extended spatial reasoning. Sapiens2 achieves substantial improvements over its predecessor with +4 mAP in pose estimation, +24.3 mIoU in body-part segmentation, and 45.6% error reduction in normal estimation.

Links: Documentation | Paper

• Add Sapiens2 Model (#45919) by @​guarin in #45919

DeepSeek-OCR-2

DeepSeek-OCR-2 is an OCR-specialized vision-language model built on a distinctive architecture that combines a SAM ViT-B vision encoder with a Qwen2 hybrid attention encoder, connected through an MLP projector to a DeepSeek-V2 Mixture-of-Experts (MoE) language model. The model features a hybrid attention mechanism that applies bidirectional attention over image tokens and causal attention over query tokens, enabling efficient and accurate document understanding. It supports both plain OCR tasks and grounding capabilities with coordinate-aware output for document conversion to markdown format.

Links: Documentation

• Add Deepseek-OCR-2 model (#45075) by @​thisisiron in #45075

Mellum

Mellum is a code-focused Mixture-of-Experts language model developed by JetBrains. It is derived from the Qwen3-MoE architecture with per-layer-type RoPE and interleaved sliding window attention. The model has 12B total parameters with 2.5B active parameters per token, using 64 routed experts with 8 activated per token across 28 layers.

Links: Documentation

• feat: Add support for JetBrains' Mellum v2 code generation model (#46112) by @​shadeMe in #46112

Breaking changes

The Gemma4 vision pooler now casts inputs to float32 before scaling to prevent float16 overflow (inf saturation) with large checkpoints, which may cause minor numerical differences in outputs for users running Gemma-4 vision models in float16.

• 🚨 Fix float16 overflow in Gemma4 vision pooler (#46277) by @​Bluear7878

Audio Language Models (ALMs) now have a dedicated base model class without a language modeling head, aligning them with the design of Vision Language Models (VLMs); users relying on the previous model class structure should update their code to use the new base model class where appropriate.

• 🚨 [ALM] Add base model without head (#45534) by @​eustlb

... (truncated)

Commits

• 90c3ae5 Patch because we had to yank 5.10 because the release branch was not up to date
• 0bd94b3 v5.10.0
• 1423d22 who needs encoders? (#46385)
• 50eb20a Fix dsv4 dequant + tp/ep (#46378)
• 74464e8 Fix wrong changes produced by style/repo. check bot (#46371)
• 1b8ec34 Fix path traversal when saving Bark voice preset embeddings (#46237)
• e820678 Add Sapiens2 Model (#45919)
• 595721c Pass library_name/version to Hub calls via a shared HfApi (#46318)
• 0f0036c docs: update ACL Anthology URL in CITATION.cff (#46352)
• fa6c830 DeepGEMM BF16 + mixed FP8/FP4 + MegaMoE + refactor (#45634)
• Additional commits viewable in compare view

Updates transformers from 5.5.0 to 5.10.1

Release notes

Sourced from transformers's releases.

Release v5.10.1

v5.10.0 was yanked as we publish on a corrupted branch. Sorry everyone, this happens when we rush a release!!!

New Model additions

Gemma4 unified+ Gemma4 MTP

Gemma 4 12B Unified is an encoder-free multimodal model with pretrained and instruction-tuned variants. Unlike standard Gemma 4, which uses dedicated encoder towers, Gemma 4 12B Unified projects raw inputs directly into the language model's embedding space through lightweight linear pipelines. This results in a simpler architecture while maintaining strong multimodal performance.

Key differences from standard Gemma 4:

• No Vision Tower: Raw pixel patches are projected directly into LM space via a Dense + LayerNorm pipeline with factorized 2D positional embeddings, replacing the vision encoder.
• No Audio Tower: Raw 16 kHz waveform samples are chunked into fixed-length frames and projected through a simple RMSNorm → Linear pipeline, replacing the mel spectrogram + Conformer encoder.
• Shared Multimodal Pipeline: Both vision and audio use the same Gemma4UnifiedMultimodalEmbedder (RMSNorm → Linear) for the final projection to text hidden space.

You can find the original Gemma 4 12B Unified checkpoints under the Gemma 4 release.

• who needs encoders? (#46385) by @​douglas-reid @​sgerrard @​vasqu @​molbap

Sapiens2

Sapiens2 is a family of high-resolution vision transformers pretrained on ~1 billion curated human images, designed for human-centric computer vision tasks including pose estimation, body-part segmentation, surface normal estimation, and pointmap estimation. The models scale from 0.4B to 5B parameters and train at native 1K resolution, with hierarchical 4K variants for extended spatial reasoning. Sapiens2 achieves substantial improvements over its predecessor with +4 mAP in pose estimation, +24.3 mIoU in body-part segmentation, and 45.6% error reduction in normal estimation.

Links: Documentation | Paper

• Add Sapiens2 Model (#45919) by @​guarin in #45919

DeepSeek-OCR-2

DeepSeek-OCR-2 is an OCR-specialized vision-language model built on a distinctive architecture that combines a SAM ViT-B vision encoder with a Qwen2 hybrid attention encoder, connected through an MLP projector to a DeepSeek-V2 Mixture-of-Experts (MoE) language model. The model features a hybrid attention mechanism that applies bidirectional attention over image tokens and causal attention over query tokens, enabling efficient and accurate document understanding. It supports both plain OCR tasks and grounding capabilities with coordinate-aware output for document conversion to markdown format.

Links: Documentation

• Add Deepseek-OCR-2 model (#45075) by @​thisisiron in #45075

Mellum

Mellum is a code-focused Mixture-of-Experts language model developed by JetBrains. It is derived from the Qwen3-MoE architecture with per-layer-type RoPE and interleaved sliding window attention. The model has 12B total parameters with 2.5B active parameters per token, using 64 routed experts with 8 activated per token across 28 layers.

Links: Documentation

• feat: Add support for JetBrains' Mellum v2 code generation model (#46112) by @​shadeMe in #46112

Breaking changes

The Gemma4 vision pooler now casts inputs to float32 before scaling to prevent float16 overflow (inf saturation) with large checkpoints, which may cause minor numerical differences in outputs for users running Gemma-4 vision models in float16.

• 🚨 Fix float16 overflow in Gemma4 vision pooler (#46277) by @​Bluear7878

Audio Language Models (ALMs) now have a dedicated base model class without a language modeling head, aligning them with the design of Vision Language Models (VLMs); users relying on the previous model class structure should update their code to use the new base model class where appropriate.

• 🚨 [ALM] Add base model without head (#45534) by @​eustlb

... (truncated)

Commits

• 90c3ae5 Patch because we had to yank 5.10 because the release branch was not up to date
• 0bd94b3 v5.10.0
• 1423d22 who needs encoders? (#46385)
• 50eb20a Fix dsv4 dequant + tp/ep (#46378)
• 74464e8 Fix wrong changes produced by style/repo. check bot (#46371)
• 1b8ec34 Fix path traversal when saving Bark voice preset embeddings (#46237)
• e820678 Add Sapiens2 Model (#45919)
• 595721c Pass library_name/version to Hub calls via a shared HfApi (#46318)
• 0f0036c docs: update ACL Anthology URL in CITATION.cff (#46352)
• fa6c830 DeepGEMM BF16 + mixed FP8/FP4 + MegaMoE + refactor (#45634)
• Additional commits viewable in compare view

Updates transformers from 5.5.0 to 5.10.1

Release notes

Sourced from transformers's releases.

Release v5.10.1

v5.10.0 was yanked as we publish on a corrupted branch. Sorry everyone, this happens when we rush a release!!!

New Model additions

Gemma4 unified+ Gemma4 MTP

Gemma 4 12B Unified is an encoder-free multimodal model with pretrained and instruction-tuned variants. Unlike standard Gemma 4, which uses dedicated encoder towers, Gemma 4 12B Unified projects raw inputs directly into the language model's embedding space through lightweight linear pipelines. This results in a simpler architecture while maintaining strong multimodal performance.

Key differences from standard Gemma 4:

• No Vision Tower: Raw pixel patches are projected directly into LM space via a Dense + LayerNorm pipeline with factorized 2D positional embeddings, replacing the vision encoder.
• No Audio Tower: Raw 16 kHz waveform samples are chunked into fixed-length frames and projected through a simple RMSNorm → Linear pipeline, replacing the mel spectrogram + Conformer encoder.
• Shared Multimodal Pipeline: Both vision and audio use the same Gemma4UnifiedMultimodalEmbedder (RMSNorm → Linear) for the final projection to text hidden space.

You can find the original Gemma 4 12B Unified checkpoints under the Gemma 4 release.

• who needs encoders? (#46385) by @​douglas-reid @​sgerrard @​vasqu @​molbap

Sapiens2

Sapiens2 is a family of high-resolution vision transformers pretrained on ~1 billion curated human images, designed for human-centric computer vision tasks including pose estimation, body-part segmentation, surface normal estimation, and pointmap estimation. The models scale from 0.4B to 5B parameters and train at native 1K resolution, with hierarchical 4K variants for extended spatial reasoning. Sapiens2 achieves substantial improvements over its predecessor with +4 mAP in pose estimation, +24.3 mIoU in body-part segmentation, and 45.6% error reduction in normal estimation.

Links: Documentation | Paper

• Add Sapiens2 Model (#45919) by @​guarin in #45919

DeepSeek-OCR-2

DeepSeek-OCR-2 is an OCR-specialized vision-language model built on a distinctive architecture that combines a SAM ViT-B vision encoder with a Qwen2 hybrid attention encoder, connected through an MLP projector to a DeepSeek-V2 Mixture-of-Experts (MoE) language model. The model features a hybrid attention mechanism that applies bidirectional attention over image tokens and causal attention over query tokens, enabling efficient and accurate document understanding. It supports both plain OCR tasks and grounding capabilities with coordinate-aware output for document conversion to markdown format.

Links: Documentation

• Add Deepseek-OCR-2 model (#45075) by @​thisisiron in #45075

Mellum

Mellum is a code-focused Mixture-of-Experts language model developed by JetBrains. It is derived from the Qwen3-MoE architecture with per-layer-type RoPE and interleaved sliding window attention. The model has 12B total parameters with 2.5B active parameters per token, using 64 routed experts with 8 activated per token across 28 layers.

Links: Documentation

• feat: Add support for JetBrains' Mellum v2 code generation model (#46112) by @​shadeMe in #46112

Breaking changes

The Gemma4 vision pooler now casts inputs to float32 before scaling to prevent float16 overflow (inf saturation) with large checkpoints, which may cause minor numerical differences in outputs for users running Gemma-4 vision models in float16.

• 🚨 Fix float16 overflow in Gemma4 vision pooler (#46277) by @​Bluear7878

Audio Language Models (ALMs) now have a dedicated base model class without a language modeling head, aligning them with the design of Vision Language Models (VLMs); users relying on the previous model class structure should update their code to use the new base model class where appropriate.

• 🚨 [ALM] Add base model without head (#45534) by @​eustlb

... (truncated)

Commits

• 90c3ae5 Patch because we had to yank 5.10 because the release branch was not up to date
• 0bd94b3 v5.10.0
• 1423d22 who needs encoders? (#46385)
• 50eb20a Fix dsv4 dequant + tp/ep (#46378)
• 74464e8 Fix wrong changes produced by style/repo. check bot (#46371)
• 1b8ec34 Fix path traversal when saving Bark voice preset embeddings (#46237)
• e820678 Add Sapiens2 Model (#45919)
• 595721c Pass library_name/version to Hub calls via a shared HfApi (#46318)
• 0f0036c docs: update ACL Anthology URL in CITATION.cff (#46352)
• fa6c830 DeepGEMM BF16 + mixed FP8/FP4 + MegaMoE + refactor (#45634)
• Additional commits viewable in compare view

Updates transformers from 5.5.0 to 5.10.1

Release notes

Sourced from transformers's releases.

Release v5.10.1

v5.10.0 was yanked as we publish on a corrupted branch. Sorry everyone, this happens when we rush a release!!!

New Model additions

Gemma4 unified+ Gemma4 MTP

Gemma 4 12B Unified is an encoder-free multimodal model with pretrained and instruction-tuned variants. Unlike standard Gemma 4, which uses dedicated encoder towers, Gemma 4 12B Unified projects raw inputs directly into the language model's embedding space through lightweight linear pipelines. This results in a simpler architecture while maintaining strong multimodal performance.

Key differences from standard Gemma 4:

• No Vision Tower: Raw pixel patches are projected directly into LM space via a Dense + LayerNorm pipeline with factorized 2D positional embeddings, replacing the vision encoder.
• No Audio Tower: Raw 16 kHz waveform samples are chunked into fixed-length frames and projected through a simple RMSNorm → Linear pipeline, replacing the mel spectrogram + Conformer encoder.
• Shared Multimodal Pipeline: Both vision and audio use the same Gemma4UnifiedMultimodalEmbedder (RMSNorm → Linear) for the final projection to text hidden space.

You can find the original Gemma 4 12B Unified checkpoints under the Gemma 4 release.

• who needs encoders? (#46385) by @​douglas-reid @​sgerrard @​vasqu @​molbap

Sapiens2

Sapiens2 is a family of high-resolution vision transformers pretrained on ~1 billion curated human images, designed for human-centric computer vision tasks including pose estimation, body-part segmentation, surface normal estimation, and pointmap estimation. The models scale from 0.4B to 5B parameters and train at native 1K resolution, with hierarchical 4K variants for extended spatial reasoning. Sapiens2 achieves substantial improvements over its predecessor with +4 mAP in pose estimation, +24.3 mIoU in body-part segmentation, and 45.6% error reduction in normal estimation.

Links: Documentation | Paper

• Add Sapiens2 Model (#45919) by @​guarin in #45919

DeepSeek-OCR-2

DeepSeek-OCR-2 is an OCR-specialized vision-language model built on a distinctive architecture that combines a SAM ViT-B vision encoder with a Qwen2 hybrid attention encoder, connected through an MLP projector to a DeepSeek-V2 Mixture-of-Experts (MoE) language model. The model features a hybrid attention mechanism that applies bidirectional attention over image tokens and causal attention over query tokens, enabling efficient and accurate document understanding. It supports both plain OCR tasks and grounding capabilities with coordinate-aware output for document conversion to markdown format.

Links: Documentation

• Add Deepseek-OCR-2 model (#45075) by @​thisisiron in #45075

Mellum

Mellum is a code-focused Mixture-of-Experts language model developed by JetBrains. It is derived from the Qwen3-MoE architecture with per-layer-type RoPE and interleaved sliding window attention. The model has 12B total parameters with 2.5B active parameters per token, using 64 routed experts with 8 activated per token across 28 layers.

Links: Documentation

• feat: Add support for JetBrains' Mellum v2 code generation model (#46112) by @​shadeMe in #46112

Breaking changes

The Gemma4 vision pooler now casts inputs to float32 before scaling to prevent float16 overflow (inf saturation) with large checkpoints, which may cause minor numerical differences in outputs for users running Gemma-4 vision models in float16.

• 🚨 Fix float16 overflow in Gemma4 vision pooler (#46277) by @​Bluear7878

Audio Language Models (ALMs) now have a dedicated base model class without a language modeling head, aligning them with the design of Vision Language Models (VLMs); users relying on the previous model class structure should update their code to use the new base model class where appropriate.

• 🚨 [ALM] Add base model without head (#45534) by @​eustlb

... (truncated)

Commits

• 90c3ae5 Patch because we had to yank 5.10 because the release branch was not up to date
• 0bd94b3 v5.10.0
• 1423d22 who needs encoders? (#46385)
• 50eb20a Fix dsv4 dequant + tp/ep (#46378)
• 74464e8 Fix wrong changes produced by style/repo. check bot (#46371)
• 1b8ec34 Fix path traversal when saving Bark voice preset embeddings (#46237)
• e820678 Add Sapiens2 Model (#45919)
• 595721c Pass library_name/version to Hub calls via a shared HfApi (#46318)
• 0f0036c docs: update ACL Anthology URL in CITATION.cff (#46352)
• fa6c830 DeepGEMM BF16 + mixed FP8/FP4 + MegaMoE + refactor (#45634)
• Additional commits viewable in compare view

Updates transformers from 5.5.0 to 5.10.1

Release notes

Sourced from transformers's releases.

Release v5.10.1

v5.10.0 was yanked as we publish on a corrupted branch. Sorry everyone, this happens when we rush a release!!!

New Model additions

Gemma4 unified+ Gemma4 MTP

Gemma 4 12B Unified is an encoder-free multimodal ...

Description has been truncated