Skip to content

fix(data): count Hugging Face samples after token packing - #387

Merged
yghstill merged 1 commit into
Tencent:mainfrom
Linxiushen:fix/hf-text-packing
Oct 1, 2026
Merged

yghstill merged 1 commit into
Tencent:mainfrom
Linxiushen:fix/hf-text-packing

fix(data): count Hugging Face samples after token packing

87d6737
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
pre-commit
succeeded Sep 27, 2026 in 47s