Skip to content

Pack float and INT4 QKV projections with deferred weight binding - #754

Open
titaiwangms wants to merge 9 commits into
mainfrom
titaiwang/quantized-qkv-packing
Open

Pack float and INT4 QKV projections with deferred weight binding#754
titaiwangms wants to merge 9 commits into
mainfrom
titaiwang/quantized-qkv-packing

Require independent opt-in for float projection packing

54327d3
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar