Skip to content

[MD-TRT] Llama export TP example with KV cache - #4287

Open
apbose wants to merge 2 commits into
mainfrom
abose/parallel_llama_export_kvcache
Open

[MD-TRT] Llama export TP example with KV cache#4287
apbose wants to merge 2 commits into
mainfrom
abose/parallel_llama_export_kvcache

adding qwen model

16a42ba
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar