Skip to content

[MD-TRT] Llama export TP example with KV cache - #4287

Open
apbose wants to merge 2 commits into
mainfrom
abose/parallel_llama_export_kvcache
Open

[MD-TRT] Llama export TP example with KV cache#4287
apbose wants to merge 2 commits into
mainfrom
abose/parallel_llama_export_kvcache

Conversation

@apbose

@apbose apbose commented May 21, 2026

Copy link
Copy Markdown
Collaborator

No description provided.

@meta-cla meta-cla Bot added the cla signed label May 21, 2026
@github-actions github-actions Bot added component: conversion Issues re: Conversion stage component: core Issues re: The core compiler component: api [Python] Issues re: Python API component: runtime component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths labels May 21, 2026
@github-actions
github-actions Bot requested a review from cehongwang May 21, 2026 22:32
@apbose
apbose force-pushed the abose/parallel_llama_export_kvcache branch 2 times, most recently from dc7b008 to 3bad9e4 Compare June 15, 2026 16:30
@apbose
apbose force-pushed the abose/parallel_llama_export_kvcache branch from 3bad9e4 to 006cfef Compare June 25, 2026 18:39
@apbose apbose changed the title Llama export TP example with KV cache [MD-TRT] Llama export TP example with KV cache Aug 13, 2026
@lanluo-nvidia lanluo-nvidia added this to the v2.15.0 milestone Aug 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants