Skip to content

lfm3: serve LFM3-1.7B NVFP4 on CUDA, weight-only (stacked on #1492 and the LFM3 admission) - #1508

Draft
jschmied wants to merge 20 commits into
ashhart:mainfrom
jschmied:lfm3-cuda-nvfp4
Draft

jschmied wants to merge 20 commits into
ashhart:mainfrom
jschmied:lfm3-cuda-nvfp4

Enhance your code review process with GitHub Actions

GitHub Actions make it easy to automate all your software workflows, now with world-class CI/CD.
Build, test, and deploy your code right from GitHub. Learn more about GitHub Actions.

Linux, macOS, Windows, and containers
Linux, macOS, Windows, and containers
Matrix builds
Matrix builds
Any language
Any language
Live logs
Live logs
Built-in secret store
Built-in secret store
Multi-container testing
Multi-container testing