Pinned Loading

1. pro-router pro-router Public

   Token-aware progressive model routing with adaptive edge-cloud collaboration for efficient multimodal LLM inference

   Python

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. ray-project/ray ray-project/ray Public

   Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

   Python 44k 8.1k

4. verl-project/verl verl-project/verl Public

   verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework

   Python 23.7k 4.7k

5. NovaSky-AI/SkyRL NovaSky-AI/SkyRL Public

   SkyRL: A Modular Full-stack RL Library for LLMs

   Python 2.4k 446