Pinned Loading

1. AutoSmoothQuant AutoSmoothQuant Public

   An easy-to-use package for implementing SmoothQuant for LLMs

   Python 104 9

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 17.2k 2.7k

3. volcengine/verl volcengine/verl Public

   verl: Volcano Engine Reinforcement Learning for LLMs

   Python 12.6k 2.2k

4. HandH1998/QQQ HandH1998/QQQ Public

   QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.

   Python 138 18

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 8 5

6. torch-int torch-int Public

   Forked from Guangxuan-Xiao/torch-int

   This repository contains integer operators on GPUs for PyTorch.

   Python 3 2