bytedance-iaas
Popular repositories Loading
-
vllm
vllm PublicForked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
-
sglang
sglang PublicForked from sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
-
dynamo
dynamo PublicForked from ai-dynamo/dynamo
A Datacenter Scale Distributed Inference Serving Framework
-
LMCache
LMCache PublicForked from LMCache/LMCache
Making Long-Context LLM Inference 10x Faster and 10x Cheaper
-
xDiT
xDiT PublicForked from xdit-project/xDiT
xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism
Repositories
- sglang Public Forked from sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
bytedance-iaas/sglang’s past year of commit activity - SageAttention Public Forked from thu-ml/SageAttention
Quantized Attention achieves speedup of 2-5x and 3-11x compared to FlashAttention and xformers, without lossing end-to-end metrics across language, image, and video models.
bytedance-iaas/SageAttention’s past year of commit activity - SpecForge Public Forked from sgl-project/SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
bytedance-iaas/SpecForge’s past year of commit activity - vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
bytedance-iaas/vllm’s past year of commit activity - dynamo Public Forked from ai-dynamo/dynamo
A Datacenter Scale Distributed Inference Serving Framework
bytedance-iaas/dynamo’s past year of commit activity - xDiT Public Forked from xdit-project/xDiT
xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism
bytedance-iaas/xDiT’s past year of commit activity - DeepEP Public Forked from deepseek-ai/DeepEP
DeepEP: an efficient expert-parallel communication library
bytedance-iaas/DeepEP’s past year of commit activity - aibrix Public Forked from vllm-project/aibrix
Cost-efficient and pluggable Infrastructure components for GenAI inference
bytedance-iaas/aibrix’s past year of commit activity - Wan2.1 Public archive Forked from Wan-Video/Wan2.1
Wan: Open and Advanced Large-Scale Video Generative Models
bytedance-iaas/Wan2.1’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…