Pinned Loading

1. deepspeedai/DeepSpeed deepspeedai/DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 40.8k 4.6k

2. snowflakedb/ArcticInference snowflakedb/ArcticInference Public

   ArcticInference: vLLM plugin for high-throughput, low-latency inference

   Python 322 38

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 64k 11.6k