Pinned Loading

1. python/cpython python/cpython Public

   The Python programming language

   Python 77.8k 37.1k

2. pytorch/pytorch pytorch/pytorch Public

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python 105k 31.3k

3. NVIDIA/Megatron-LM NVIDIA/Megatron-LM Public

   Ongoing research training transformer models at scale

   Python 18.3k 4.7k

4. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   Python 15k 2.9k

5. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 38.3k 10.1k

6. flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

   FlashInfer: Kernel Library for LLM Serving

   Cuda 6.8k 1.7k