Pinned Loading

1. thu-nics/DiTFastAttn thu-nics/DiTFastAttn Public

   Jupyter Notebook 179 10

2. nn_tools nn_tools Public

   Neural Network Tools: Converter and Analyzer. For caffe, pytorch, draknet and so on.

   Python 357 63

3. LLM-Viewer LLM-Viewer Public

   Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.

   Python 559 67

4. RPTQ4LLM RPTQ4LLM Public

   Reorder-based post-training quantization for large language model

   Python 195 14

5. PTQ4ViT PTQ4ViT Public

   Post-Training Quantization for Vision transformers.

   Python 227 34

6. PB-LLM PB-LLM Public

   PB-LLM: Partially Binarized Large Language Models

   Python 155 8