Pinned Loading

1. mit-han-lab/omniserve mit-han-lab/omniserve Public

   [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention

   C++ 569 32

2. mit-han-lab/llm-awq mit-han-lab/llm-awq Public

   [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

   Python 2.8k 233

3. mit-han-lab/torchsparse mit-han-lab/torchsparse Public

   [MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.

   Cuda 1.3k 150

4. ys-2020.github.io ys-2020.github.io Public

   CSS