Skip to content

Issues: casper-hansen/AutoAWQ

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

186 Open 272 Closed
186 Open 272 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Error with transformers 4.48+
#731 opened Mar 19, 2025 by corey-lambda
1
An error occurred when quantizing deepseek-r1-bf16 with longer data.
#729 opened Mar 19, 2025 by taishan1994
1
Support for Mistral Small 3.1
#728 opened Mar 18, 2025 by Leflak
Converting ph-4-mini model
#727 opened Mar 14, 2025 by farzanehnakhaee70
Support for Google Gemma 3
#726 opened Mar 14, 2025 by stelterlab
1
not working on wsl, impossible to install
#725 opened Mar 12, 2025 by Aveline67
Quantizing DeepSeek-R1-Distill-Qwen-7B produces garbage and repetitive tokens
#724 opened Mar 11, 2025 by hav4ik
1
macos support
#723 opened Mar 9, 2025 by lucasjinreal
backward
#722 opened Mar 8, 2025 by shuyuan-wang
What is the best format of the calib_data for instract model?
#721 opened Mar 3, 2025 by planetroger2020
Unpinning transformers or upgrading its latest supported version
#719 opened Feb 25, 2025 by mirekphd
Qwen 2.5 Quantization is slower than fp16 with vLLM
#717 opened Feb 22, 2025 by orionw
2
key/value shape mismatch in awq/modules/fused/cache.py
#716 opened Feb 20, 2025 by DominikHil
2
"Clarification on Multimodal Model Quantization and Default Calibration Dataset"
#714 opened Feb 17, 2025 by donghong1
1
while quantizing the llava-7b model,an error occurred: AttributeError: 'NoneType' object has no attribute 'shape'
#713 opened Feb 17, 2025 by donghong1
Support for Newer Mistral models for fused.
#712 opened Feb 17, 2025 by OPPEYRADY
1
Support for QWEN 2.5 VL
#710 opened Feb 11, 2025 by ViswaVasanth-2002
1
Support InternVL2.5 VLM
#708 opened Feb 8, 2025 by BenasdTW
Error after loading deepseekv3_cpu
#707 opened Feb 7, 2025 by Tortoise17
3
AutoAWQ Windows Fix – Get It Running!
#704 opened Jan 30, 2025 by WackyArt
ModuleNotFoundError: No module named 'torch'
#703 opened Jan 27, 2025 by Xephier102
6
3-bit or 6-bit quantization
#702 opened Jan 21, 2025 by khurramusman-10xe
3
Load Qwen/Qwen2-7B-Instruct-AWQ error: RuntimeError: Only Tensors created explicitly by the user (graph leaves) support the deepcopy protocol at the moment
#693 opened Jan 16, 2025 by liuzhishan
3
Failed to convert Qwen2-VL-7B-Instruct LORA model
#692 opened Jan 16, 2025 by songyang23
2
Same Memory (VRAM) with different batch_size, Prefill Length, Decode Length.
#691 opened Jan 15, 2025 by rayzr0123
ProTip! Add no:assignee to see everything that’s not assigned.