Skip to content

Issues: turboderp-org/exllamav2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

110 Open 417 Closed
110 Open 417 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

HIP kernel errors
#328 opened Feb 7, 2024 by userbox020
3
[Feature Suggestion] SmoothQuant (W8A8) leads to ~50% better throughput
#311 opened Jan 31, 2024 by DreamGenX
why there isn't a more popular training approach based on exl2.
#309 opened Jan 30, 2024 by laoda513
5
GPU not supported on Nvidia Jetson AGX with JetPack 5.1
#301 opened Jan 25, 2024 by davidtheITguy
4
How to improve the performance of gemm_half_q_half_gptq_kernel operator?
#297 opened Jan 24, 2024 by lovelynight
1
Yi-Yi 2x34b+ merges generate very slowly.
#293 opened Jan 19, 2024 by Ph0rk0z
8
Possible problem in zero output
#279 opened Jan 16, 2024 by chu-tianxiang
2
Upcasting all the calculations.
#185 opened Nov 27, 2023 by Ph0rk0z
3
QuIP#, New SOTA(?) 2-bit Quantization Method
#176 opened Nov 23, 2023 by brucethemoose
6
Beam Search Implementation
#84 opened Oct 3, 2023 by ChrisCates
4
ProTip! Adding no:label will show everything without a label.