0.1.1

github-actions released this 27 May 16:53

· 452 commits to master since this release

8a57be1

Fix performance of Q4 cache in dynamic generator
Add paged attn support for FP16 models
Add xformers support

Full Changelog: v0.1.0...v0.1.1

Assets 39