Skip to content

KoboldCPP_Frankenstein_Experimental_1.52_Mixtral_v2

Compare
Choose a tag to compare
@Nexesenex Nexesenex released this 13 Dec 15:07
· 4842 commits to concedo_experimental since this release

Based on the just released Kobold CPP v.1.52, compatible with Mixtral and Qwen, with :

  • unlocked context size and blas batch size in command line
  • Cublas version compiled with CUDA 11.0 (for a smaller koboldcpp_cuda.exe)

Original release from LostRuins, and the full changelog :
https://github.com/LostRuins/koboldcpp/releases/tag/v1.52