Skip to content

Commit cc1f6f9

Browse files
mudlerdave-gray101
andauthored
fix(llama.cpp): disable mirostat as default (mudler#2911)
Even if increasing the quality of the output, it has shown to have performance drawbacks to be so noticeable that the confuses users about speed of LocalAI ( see also mudler#2780 ). This changeset disables Mirostat by default (which can be still enabled manually). Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: Dave <dave@gray101.com>
1 parent 7f90ff7 commit cc1f6f9

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

core/config/backend_config.go

+2-1
Original file line numberDiff line numberDiff line change
@@ -287,7 +287,8 @@ func (cfg *BackendConfig) SetDefaults(opts ...ConfigLoaderOption) {
287287
defaultTopP := 0.95
288288
defaultTopK := 40
289289
defaultTemp := 0.9
290-
defaultMirostat := 2
290+
// https://github.com/mudler/LocalAI/issues/2780
291+
defaultMirostat := 0
291292
defaultMirostatTAU := 5.0
292293
defaultMirostatETA := 0.1
293294
defaultTypicalP := 1.0

0 commit comments

Comments
 (0)