How many languages does model ggml-base.bin support? Can LANGUAGE be automatically recognized with AUTO?

[menghan465]

How many languages does this model support? Can LANGUAGE be automatically recognized with AUTO?

[misutoneko]

The model card says the training material was in english + 98 other languages.
As for actual support, YMMV. The big european languages will probably work out the best.
The details can be found in OpenAI's original paper.

The language must be known first before any text can be generated, and yes it's recognized unless you set it manually.
Multiple languages in the same sample will cause trouble (the first language will take precedence).