New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Error opening embedding model #1410

Open

gilbert0571 opened this issue Mar 7, 2025 · 1 comment

gilbert0571 commented Mar 7, 2025

The used embedding model is bge-m3 downloaded from https://huggingface.co/gpustack/bge-m3-GGUF/tree/main.

I want to use the model through the ollama api provided by koboldcpp_nocuda.exe by loading the embedding model.

error log:
src/llama.cpp:8702: GGML_ASSERT(strcmp(res->name, "result_output") == 0 && "missing result_output tensor") failed

Is it possible to add an embedding option?

Owner

LostRuins commented Mar 7, 2025

Sorry, embedding models are not supported in koboldcpp at this time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment