Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] kotaemon fails to run local - cloud API copromises privacy and confidentiality #674

Open
iopenet opened this issue Feb 23, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@iopenet
Copy link

iopenet commented Feb 23, 2025

Description

Kotaemon fails to run any Local LLM
and this compromises confidentiality and privacy by only prioritizing "cloud APIs" out-of-the box.

Any proprietary remote backend makes it untrustworthy by default.
The only trustworthy AI solution for an individual or business is 100% local.

  1. Cloud storage may not be as private as you think, as many cloud providers have the technical capability to access your files and data
  2. Attackers can exploit vulnerabilities in APIs to access sensitive data, such as personal information, financial details, and login credentials — potentially resulting in identity theft, fraud, and other cybercrimes.

Reproduction steps

✅ CPU/GPU
✅ Default install kotaemon (python)
✅ Download and run gui
✅ Upload file txt 
❌ Fail with any local LLM 
❌ Fail with any local embeddings
❌ Fail .env with local path 
❌ Fail to update LLM
❌ Fail to provide safe alternative

Tested on Win10/WSL/VM running other Apps/LLM

Screenshots

![DESCRIPTION](LINK.png)

Logs

Browsers

No response

OS

No response

Additional information

No response

@iopenet iopenet added the bug Something isn't working label Feb 23, 2025
@Luap2003
Copy link

Can you give more information?
Because in the Resources Section under LLMs and Embeddings you can select Ollama and therefore locally run your models,

In your Reproduction steps you didn't mention installing or setting up Ollama, that would be a necessary step, to be able to run llms locally.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants