Easy way to make llama_cpp.server available on local net? #353
Replies: 2 comments
-
see #315 set HOST='external IP of your OS' |
Beta Was this translation helpful? Give feedback.
0 replies
-
Great, Thanks! |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi, I am aware I can clone the repo and modify
llama_cpp/server/__main__.py
to changelocalhost
to0.0.0.0
, etc but as I would prefer not to do that and am usingpip install llama-cpp-python
to stay up to date with the package:What is the easiest way to make the llama-cpp API server available on the local net with out breaking the
pip install
method?Beta Was this translation helpful? Give feedback.
All reactions