docs/how_to/local_llms/

[giscus[bot]]

docs/how_to/local_llms/

Use case

https://python.langchain.com/docs/how_to/local_llms/

[NeuroinformaticaFBF]

Nice guide! However, I wonder if there's a way to use a generic LLM locally, and not just the ones reported in the guide here.

[majorli]

I found, to create an OllamaLLM, u must add a 'base_url' parameter. e.g., ``llm = OllamaLLM(model="llama3.1:8b", base_url="http://localhost:11434"), otherwise there will be a ConnectError: [WinError 10049] exception be thrown.