ctx mem_size #2130
Unanswered
desaiIshan00
asked this question in
Q&A
ctx mem_size
#2130
Replies: 1 comment
-
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I'm trying to build a personal AI voice assistant using GPT-2. When I run the command ./talk -p santa, it gives this error:
"gpt2_model_load: ggml ctx size = 384.74 MB ggml_new_object: not enough space in the context's memory pool (needed 403447760, available 403425792) Segmentation fault"
I've tried increasing the mem_size in the ggml.c file, but that's not working. How can I solve this? Thank you.
Beta Was this translation helpful? Give feedback.
All reactions