Cuda out of memory!! #415
Answered
by
mrhan1993
MohamedAziz-Khezami
asked this question in
Q&A
-
After multiple image generations and mask generations the free gpu memory keeps decreasing until i get cuda of memory error, is there a way to free memory after each request ?? @mrhan1993 |
Beta Was this translation helpful? Give feedback.
Answered by
mrhan1993
Feb 23, 2025
Replies: 2 comments 1 reply
-
I'll try to deal with this later |
Beta Was this translation helpful? Give feedback.
0 replies
-
I have added an Endpoint, |
Beta Was this translation helpful? Give feedback.
1 reply
Answer selected by
MohamedAziz-Khezami
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I have added an Endpoint,
/v1/engines/clean_vram
, which you can access to manually release VRAM usage