Cuda out of memory!! #415
-
|
After multiple image generations and mask generations the free gpu memory keeps decreasing until i get cuda of memory error, is there a way to free memory after each request ?? @mrhan1993 |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 1 reply
-
|
I'll try to deal with this later |
Beta Was this translation helpful? Give feedback.
-
|
I have added an Endpoint, |
Beta Was this translation helpful? Give feedback.
-
|
Thank you so much, you are a life saver ❤️ |
Beta Was this translation helpful? Give feedback.
I have added an Endpoint,
/v1/engines/clean_vram, which you can access to manually release VRAM usage