We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
When the model is closed or Python exits, it should clean up resources quietly.
When using Llama(...), a crash occurs on exit:
TypeError: 'NoneType' object is not callable
This happens inside __del__() when it tries to close internal objects (e.g., ExitStack or model context) that are already None.
__del__()
None
Llama(...)
Llama(model_path=..., ...)
Wrap close() call in __del__() like so:
close()
def __del__(self): try: self.close() except Exception: pass
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Prerequisites
Expected Behavior
When the model is closed or Python exits, it should clean up resources quietly.
Current Behavior
When using Llama(...), a crash occurs on exit:
TypeError: 'NoneType' object is not callable
This happens inside
__del__()
when it tries to close internal objects (e.g., ExitStack or model context) that are alreadyNone
.Environment and Context
Llama(...)
Steps to Reproduce
Llama(model_path=..., ...)
Recommended Fix
Wrap
close()
call in__del__()
like so:The text was updated successfully, but these errors were encountered: