Skip to content

[FEAT]: Chat ID available for agent skills and flows #3604

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Filaton opened this issue Apr 7, 2025 · 3 comments
Open

[FEAT]: Chat ID available for agent skills and flows #3604

Filaton opened this issue Apr 7, 2025 · 3 comments
Labels
enhancement New feature or request feature request

Comments

@Filaton
Copy link

Filaton commented Apr 7, 2025

What would you like to see?

For my API use by an agent I wanted to add some caching logic and other stuff, that needs to get the information in which chat it is right now, so like a unique chat/user id. But to send this to my API I need to have access to something like this in the agent skill and flows, for example that I can send it in the headers etc. This would improve the usability of agents massively for use cases like this, where a chat context is alo important for apis my agent is using.

@Filaton Filaton added enhancement New feature or request feature request labels Apr 7, 2025
@timothycarambat
Copy link
Member

This sounds like something better suited for a custom fork of AnythingLLM. Until the chat is completed we would not yet have its known database ID. Kind of like a post-chat webhook is what this sounds like to where on each agent chat conclusion, an endpoint could be hit to forward this information.

Am i understanding this correctly?

@Filaton
Copy link
Author

Filaton commented Apr 8, 2025

I was thinking more of a variable or more generally speaking metadata, which can be accessed in existing API calls in the agent flows/skills (before the real LLM request is started), like having information about the workspace and thread and maybe also the user from which the request is coming available for API calls. For example if I want to do an API call to my own service, I want the service to know from which chat the request is coming. With this I could cache data which normally would be retrieved in a resource-intensive process or do monitoring chat wise etc.

I'm not sure if this would be better of in a custom fork, because I see quite a few scenarios where this could be important information for external, but mainly self written APIs/services I want to call.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request feature request
Projects
None yet
Development

No branches or pull requests

3 participants
@timothycarambat @Filaton and others