[FEATURE] Batch multiple requests for the same flow function

[badmonster0]

What is the use case?
We can significantly improve the efficiency if we batch multiple requests for the same flow function, especially when they're using the same model using GPU.

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.