Skip to content

[FEATURE] Support for passing the PoolingHttpClientConnectionManager as a dependency #332

Open
@stikkireddy

Description

@stikkireddy

Problem Statement
For model serving with optimized routes we need to be able to send significantly larger volume of concurrent requests. it would be great to be able to control the pooling config.

Proposed Solution
Pass the pooling config as part of the setting the databricks config.

Additional Context
Alternative is to maintain a custom http client implementation with custom pooling manager configurations.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions