Skip to content

add run_async for OllamaChatGenerator #1889

Open
@sjrl

Description

@sjrl

We should add a run_async implementation for OllamaChatGenerator since we have AsyncPipeline available.

It looks like ollama provides an async client in their library that we could use to accomplish this from ollama import AsyncClient

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions