Skip to content

Reposition query handlers #500

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
badmonster0 opened this issue May 16, 2025 · 0 comments
Open

Reposition query handlers #500

badmonster0 opened this issue May 16, 2025 · 0 comments
Assignees
Labels
cocoindex-core CocoIndex Core Engine enhancement New feature or request python-sdk CocoIndex Python SDK

Comments

@badmonster0
Copy link
Member

badmonster0 commented May 16, 2025

CocoIndex, as a framework focusing on indexing / preparing data to be used for queries, also provides light query handlers (example) for pragmatic reasons.
The current query handler in cocoindex serves a mixed of purpose:

  1. Provide a shortcut to build examples of querying indexes built by CocoIndex.
  2. Reuse part of the logic between indexing and query (e.g. compute indexing).
  3. Provide an interface for tools like CocoInsight to query the index, for evaluation / debugging purpose.

However, CocoIndex is not limited to a single storage target - besides Postgres, it started to supports Qdrant and Neo4j, and is going to support more and more. Different targets have quite different capabilities regarding query. This approach is not going to scale well.

From now on, we want to encourage users to directly query the target storage using existing solutions in the eco-system (db drivers, ORM, etc.) which is usually not difficult, which provides maximum flexibility. We'll provide bridges for purpose of 2 and 3, allowing users to directly invoke part of the flow logic, and expose custom query functions.

@badmonster0 badmonster0 added the enhancement New feature or request label May 16, 2025
@badmonster0 badmonster0 added cocoindex-core CocoIndex Core Engine python-sdk CocoIndex Python SDK labels May 16, 2025
@badmonster0 badmonster0 moved this to 🚀 In Progress in 🐳 CocoIndex Roadmap May 16, 2025
@badmonster0 badmonster0 self-assigned this May 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cocoindex-core CocoIndex Core Engine enhancement New feature or request python-sdk CocoIndex Python SDK
Projects
Status: 🚀 In Progress
Development

No branches or pull requests

1 participant