Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: integrate opik framework #341

Open
kdziedzic68 opened this issue Feb 11, 2025 · 0 comments
Open

feat: integrate opik framework #341

kdziedzic68 opened this issue Feb 11, 2025 · 0 comments
Assignees
@kdziedzic68
Labels
feature New feature or request

Comments

@kdziedzic68
Copy link
Collaborator

Feature description

https://github.com/comet-ml/opik

the integration should be done on level of:

  1. ragbits audit - monitoring performance on production
  2. ragbits evaluate - experimenting and / or auto-optimization

Motivation

We would like to monitor and evaluate LLM metrics.

Additional context

No response
@kdziedzic68 kdziedzic68 added the feature New feature or request label Feb 11, 2025
@kdziedzic68 kdziedzic68 moved this to Backlog in ragbits Feb 11, 2025
@mhordynski mhordynski moved this from Backlog to Ready in ragbits Feb 11, 2025
@mhordynski mhordynski moved this from Ready to Backlog in ragbits Feb 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kdziedzic68 kdziedzic68

Labels
feature New feature or request
Projects
ragbits
Status: Backlog
Milestone
No milestone
Development

No branches or pull requests
1 participant
@kdziedzic68