Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: RayDistributedStrategy doesn't propagate ingest errors correctly #445

Closed
micpst opened this issue Mar 24, 2025 · 0 comments · Fixed by #448
Closed

bug: RayDistributedStrategy doesn't propagate ingest errors correctly #445

micpst opened this issue Mar 24, 2025 · 0 comments · Fixed by #448
Assignees
Labels
bug Something isn't working
Milestone

Comments

@micpst
Copy link
Collaborator

micpst commented Mar 24, 2025

What happened?

Currently ingest steps return IngestDocumentResult which contains an error field that can store any exception from the task. Most of these exceptions can't be serialized properly, resulting in error during ingest and messing up the entire pipeline.

The solution would be to change the error field in IngestDocumentResult to store only the error type and add fields for error message and stack trace.

@micpst micpst added the bug Something isn't working label Mar 24, 2025
@micpst micpst added this to ragbits Mar 24, 2025
@micpst micpst moved this to Backlog in ragbits Mar 24, 2025
@micpst micpst self-assigned this Mar 24, 2025
@micpst micpst moved this from Backlog to Ready in ragbits Mar 24, 2025
@pawel-chmielak-deepsense pawel-chmielak-deepsense moved this from Ready to In Progress in ragbits Mar 24, 2025
@github-project-automation github-project-automation bot moved this from In Progress to Done in ragbits Mar 25, 2025
@mhordynski mhordynski added this to the Ragbits 1.0.0 milestone Mar 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

3 participants