Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP: storage definition for new table + unit tests for message processor #6888

Draft
wants to merge 9 commits into
base: master
Choose a base branch
from

Conversation

kylemumma
Copy link
Member

@kylemumma kylemumma commented Feb 15, 2025

- processor: UniqInSelectAndHavingProcessor
- processor: UUIDColumnProcessor
args:
columns: [transaction_id, trace_id, profile_id]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only trace_id exists here.

columns: [transaction_id, trace_id, profile_id]
- processor: HexIntColumnProcessor
args:
columns: [span_id, parent_span_id, segment_id]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't have a column we automatically want to process, you can remove this processor.

- processor: PrewhereProcessor
args:
prewhere_candidates:
[span_id, trace_id, segment_name]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only trace_id would be a good candidate for PREWHERE here.

Comment on lines +30 to +36
if let Some(headers) = payload.headers() {
if let Some(ingest_in_eap) = headers.get("ingest_in_eap") {
if ingest_in_eap == b"false" {
return Ok(InsertBatch::skip());
}
}
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We're going to ingest all spans, we can remove this.

Comment on lines +43 to +46
span.retention_days = Some(max(
enforce_retention(span.retention_days, &config.env_config),
30,
));
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We'll start ingesting the real retention, we can remove this as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants