-
-
Notifications
You must be signed in to change notification settings - Fork 62
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
WIP: storage definition for new table + unit tests for message processor #6888
base: master
Are you sure you want to change the base?
Conversation
- processor: UniqInSelectAndHavingProcessor | ||
- processor: UUIDColumnProcessor | ||
args: | ||
columns: [transaction_id, trace_id, profile_id] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Only trace_id
exists here.
columns: [transaction_id, trace_id, profile_id] | ||
- processor: HexIntColumnProcessor | ||
args: | ||
columns: [span_id, parent_span_id, segment_id] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We don't have a column we automatically want to process, you can remove this processor.
- processor: PrewhereProcessor | ||
args: | ||
prewhere_candidates: | ||
[span_id, trace_id, segment_name] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Only trace_id
would be a good candidate for PREWHERE
here.
if let Some(headers) = payload.headers() { | ||
if let Some(ingest_in_eap) = headers.get("ingest_in_eap") { | ||
if ingest_in_eap == b"false" { | ||
return Ok(InsertBatch::skip()); | ||
} | ||
} | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We're going to ingest all spans, we can remove this.
span.retention_days = Some(max( | ||
enforce_retention(span.retention_days, &config.env_config), | ||
30, | ||
)); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We'll start ingesting the real retention, we can remove this as well.
Resolves https://github.com/getsentry/eap-planning/issues/189