Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove more gossipsub duplicate warnings #5197

Closed
michaelsproul opened this issue Feb 5, 2024 · 1 comment
Closed

Remove more gossipsub duplicate warnings #5197

michaelsproul opened this issue Feb 5, 2024 · 1 comment

Comments

@michaelsproul
Copy link
Member

Description

This PR #5163 removes some warnings, but doesn't cover this case:

WARN Gossip message publish failed on retry error: Duplicate, topic: beacon_attestation, service: libp2p

Relevant code is here:

match self
.swarm
.behaviour_mut()
.gossipsub
.publish(Topic::from(topic.clone()), data)
{
Ok(_) => {
warn!(self.log, "Gossip message published on retry"; "topic" => topic_str);
if let Some(v) = metrics::get_int_counter(
&metrics::GOSSIP_LATE_PUBLISH_PER_TOPIC_KIND,
&[topic_str],
) {
v.inc()
};
}
Err(e) => {
warn!(self.log, "Gossip message publish failed on retry"; "topic" => topic_str, "error" => %e);
if let Some(v) = metrics::get_int_counter(
&metrics::GOSSIP_FAILED_LATE_PUBLISH_PER_TOPIC_KIND,
&[topic_str],
) {
v.inc()
};
}

There are 3 cases, and I think we should warn in at most 2 of them:

  • Message published successfully on retry: warn? because it was probably published late? no warn? because these logs are annoying af?
  • Message failed to publish because it was a duplicate: no warn.
  • Message failed to pubish at all: warn.

Version

Lighthouse v4.6.0

Additional Info

The Gossip message publish failed on retry is much more common on our infra, with 50M occurrences in the last month across our infra. By comparion, Gossip message published on retry has only 27k occurrences, it seems mostly after a node restarting.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants