Adding more resilitent defaults to ES client

[michalpristas]

Adding more resilient defaults to ES client
Comparing default with updated version

x	Default	Updated	comment
Retry on Status	502, 503, 504	429, 502, 503, 504	adding retries on backpressure TooManyRequests
Retry on error	fail always	Connection Refused and Reset	retry when waiting for ES to spin up or ES is restarting
Retry Backoff	none	exponential from 500ms up to 10s max	retries were immediate before
Max retries	3	5	to stay aligned with other products talking to ES like APM or Profiling

Fixes #3082

[mergify]

This pull request does not have a backport label. Could you fix it @michalpristas? 🙏
To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

• backport-./d./d is the label to automatically backport to the 8./d branch. /d is the digit
• backport-active-all is the label that automatically backports to all active branches.
• backport-active-8 is the label that automatically backports to all active minor branches for the 8 major.
• backport-active-9 is the label that automatically backports to all active minor branches for the 9 major.

[blakerouse]

@michalpristas Thanks for updating the code. Looks good. I will wait for green CI before approval.

[michalpristas]

failing on unrelated lint and failing cloud e2e that fails to be created across PRs

[swiatekm]

LGTM, but I'd like some more clarity on where we're getting the backoff values.

[michel-laterman]

lgth, could you fix the linter before merging?

[jlind23]

Requesting Blake's review as CI is now green.

[elastic-sonarqube]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
88.1% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube