Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: X-Pack Cloud Security Posture Functional Tests.x-pack/test/cloud_security_posture_functional/pages/findings_onboarding·ts - Cloud Security Posture Findings Page onboarding Vulnerabilities - clicking on the No integrations installed prompt action button - install CNVM: navigates to the CNVM integration installation page #197143

Closed
kibanamachine opened this issue Oct 21, 2024 · 10 comments
Closed

Failing test: X-Pack Cloud Security Posture Functional Tests.x-pack/test/cloud_security_posture_functional/pages/findings_onboarding·ts - Cloud Security Posture Findings Page onboarding Vulnerabilities - clicking on the No integrations installed prompt action button - install CNVM: navigates to the CNVM integration installation page #197143

kibanamachine opened this issue Oct 21, 2024 · 10 comments
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Cloud Security Cloud Security team related

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Oct 21, 2024 •
edited
Loading

A test failed on a tracked branch

Error: retry.try reached timeout 120000 ms
Error: retry.try reached timeout 120000 ms
TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="cnvm-not-installed-action"])
Wait timed out after 10038ms
    at /opt/buildkite-agent/builds/bk-agent-prod-gcp-1729543759396162198/elastic/kibana-on-merge/kibana/node_modules/selenium-webdriver/lib/webdriver.js:923:22
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at onFailure (retry_for_success.ts:18:9)
    at retryForSuccess (retry_for_success.ts:85:7)
    at RetryService.try (retry.ts:52:12)
    at Proxy.clickByCssSelector (find.ts:420:5)
    at TestSubjects.click (test_subjects.ts:169:5)
    at findings_page.ts:114:9
    at runAttempt (retry_for_success.ts:30:15)
    at retryForSuccess (retry_for_success.ts:99:21)
    at RetryService.try (retry.ts:52:12)
    at Object.navigateToAction (findings_page.ts:113:14)
    at Context.<anonymous> (findings_onboarding.ts:41:7)
    at Object.apply (wrap_function.js:74:16)
    at onFailure (retry_for_success.ts:18:9)
    at retryForSuccess (retry_for_success.ts:85:7)
    at RetryService.try (retry.ts:52:12)
    at Object.navigateToAction (findings_page.ts:113:14)
    at Context.<anonymous> (findings_onboarding.ts:41:7)
    at Object.apply (wrap_function.js:74:16)

First failure: kibana-on-merge - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Oct 21, 2024
@botelastic botelastic bot added the needs-team Issues missing a team label label Oct 21, 2024
@kibanamachine kibanamachine added the Team:Cloud Security Cloud Security team related label Oct 21, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-cloud-security-posture (Team:Cloud Security)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Oct 21, 2024
@maxcold
Copy link
Contributor

maxcold commented Oct 22, 2024

Navigation happened according to the screenshot, also 50 runs of the flaky test runner were successful, closing as intermittent flakiness

@maxcold maxcold closed this as completed Oct 22, 2024
@kibanamachine kibanamachine reopened this Dec 16, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@alexreal1314 alexreal1314 mentioned this issue Jan 28, 2025
Merged
2 tasks
alexreal1314 added a commit that referenced this issue Jan 30, 2025
@alexreal1314
[Cloud Security] 10973 migrate flaky e2e tests to jest (#208345)
cd9096c 
## Summary

This PR tries to fix the following issues - which are flaky FTR tests:

- #197143 - convert to unit test
- #190967 - fixed
- #187470 - fixed
- #186302 - convert to unit test
- #186438 - convert to unit test


There will be an RFC document which is going to be released to help us
better understand and decide which tests are more suitable to make as
E2E tests and which as unit tests.

### Checklist
- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

### Closes
this PR closes the above mentioned issues in relation for this ticket -
elastic/security-team#10973
@alexreal1314
Copy link
Contributor

closed by #208345

@kibanamachine kibanamachine reopened this Feb 4, 2025
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - 8.18

This was referenced Feb 12, 2025
Merged
Merged
Merged
alexreal1314 added a commit that referenced this issue Feb 12, 2025
@alexreal1314
[8.16] [Cloud Security] skip flaky tests (#197143) (#190967) (#210736)
d507b63 
# Backport

This will skip the following tests in version `8.16`:
 - (#197143)
 - #190967

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)
alexreal1314 added a commit that referenced this issue Feb 12, 2025
@alexreal1314
[8.18] [Cloud Security] skip flaky tests (#197143) (#190967) (#210743)
a5891a1 
# Backport

This will skip the following tests in version `8.18`:
 - (#197143)
 - #190967

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)
alexreal1314 added a commit that referenced this issue Feb 13, 2025
@alexreal1314
[8.17] [Cloud Security] skip flaky tests (#197143) (#190967) (#210741)
bd4b57d 
# Backport

This will skip the following tests in version `8.17`:
 - (#197143)
 - #190967

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)
@alexreal1314
Copy link
Contributor

alexreal1314 commented Feb 13, 2025 •
edited
Loading

closed by #210743

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Cloud Security Cloud Security team related
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@maxcold @elasticmachine @alexreal1314 @kibanamachine