Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Obs AI Assistant] fix flaky test and add back test in settings #213196

Merged
merged 4 commits into from
Mar 5, 2025

Conversation

neptunian
Copy link
Contributor

@neptunian neptunian commented Mar 5, 2025

Summary

Closes #191707

Summarize your PR. If it involves visual changes include a screenshot or gif.

@neptunian neptunian added release_note:skip Skip the PR/issue when compiling release notes backport:version Backport to applied version labels v8.19.0 v9.1.0 Team:Obs AI Assistant Observability AI Assistant labels Mar 5, 2025
@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#7979

[✅] x-pack/test/observability_ai_assistant_functional/enterprise/config.ts: 25/25 tests passed.

see run history

@neptunian neptunian added backport:all-open Backport to all branches that could still receive a release and removed backport:version Backport to applied version labels v9.1.0 v8.19.0 labels Mar 5, 2025
@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#7980

[✅] x-pack/test/observability_ai_assistant_functional/enterprise/config.ts: 100/100 tests passed.

see run history

@neptunian neptunian marked this pull request as ready for review March 5, 2025 09:29
@neptunian neptunian requested a review from a team as a code owner March 5, 2025 09:29
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ai-assistant (Team:Obs AI Assistant)

@botelastic botelastic bot added the ci:project-deploy-observability Create an Observability project label Mar 5, 2025
Copy link
Contributor

github-actions bot commented Mar 5, 2025

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
  • run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

…e_controls/settings_security.spec.ts

Co-authored-by: Søren Louv-Jansen <sorenlouv@gmail.com>
@elasticmachine
Copy link
Contributor

elasticmachine commented Mar 5, 2025

💔 Build Failed

Failed CI Steps

History

await searchConnectorIndexPatternInput.clearValue();
await searchConnectorIndexPatternInput.type('test');

await interceptRequest({ driver: driver.driver, pattern: '*kibana\\/settings*' }, (responseFactory) => {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You'll also need to update interceptRequest

Copy link
Contributor Author

@neptunian neptunian Mar 5, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, I've reverted the change for now. I'm going to open up a separate PR for this. I'm going to remove our version and use the one added to the browser service, which date_usage plugin also uses. I'll update the other parts of our code to use it as well and implement the changes you suggested.

…s/feature_controls/settings_security.spec.ts"

This reverts commit c629446.
@neptunian neptunian merged commit bccbb93 into elastic:main Mar 5, 2025
9 checks passed
@kibanamachine
Copy link
Contributor

Starting backport for target branches: 7.17, 8.16, 8.17, 8.18, 8.x, 9.0

https://github.com/elastic/kibana/actions/runs/13681066304

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Mar 5, 2025
…tic#213196)

## Summary

Closes elastic#191707

Summarize your PR. If it involves visual changes include a screenshot or
gif.

- Fixes flaky test`allows updating of an advanced setting` by making
sure to wait for page refresh
- Adds back test to check for toast on error
elastic#191531

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Søren Louv-Jansen <sorenlouv@gmail.com>
(cherry picked from commit bccbb93)
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Mar 5, 2025
…tic#213196)

## Summary

Closes elastic#191707

Summarize your PR. If it involves visual changes include a screenshot or
gif.

- Fixes flaky test`allows updating of an advanced setting` by making
sure to wait for page refresh
- Adds back test to check for toast on error
elastic#191531

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Søren Louv-Jansen <sorenlouv@gmail.com>
(cherry picked from commit bccbb93)
@kibanamachine
Copy link
Contributor

💔 Some backports could not be created

Status Branch Result
7.17 Backport failed because of merge conflicts
8.16
8.17 Backport failed because of merge conflicts
8.18 Backport failed because of merge conflicts
8.x Backport failed because of merge conflicts
9.0

Note: Successful backport PRs will be merged automatically after passing CI.

Manual backport

To create the backport manually run:

node scripts/backport --pr 213196

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Mar 5, 2025
#213196) (#213271)

# Backport

This will backport the following commits from `main` to `8.16`:
- [[Obs AI Assistant] fix flaky test and add back test in settings
(#213196)](#213196)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Sandra
G","email":"neptunian@users.noreply.github.com"},"sourceCommit":{"committedDate":"2025-03-05T16:46:02Z","message":"[Obs
AI Assistant] fix flaky test and add back test in settings
(#213196)\n\n## Summary\n\nCloses
https://github.com/elastic/kibana/issues/191707\n\nSummarize your PR. If
it involves visual changes include a screenshot or\ngif.\n\n- Fixes
flaky test`allows updating of an advanced setting` by making\nsure to
wait for page refresh\n- Adds back test to check for toast on
error\nhttps://github.com//pull/191531\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>\nCo-authored-by: Søren
Louv-Jansen
<sorenlouv@gmail.com>","sha":"bccbb933c0e2dea4c4d23c7174bbe0be638db252","branchLabelMapping":{"^v9.1.0$":"main","^v8.19.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:all-open","Team:Obs
AI Assistant","ci:project-deploy-observability","v9.1.0"],"title":"[Obs
AI Assistant] fix flaky test and add back test in
settings","number":213196,"url":"https://github.com/elastic/kibana/pull/213196","mergeCommit":{"message":"[Obs
AI Assistant] fix flaky test and add back test in settings
(#213196)\n\n## Summary\n\nCloses
https://github.com/elastic/kibana/issues/191707\n\nSummarize your PR. If
it involves visual changes include a screenshot or\ngif.\n\n- Fixes
flaky test`allows updating of an advanced setting` by making\nsure to
wait for page refresh\n- Adds back test to check for toast on
error\nhttps://github.com//pull/191531\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>\nCo-authored-by: Søren
Louv-Jansen
<sorenlouv@gmail.com>","sha":"bccbb933c0e2dea4c4d23c7174bbe0be638db252"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.1.0","branchLabelMappingKey":"^v9.1.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/213196","number":213196,"mergeCommit":{"message":"[Obs
AI Assistant] fix flaky test and add back test in settings
(#213196)\n\n## Summary\n\nCloses
https://github.com/elastic/kibana/issues/191707\n\nSummarize your PR. If
it involves visual changes include a screenshot or\ngif.\n\n- Fixes
flaky test`allows updating of an advanced setting` by making\nsure to
wait for page refresh\n- Adds back test to check for toast on
error\nhttps://github.com//pull/191531\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>\nCo-authored-by: Søren
Louv-Jansen
<sorenlouv@gmail.com>","sha":"bccbb933c0e2dea4c4d23c7174bbe0be638db252"}}]}]
BACKPORT-->

Co-authored-by: Sandra G <neptunian@users.noreply.github.com>
@neptunian
Copy link
Contributor Author

💚 All backports created successfully

Status Branch Result
8.x

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

@neptunian
Copy link
Contributor Author

💚 All backports created successfully

Status Branch Result
8.18

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

neptunian added a commit to neptunian/kibana that referenced this pull request Mar 6, 2025
…tic#213196)

## Summary

Closes elastic#191707

Summarize your PR. If it involves visual changes include a screenshot or
gif.

- Fixes flaky test`allows updating of an advanced setting` by making
sure to wait for page refresh
- Adds back test to check for toast on error
elastic#191531

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Søren Louv-Jansen <sorenlouv@gmail.com>
(cherry picked from commit bccbb93)

# Conflicts:
#	x-pack/test/observability_ai_assistant_functional/tests/feature_controls/settings_security.spec.ts
neptunian added a commit to neptunian/kibana that referenced this pull request Mar 6, 2025
…tic#213196)

## Summary

Closes elastic#191707

Summarize your PR. If it involves visual changes include a screenshot or
gif.

- Fixes flaky test`allows updating of an advanced setting` by making
sure to wait for page refresh
- Adds back test to check for toast on error
elastic#191531

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Søren Louv-Jansen <sorenlouv@gmail.com>
(cherry picked from commit bccbb93)

# Conflicts:
#	x-pack/test/observability_ai_assistant_functional/tests/feature_controls/settings_security.spec.ts
@neptunian
Copy link
Contributor Author

💚 All backports created successfully

Status Branch Result
8.17

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

neptunian added a commit to neptunian/kibana that referenced this pull request Mar 6, 2025
…tic#213196)

## Summary

Closes elastic#191707

Summarize your PR. If it involves visual changes include a screenshot or
gif.

- Fixes flaky test`allows updating of an advanced setting` by making
sure to wait for page refresh
- Adds back test to check for toast on error
elastic#191531

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Søren Louv-Jansen <sorenlouv@gmail.com>
(cherry picked from commit bccbb93)

# Conflicts:
#	x-pack/test/observability_ai_assistant_functional/tests/feature_controls/settings_security.spec.ts
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:all-open Backport to all branches that could still receive a release ci:project-deploy-observability Create an Observability project release_note:skip Skip the PR/issue when compiling release notes Team:Obs AI Assistant Observability AI Assistant v8.16.6 v9.1.0
Projects
None yet
4 participants