[scout] add dynamic ci pipeline to run tests

[dmlemeshko]

Summary

closes #211592

This PR improves the way we run scout tests by discovering all the plugins that have the scout tests and run tests in multiple workers:

How it works:

1. Run search script to find all existing scout playwright config files across kibana repo
2. Save results into scout_test_configs.json file, that will be used as source to run configs in individual jobs per plugin. Upload it as BK artifact.
3. Spin up job for each plugin mentioned in scout_test_configs.json
4. In each individual job use scout_test_configs.json and get configs for specific plugin.
   While running configs 1 by 1 collect command exit code with the following rules:

• configs run passed => exit code 0 , final status remains 0
• config has no tests => exit code 2, put config name into configsWithoutTests group to push BK annotation later, change exit status to 0 - we accept configs without tests at current stage
• config run fails => exit code 1, final status changed to 1 and job will fail in the end; put config name into failedConfigs group to push BK annotation later

[elasticmachine]

🤖 Jobs for this PR can be triggered through checkboxes. 🚧

ℹ️ To trigger the CI, please tick the checkbox below 👇

• Click to trigger kibana-pull-request for this PR!
• Click to trigger kibana-deploy-project-from-pr for this PR!
• Click to trigger kibana-deploy-cloud-from-pr for this PR!

[elasticmachine]

⏳ Build in-progress, with failures

• Buildkite Build
• Commit: a07ef75

Failed CI Steps

• FTR Configs #35
• FTR Configs #90
• Scout: [ platform / discover_enhanced-1 ] plugin
• Scout: [ platform / discover_enhanced-2 ] plugin
• Scout: [ platform / discover_enhanced-3 ] plugin
• Scout: [ platform / maps-1 ] plugin
• Scout: [ platform / maps-2 ] plugin
• Scout: [ platform / maps-3 ] plugin
• Scout: [ observability / observability_onboarding-1 ] plugin
• Scout: [ observability / observability_onboarding-2 ] plugin
• Scout: [ observability / observability_onboarding-3 ] plugin

Test Failures

• [job] [logs] FTR Configs #35 / discover/context_awareness extension getAdditionalCellActions data view mode should render additional cell actions for logs data source
• [job] [logs] FTR Configs #90 / InfraOps App Metrics UI Node Details #Asset Type: host Osquery Tab should not show a date picker

History

• 💔 Build #281245 failed 531582f
• 💔 Build #281237 failed 4ec8548
• 💔 Build #281228 failed ce06e2a
• 💔 Build #281209 failed 258a483