[O11y][MySQL] Rally benchmark mysql.status

[ali786XI]

Proposed commit message

• This PR adds benchmarking templates to the status data stream of MySQL

Checklist

• I have reviewed tips for building integrations and this pull request is aligned with them.
• I have verified that all data streams collect metrics or logs.

How to test this PR locally

Run this command from package root

• elastic-package benchmark rally --benchmark status-benchmark -v

Related issues

• Relates [Rally] Add benchmarking templates to data streams for set of packages #8719

Screenshots

--- Benchmark results for package: mysql - START ---
╭───────────────────────────────────────────────────────────────────────────────────╮
│ info                                                                              │
├────────────────────────┬──────────────────────────────────────────────────────────┤
│ benchmark              │                                         status-benchmark │
│ description            │             Benchmark 20000 mysql.status events ingested │
│ run ID                 │                     9d9df1ae-7389-4db9-88ae-02a4be5e5d7c │
│ package                │                                                    mysql │
│ start ts (s)           │                                               1705042243 │
│ end ts (s)             │                                               1705042290 │
│ duration               │                                                      47s │
│ generated corpora file │ /root/.elastic-package/tmp/rally_corpus/corpus-971225849 │
╰────────────────────────┴──────────────────────────────────────────────────────────╯
╭──────────────────────────────────────────────────────────────────────╮
│ parameters                                                           │
├─────────────────────────────────┬────────────────────────────────────┤
│ package version                 │                             1.17.0 │
│ data_stream.name                │                             status │
│ corpora.generator.total_events  │                              20000 │
│ corpora.generator.template.path │ ./status-benchmark/template.ndjson │
│ corpora.generator.template.raw  │                                    │
│ corpora.generator.template.type │                             gotext │
│ corpora.generator.config.path   │      ./status-benchmark/config.yml │
│ corpora.generator.config.raw    │                              map[] │
│ corpora.generator.fields.path   │      ./status-benchmark/fields.yml │
│ corpora.generator.fields.raw    │                              map[] │
╰─────────────────────────────────┴────────────────────────────────────╯
╭───────────────────────╮
│ cluster info          │
├───────┬───────────────┤
│ name  │ elasticsearch │
│ nodes │             1 │
╰───────┴───────────────╯
╭───────────────────────────────────────╮
│ disk usage for index metrics-mysql.st │
│ atus-ep (for all fields)              │
├──────────────────────────────┬────────┤
│ total                        │  13 MB │
│ inverted_index.total         │ 622 kB │
│ inverted_index.stored_fields │ 7.8 MB │
│ inverted_index.doc_values    │ 3.1 MB │
│ inverted_index.points        │ 1.2 MB │
│ inverted_index.norms         │    0 B │
│ inverted_index.term_vectors  │    0 B │
│ inverted_index.knn_vectors   │    0 B │
╰──────────────────────────────┴────────╯
╭────────────────────────────────────────────────────────────────────────────────╮
│ pipeline metrics-mysql.status-1.17.0 stats in node rn5umXHcQbGcFUenBEgPwg      │
├────────────────────────────────────────┬───────────────────────────────────────┤
│ Totals                                 │ Count: 20000 | Failed: 0 | Time: 29ms │
│ pipeline (metrics-mysql.status@custom) │  Count: 20000 | Failed: 0 | Time: 9ms │
╰────────────────────────────────────────┴───────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ rally stats                                                                                 │
├────────────────────────────────────────────────────────────────┬────────────────────────────┤
│ Cumulative indexing time of primary shards                     │    0.29793333333333333 min │
│ Min cumulative indexing time across primary shards             │                      0 min │
│ Median cumulative indexing time across primary shards          │ 0.00016666666666666666 min │
│ Max cumulative indexing time across primary shards             │    0.29091666666666666 min │
│ Cumulative indexing throttle time of primary shards            │                      0 min │
│ Min cumulative indexing throttle time across primary shards    │                      0 min │
│ Median cumulative indexing throttle time across primary shards │                    0.0 min │
│ Max cumulative indexing throttle time across primary shards    │                      0 min │
│ Cumulative merge time of primary shards                        │                      0 min │
│ Cumulative merge count of primary shards                       │                          0 │
│ Min cumulative merge time across primary shards                │                      0 min │
│ Median cumulative merge time across primary shards             │                    0.0 min │
│ Max cumulative merge time across primary shards                │                      0 min │
│ Cumulative merge throttle time of primary shards               │                      0 min │
│ Min cumulative merge throttle time across primary shards       │                      0 min │
│ Median cumulative merge throttle time across primary shards    │                    0.0 min │
│ Max cumulative merge throttle time across primary shards       │                      0 min │
│ Cumulative refresh time of primary shards                      │                 0.0496 min │
│ Cumulative refresh count of primary shards                     │                        136 │
│ Min cumulative refresh time across primary shards              │                      0 min │
│ Median cumulative refresh time across primary shards           │  0.0005166666666666667 min │
│ Max cumulative refresh time across primary shards              │   0.032266666666666666 min │
│ Cumulative flush time of primary shards                        │   0.025066666666666668 min │
│ Cumulative flush count of primary shards                       │                         18 │
│ Min cumulative flush time across primary shards                │                      0 min │
│ Median cumulative flush time across primary shards             │  0.0004333333333333333 min │
│ Max cumulative flush time across primary shards                │   0.014533333333333334 min │
│ Total Young Gen GC time                                        │                    0.088 s │
│ Total Young Gen GC count                                       │                          4 │
│ Total Old Gen GC time                                          │                        0 s │
│ Total Old Gen GC count                                         │                          0 │
│ Store size                                                     │    0.026648799888789654 GB │
│ Translog size                                                  │    0.001351773738861084 GB │
│ Heap used for segments                                         │                       0 MB │
│ Heap used for doc values                                       │                       0 MB │
│ Heap used for terms                                            │                       0 MB │
│ Heap used for norms                                            │                       0 MB │
│ Heap used for points                                           │                       0 MB │
│ Heap used for stored fields                                    │                       0 MB │
│ Segment count                                                  │                         92 │
│ Total Ingest Pipeline count                                    │                      20056 │
│ Total Ingest Pipeline time                                     │                    2.433 s │
│ Total Ingest Pipeline failed                                   │                          0 │
│ Min Throughput                                                 │             1949.42 docs/s │
│ Mean Throughput                                                │             1949.42 docs/s │
│ Median Throughput                                              │             1949.42 docs/s │
│ Max Throughput                                                 │             1949.42 docs/s │
│ 50th percentile latency                                        │      1256.4597065065755 ms │
│ 100th percentile latency                                       │      2060.3482619917486 ms │
│ 50th percentile service time                                   │      1256.4597065065755 ms │
│ 100th percentile service time                                  │      2060.3482619917486 ms │
│ error rate                                                     │                     0.00 % │
╰────────────────────────────────────────────────────────────────┴────────────────────────────╯

--- Benchmark results for package: mysql - END   ---
Done

[elasticmachine]

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

[elasticmachine]

💚 Build Succeeded

• Buildkite Build
• Commit: a5b3ac4

History

• 💚 Build #8317 succeeded 53adbd6
• 💚 Build #8157 succeeded 988481a

cc @aliabbas-elastic

[elastic-sonarqube]

Quality Gate passed

Kudos, no new issues were introduced!

0 New issues
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube