Skip to content

chore: Update Playwright to v1.51 #4049

chore: Update Playwright to v1.51

chore: Update Playwright to v1.51 #4049

Triggered via pull request February 24, 2025 20:37
Status Failure
Total duration 22m 5s
Artifacts 10

e2e.yml

on: pull_request
Matrix: e2e-tests
Fit to window
Zoom out
Zoom in

Annotations

15 errors, 1 warning, and 1 notice
e2e-tests (webkit-2-2)
Process completed with exit code 1.
e2e-tests (webkit-1-2)
Process completed with exit code 1.
e2e-tests (firefox-1-1)
Process completed with exit code 1.
e2e-tests (chromium-1-1)
Process completed with exit code 1.
e2e-results
Process completed with exit code 1.
[chromium] › ../../../../../work/tests/context-menu.spec.ts:34:5 › toggle column visibility: ../../../../../work/tests/context-menu.spec.ts#L40
1) [chromium] › ../../../../../work/tests/context-menu.spec.ts:34:5 › toggle column visibility ─── Error: expect(locator).toHaveScreenshot(expected) 148 pixels (ratio 0.01 of all image pixels) are different. Expected: /work/tests/context-menu.spec.ts-snapshots/toggle-column-visibility-1-chromium-linux.png Received: /work/test-results/context-menu-toggle-column-visibility-chromium/toggle-column-visibility-1-actual.png Diff: /work/test-results/context-menu-toggle-column-visibility-chromium/toggle-column-visibility-1-diff.png Call log: - expect.toHaveScreenshot with timeout 15000ms - verifying given screenshot expectation - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 148 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 148 pixels (ratio 0.01 of all image pixels) are different. 38 | 39 | await page.getByRole('button', { name: 'Hide Column' }).click(); > 40 | await expect(page.locator('.iris-grid-column')).toHaveScreenshot(); | ^ 41 | 42 | await page 43 | .locator('.iris-grid .grid-wrapper') at /work/tests/context-menu.spec.ts:40:51
[chromium] › ../../../../../work/tests/context-menu.spec.ts:34:5 › toggle column visibility: ../../../../../work/tests/context-menu.spec.ts#L40
1) [chromium] › ../../../../../work/tests/context-menu.spec.ts:34:5 › toggle column visibility ─── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 148 pixels (ratio 0.01 of all image pixels) are different. Expected: /work/tests/context-menu.spec.ts-snapshots/toggle-column-visibility-1-chromium-linux.png Received: /work/test-results/context-menu-toggle-column-visibility-chromium-retry1/toggle-column-visibility-1-actual.png Diff: /work/test-results/context-menu-toggle-column-visibility-chromium-retry1/toggle-column-visibility-1-diff.png Call log: - expect.toHaveScreenshot with timeout 15000ms - verifying given screenshot expectation - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 148 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 148 pixels (ratio 0.01 of all image pixels) are different. 38 | 39 | await page.getByRole('button', { name: 'Hide Column' }).click(); > 40 | await expect(page.locator('.iris-grid-column')).toHaveScreenshot(); | ^ 41 | 42 | await page 43 | .locator('.iris-grid .grid-wrapper') at /work/tests/context-menu.spec.ts:40:51
[chromium] › ../../../../../work/tests/context-menu.spec.ts:50:5 › quick filter and clear: ../../../../../work/tests/context-menu.spec.ts#L59
2) [chromium] › ../../../../../work/tests/context-menu.spec.ts:50:5 › quick filter and clear ───── Error: expect(locator).toHaveScreenshot(expected) 208 pixels (ratio 0.01 of all image pixels) are different. Expected: /work/tests/context-menu.spec.ts-snapshots/quick-filter-and-clear-1-chromium-linux.png Received: /work/test-results/context-menu-quick-filter-and-clear-chromium/quick-filter-and-clear-1-actual.png Diff: /work/test-results/context-menu-quick-filter-and-clear-chromium/quick-filter-and-clear-1-diff.png Call log: - expect.toHaveScreenshot with timeout 15000ms - verifying given screenshot expectation - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 16195 pixels (ratio 0.05 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 16865 pixels (ratio 0.05 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 208 pixels (ratio 0.01 of all image pixels) are different. 57 | 58 | await waitForLoadingDone(page); > 59 | await expect(page.locator('.iris-grid-column')).toHaveScreenshot(); | ^ 60 | 61 | await page 62 | .locator('.iris-grid .grid-wrapper') at /work/tests/context-menu.spec.ts:59:51
[chromium] › ../../../../../work/tests/context-menu.spec.ts:50:5 › quick filter and clear: ../../../../../work/tests/context-menu.spec.ts#L59
2) [chromium] › ../../../../../work/tests/context-menu.spec.ts:50:5 › quick filter and clear ───── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 208 pixels (ratio 0.01 of all image pixels) are different. Expected: /work/tests/context-menu.spec.ts-snapshots/quick-filter-and-clear-1-chromium-linux.png Received: /work/test-results/context-menu-quick-filter-and-clear-chromium-retry1/quick-filter-and-clear-1-actual.png Diff: /work/test-results/context-menu-quick-filter-and-clear-chromium-retry1/quick-filter-and-clear-1-diff.png Call log: - expect.toHaveScreenshot with timeout 15000ms - verifying given screenshot expectation - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 16195 pixels (ratio 0.05 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 16865 pixels (ratio 0.05 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 208 pixels (ratio 0.01 of all image pixels) are different. 57 | 58 | await waitForLoadingDone(page); > 59 | await expect(page.locator('.iris-grid-column')).toHaveScreenshot(); | ^ 60 | 61 | await page 62 | .locator('.iris-grid .grid-wrapper') at /work/tests/context-menu.spec.ts:59:51
[chromium] › ../../../../../work/tests/context-menu.spec.ts:76:5 › advanced filters: ../../../../../work/tests/context-menu.spec.ts#L83
3) [chromium] › ../../../../../work/tests/context-menu.spec.ts:76:5 › advanced filters ─────────── Error: expect(locator).toHaveScreenshot(expected) 802 pixels (ratio 0.01 of all image pixels) are different. Expected: /work/tests/context-menu.spec.ts-snapshots/advanced-filters-1-chromium-linux.png Received: /work/test-results/context-menu-advanced-filters-chromium/advanced-filters-1-actual.png Diff: /work/test-results/context-menu-advanced-filters-chromium/advanced-filters-1-diff.png Call log: - expect.toHaveScreenshot with timeout 15000ms - verifying given screenshot expectation - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 802 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 802 pixels (ratio 0.01 of all image pixels) are different. 81 | await waitForLoadingDone(page); 82 | await moveMouseAwayFromTable(page); > 83 | await expect(page.locator('.iris-grid-column')).toHaveScreenshot(); | ^ 84 | 85 | await openAdvancedFilters(page); 86 | await page.getByLabel('Sort String Descending').click(); at /work/tests/context-menu.spec.ts:83:51
[chromium] › ../../../../../work/tests/context-menu.spec.ts:76:5 › advanced filters: ../../../../../work/tests/context-menu.spec.ts#L83
3) [chromium] › ../../../../../work/tests/context-menu.spec.ts:76:5 › advanced filters ─────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 802 pixels (ratio 0.01 of all image pixels) are different. Expected: /work/tests/context-menu.spec.ts-snapshots/advanced-filters-1-chromium-linux.png Received: /work/test-results/context-menu-advanced-filters-chromium-retry1/advanced-filters-1-actual.png Diff: /work/test-results/context-menu-advanced-filters-chromium-retry1/advanced-filters-1-diff.png Call log: - expect.toHaveScreenshot with timeout 15000ms - verifying given screenshot expectation - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 802 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 802 pixels (ratio 0.01 of all image pixels) are different. 81 | await waitForLoadingDone(page); 82 | await moveMouseAwayFromTable(page); > 83 | await expect(page.locator('.iris-grid-column')).toHaveScreenshot(); | ^ 84 | 85 | await openAdvancedFilters(page); 86 | await page.getByLabel('Sort String Descending').click(); at /work/tests/context-menu.spec.ts:83:51
[chromium] › ../../../../../work/tests/context-menu.spec.ts:127:5 › sort by: ../../../../../work/tests/context-menu.spec.ts#L137
4) [chromium] › ../../../../../work/tests/context-menu.spec.ts:127:5 › sort by ─────────────────── Error: expect(locator).toHaveScreenshot(expected) 802 pixels (ratio 0.01 of all image pixels) are different. Expected: /work/tests/context-menu.spec.ts-snapshots/sort-by-1-chromium-linux.png Received: /work/test-results/context-menu-sort-by-chromium/sort-by-1-actual.png Diff: /work/test-results/context-menu-sort-by-chromium/sort-by-1-diff.png Call log: - expect.toHaveScreenshot with timeout 15000ms - verifying given screenshot expectation - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 802 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 802 pixels (ratio 0.01 of all image pixels) are different. 135 | 136 | await waitForLoadingDone(page); > 137 | await expect(page.locator('.iris-grid-column')).toHaveScreenshot(); | ^ 138 | 139 | await page 140 | .locator('.iris-grid .grid-wrapper') at /work/tests/context-menu.spec.ts:137:51
[chromium] › ../../../../../work/tests/context-menu.spec.ts:127:5 › sort by: ../../../../../work/tests/context-menu.spec.ts#L137
4) [chromium] › ../../../../../work/tests/context-menu.spec.ts:127:5 › sort by ─────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 802 pixels (ratio 0.01 of all image pixels) are different. Expected: /work/tests/context-menu.spec.ts-snapshots/sort-by-1-chromium-linux.png Received: /work/test-results/context-menu-sort-by-chromium-retry1/sort-by-1-actual.png Diff: /work/test-results/context-menu-sort-by-chromium-retry1/sort-by-1-diff.png Call log: - expect.toHaveScreenshot with timeout 15000ms - verifying given screenshot expectation - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 802 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 802 pixels (ratio 0.01 of all image pixels) are different. 135 | 136 | await waitForLoadingDone(page); > 137 | await expect(page.locator('.iris-grid-column')).toHaveScreenshot(); | ^ 138 | 139 | await page 140 | .locator('.iris-grid .grid-wrapper') at /work/tests/context-menu.spec.ts:137:51
[chromium] › ../../../../../work/tests/context-menu.spec.ts:160:5 › freeze column: ../../../../../work/tests/context-menu.spec.ts#L168
5) [chromium] › ../../../../../work/tests/context-menu.spec.ts:160:5 › freeze column ───────────── Error: expect(locator).toHaveScreenshot(expected) 761 pixels (ratio 0.01 of all image pixels) are different. Expected: /work/tests/context-menu.spec.ts-snapshots/freeze-column-1-chromium-linux.png Received: /work/test-results/context-menu-freeze-column-chromium/freeze-column-1-actual.png Diff: /work/test-results/context-menu-freeze-column-chromium/freeze-column-1-diff.png Call log: - expect.toHaveScreenshot with timeout 15000ms - verifying given screenshot expectation - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 761 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 761 pixels (ratio 0.01 of all image pixels) are different. 166 | 167 | await waitForLoadingDone(page); > 168 | await expect(page.locator('.iris-grid-column')).toHaveScreenshot(); | ^ 169 | 170 | await page 171 | .locator('.iris-grid .grid-wrapper') at /work/tests/context-menu.spec.ts:168:51
[chromium] › ../../../../../work/tests/context-menu.spec.ts:160:5 › freeze column: ../../../../../work/tests/context-menu.spec.ts#L168
5) [chromium] › ../../../../../work/tests/context-menu.spec.ts:160:5 › freeze column ───────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 761 pixels (ratio 0.01 of all image pixels) are different. Expected: /work/tests/context-menu.spec.ts-snapshots/freeze-column-1-chromium-linux.png Received: /work/test-results/context-menu-freeze-column-chromium-retry1/freeze-column-1-actual.png Diff: /work/test-results/context-menu-freeze-column-chromium-retry1/freeze-column-1-diff.png Call log: - expect.toHaveScreenshot with timeout 15000ms - verifying given screenshot expectation - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 761 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.iris-grid-column') - locator resolved to <div class="iris-grid-column">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 761 pixels (ratio 0.01 of all image pixels) are different. 166 | 167 | await waitForLoadingDone(page); > 168 | await expect(page.locator('.iris-grid-column')).toHaveScreenshot(); | ^ 169 | 170 | await page 171 | .locator('.iris-grid .grid-wrapper') at /work/tests/context-menu.spec.ts:168:51
Slow Test: ../../tests/notebook.spec.ts#L1
../../tests/notebook.spec.ts took 16.3s
🎭 Playwright Run Summary
187 failed [chromium] › ../../../../../work/tests/context-menu.spec.ts:34:5 › toggle column visibility ──── [chromium] › ../../../../../work/tests/context-menu.spec.ts:50:5 › quick filter and clear ────── [chromium] › ../../../../../work/tests/context-menu.spec.ts:76:5 › advanced filters ──────────── [chromium] › ../../../../../work/tests/context-menu.spec.ts:127:5 › sort by ──────────────────── [chromium] › ../../../../../work/tests/context-menu.spec.ts:160:5 › freeze column ────────────── [chromium] › ../../../../../work/tests/context-menu.spec.ts:180:5 › reverse table ────────────── [chromium] › ../../../../../work/tests/context-menu.spec.ts:191:5 › filter by value ──────────── [chromium] › ../../../../../work/tests/context-menu.spec.ts:210:5 › go to ────────────────────── [chromium] › ../../../../../work/tests/figure.spec.ts:13:5 › can set point shape and size ────── [chromium] › ../../../../../work/tests/golden-layout.spec.ts:67:7 › tests golden-layout operations › golden-layout can import a layout [chromium] › ../../../../../work/tests/golden-layout.spec.ts:72:7 › tests golden-layout operations › golden-layout can maximize the first stack [chromium] › ../../../../../work/tests/golden-layout.spec.ts:82:7 › tests golden-layout operations › golden-layout can use additional tabs menu [chromium] › ../../../../../work/tests/golden-layout.spec.ts:139:7 › tests golden-layout operations › golden-layout can drag tab to left edge [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-typography [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-colors [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-theme-color-palette [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-semantic-colors [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-chart-colors [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-editor-colors [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-grid-colors [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-component-colors [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-golden-layout [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-buttons-regular [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-buttons-inline [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-buttons-socketed [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-links [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-progress [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-inputs [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-item-list-inputs [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-draggable-lists [chromium] › ../../../../../work/tests/styleguide.spec.ts:86:7 › UI regression test - Styleguide section - sample-section-time-slider-inputs [chromium] › ../../../../../work/tests/styleguide.spe

Artifacts

Produced during runtime
Name Size
image-cache Expired
1.4 GB
playwright-report
946 MB
playwright-report-blob-chromium-1-1 Expired
412 MB
playwright-report-blob-firefox-1-1 Expired
194 MB
playwright-report-blob-webkit-1-2 Expired
162 MB
playwright-report-blob-webkit-2-2 Expired
196 MB
server-logs-chromium-1-1
11.2 KB
server-logs-firefox-1-1
9.92 KB
server-logs-webkit-1-2
8.58 KB
server-logs-webkit-2-2
6.93 KB