Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update WAVE test runner #46286

Open
wants to merge 10 commits into
base: master
Choose a base branch
from

fix: remove wave test integration

694c761
Select commit
Loading
Failed to load commit list.
Open

Update WAVE test runner #46286

fix: remove wave test integration
694c761
Select commit
Loading
Failed to load commit list.
Community-TC Integration / resources/ tests (Python 3.12) succeeded Feb 19, 2025 in 5m 26s

Community-TC (pull_request)

Tests for testharness.js and other files in resources/ under Python 3.12

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2025-02-19T13:25:52.395Z
Resolved: 2025-02-19T13:30:20.199Z
Task Execution Time: 4 minutes, 27 seconds, 804 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log


[taskcluster 2025-02-19 13:25:52.560Z] Task ID: KkhalCxaQWOHWmGBU3Dbig
[taskcluster 2025-02-19 13:25:52.560Z] Worker ID: 2697466870626805059
[taskcluster 2025-02-19 13:25:52.560Z] Worker Group: us-east4-b
[taskcluster 2025-02-19 13:25:52.560Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2025-02-19 13:25:52.560Z] Worker Pool: proj-wpt/ci
[taskcluster 2025-02-19 13:25:52.560Z] Worker Version: 46.1.0
[taskcluster 2025-02-19 13:25:52.560Z] Public IP: 35.245.243.177
[taskcluster 2025-02-19 13:25:52.560Z] Hostname: proj-wpt-ci-ayhlq-sksyi2vgap-vcy7a

ff2b96c8f8ff - Started downloading
ff2b96c8f8ff - Downloaded in 0.001 seconds
560c024910be - Started downloading
72ebe8ecf66d - Started downloading
430011f338a2 - Started downloading
430011f338a2 - Downloaded in 0.007 seconds
79df10d18997 - Started downloading
560c024910be - Downloaded in 0.166 seconds
4f4fb700ef54 - Started downloading
4f4fb700ef54 - Downloaded in 0.001 seconds
7e274023cae9 - Started downloading

...(446 lines hidden)...

   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/469.0 kB ? eta -:--:--
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 469.0/469.0 kB 50.3 MB/s eta 0:00:00
Installing collected packages: distlib, typing-extensions, tomli, pluggy, platformdirs, packaging, filelock, colorama, chardet, cachetools, virtualenv, pyproject-api, tox
Successfully installed cachetools-5.5.1 chardet-5.2.0 colorama-0.4.6 distlib-0.3.9 filelock-3.16.1 packaging-24.2 platformdirs-4.3.6 pluggy-1.5.0 pyproject-api-1.8.0 tomli-2.2.1 tox-4.24.1 typing-extensions-4.12.2 virtualenv-20.29.2

[notice] A new release of pip is available: 24.0 -> 25.0.1
[notice] To update, run: python3 -m pip install --upgrade pip
+ ./wpt install firefox browser --destination /home/test
INFO:install:Now installing firefox browser...
INFO:install:Downloading Firefox from https://download.mozilla.org/?product=firefox-nightly-latest-ssl&os=linux64&lang=en-US
INFO:install:Binary installed as /home/test/browsers/nightly/firefox/firefox
+ ./wpt install firefox webdriver --destination /home/test/firefox
INFO:install:Now installing firefox webdriver...
INFO:install:Attempting to install webdriver from nightly
INFO:install:Extracted geckodriver to /home/test/firefox/geckodriver
INFO:install:Installed b'geckodriver 0.35.0 (f47117ef97a7 2025-02-18 14:42 +0000)'
INFO:install:Binary installed as /home/test/firefox/geckodriver
+ export PATH=/home/test/firefox:/home/test/bin:/home/test/bin:/home/test/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ PATH=/home/test/firefox:/home/test/bin:/home/test/bin:/home/test/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ cd /home/test/web-platform-tests/tools/ci/../../resources/test
+ tox -- --binary=/home/test/browsers/nightly/firefox/firefox
py312: install_deps> python -I -m pip install -r /home/test/web-platform-tests/resources/test/../../tools/requirements_pytest.txt -r /home/test/web-platform-tests/resources/test/requirements.txt
py312: commands[0]> pytest -vv --binary=/home/test/browsers/nightly/firefox/firefox
1739971706496	geckodriver	INFO	Listening on 127.0.0.1:4444

/home/test/web-platform-tests/tools/wptserve/wptserve/request.py:4: DeprecationWarning: 'cgi' is deprecated and slated for removal in Python 3.13

  import cgi

[2025-02-19 13:28:27,328 None on port 33281] INFO - Starting http server on http://web-platform.test:33281

[2025-02-19 13:28:28,648 None on port 33281] INFO - Stopped http server on web-platform.test:33281

[2025-02-19 13:28:30,005 http on port 8000] INFO - Starting http server on http://web-platform.test:8000

[2025-02-19 13:28:30,172 https-public on port 41109] INFO - Starting https server on https://web-platform.test:41109

[2025-02-19 13:28:30,179 http-private on port 47385] INFO - Starting http server on http://web-platform.test:47385

[2025-02-19 13:28:30,192 https-private on port 38581] INFO - Starting https server on https://web-platform.test:38581

[2025-02-19 13:28:30,276 http-public on port 38009] INFO - Starting http server on http://web-platform.test:38009

[2025-02-19 13:28:30,285 https on port 8443] INFO - Starting https server on https://web-platform.test:8443

[2025-02-19 13:28:30,324 http on port 52773] INFO - Starting http server on http://web-platform.test:52773

[2025-02-19 13:28:30,325 https on port 8444] INFO - Starting https server on https://web-platform.test:8444

[2025-02-19 13:28:30,360 h2 on port 9000] INFO - Starting http2 server on https://web-platform.test:9000

[2025-02-19 13:28:30,464 wss on port 48029] INFO - Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 48029))

[2025-02-19 13:28:30,466 wss on port 48029] INFO - Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 48029))

[2025-02-19 13:28:30,466 wss on port 48029] INFO - Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 48029))

[2025-02-19 13:28:30,613 ws on port 47969] INFO - Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 47969))

[2025-02-19 13:28:30,613 ws on port 47969] INFO - Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 47969))

[2025-02-19 13:28:30,613 ws on port 47969] INFO - Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 47969))

============================= test session starts ==============================

platform linux -- Python 3.12.9, pytest-8.3.2, pluggy-1.5.0 -- /home/test/web-platform-tests/resources/test/.tox/py312/bin/python

cachedir: .tox/py312/.pytest_cache

hypothesis profile 'default' -> database=DirectoryBasedExampleDatabase(PosixPath('/home/test/web-platform-tests/resources/test/.hypothesis/examples'))

rootdir: /home/test/web-platform-tests/resources/test

plugins: hypothesis-6.112.0, cov-5.0.0

collecting ... 
collected 88 items                                                             



tests/functional/abortsignal.html::Test#get_signal 1739971714558	mozrunner::runner	INFO	Running command: MOZ_CRASHREPORTER="1" MOZ_CRASHREPORTER_NO_REPORT="1" MOZ_CRASHREPORTER_SHUTDOWN="1" "/home/test/browsers/nightly/firefox/firefox" "--marionette" "-no-remote" "-profile" "/tmp/rust_mozprofileYYmcKu"

[GFX1-]: glxtest: libpci missing

1739971715048	Marionette	INFO	Marionette enabled

1739971715135	Marionette	INFO	Listening on port 36093

Read port: 36093

1739971715276	RemoteAgent	WARN	TLS certificate errors will be ignored for this session

Failed to read: session.screen0.titlebar.left
Setting default value
Failed to read: session.screen0.titlebar.right
Setting default value
console.error: ({})

console.error: (new NotFoundError("Could not find fa0fc42c-d91d-fca7-34eb-806ff46062dc in cache or dump", "resource://services-settings/Attachments.sys.mjs", 48))

console.warn: "Unable to find the attachment for" "fa0fc42c-d91d-fca7-34eb-806ff46062dc"

PASSED                [  1%]

tests/functional/add_cleanup.html::Test#add_cleanup PASSED               [  2%]

tests/functional/add_cleanup_async.html::Test#add_cleanup with Promise-returning functions PASSED [  3%]

tests/functional/add_cleanup_async_bad_return.html::Test#add_cleanup with non-thenable-returning function PASSED [  4%]

tests/functional/add_cleanup_async_rejection.html::Test#add_cleanup with Promise-returning functions (rejection handling) PASSED [  5%]

tests/functional/add_cleanup_async_rejection_after_load.html::Test#add_cleanup with Promise-returning functions (rejection handling following "load" event) PASSED [  6%]

tests/functional/add_cleanup_async_timeout.html::Test#add_cleanup with Promise-returning functions (timeout handling) PASSED [  7%]

tests/functional/add_cleanup_bad_return.html::Test#add_cleanup with value-returning function PASSED [  9%]

tests/functional/add_cleanup_count.html::Test#add_cleanup reported count PASSED [ 10%]

tests/functional/add_cleanup_err.html::Test#add_cleanup: error PASSED    [ 11%]

tests/functional/add_cleanup_err_multi.html::Test#add_cleanup: multiple functions with one in error PASSED [ 12%]

tests/functional/add_cleanup_sync_queue.html::Test#add_cleanup: queuing tests PASSED [ 13%]

tests/functional/api-tests-1.html::Sample HTML5 API Tests JavaScript error: resource:///modules/backup/BackupService.sys.mjs, line 108: NS_ERROR_FAILURE: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]

PASSED         [ 14%]

tests/functional/api-tests-2.html::Sample HTML5 API Tests PASSED         [ 15%]

tests/functional/api-tests-3.html::Sample HTML5 API Tests PASSED         [ 17%]

tests/functional/assert-array-equals.html::assert_array_equals PASSED    [ 18%]

tests/functional/assert-throws-dom.html::assert_throws_dom PASSED        [ 19%]

tests/functional/force_timeout.html::Test#force_timeout PASSED           [ 20%]

tests/functional/generate-callback.html::Sample for using generate_tests to create a series of tests that share the same callback. PASSED [ 21%]

tests/functional/idlharness/IdlDictionary/test_partial_interface_of.html::idlharness: Partial dictionary PASSED [ 22%]

tests/functional/idlharness/IdlInterface/test_exposed_wildcard.html::idlharness: Exposed=* PASSED [ 23%]

tests/functional/idlharness/IdlInterface/test_immutable_prototype.html::idlharness: Immutable prototypes PASSED [ 25%]

tests/functional/idlharness/IdlInterface/test_interface_mixin.html::idlharness: interface mixins PASSED [ 26%]

tests/functional/idlharness/IdlInterface/test_partial_interface_of.html::idlharness: Partial interface PASSED [ 27%]

tests/functional/idlharness/IdlInterface/test_primary_interface_of.html::idlharness: Primary interface PASSED [ 28%]

tests/functional/idlharness/IdlInterface/test_to_json_operation.html::IdlInterface.prototype.test_to_json_operation() PASSED [ 29%]

tests/functional/idlharness/IdlNamespace/test_attribute.html::idlharness: namespace attribute PASSED [ 30%]

tests/functional/idlharness/IdlNamespace/test_operation.html::idlharness: namespace operation PASSED [ 31%]

tests/functional/idlharness/IdlNamespace/test_partial_namespace.html::idlharness: Partial namespace PASSED [ 32%]

tests/functional/iframe-callback.html::Example with iframe that notifies containing document via callbacks PASSED [ 34%]

JavaScript error: https://web-platform.test:8443/resources/test/tests/functional/uncaught-exception-handle.html, line 13: Error: Example Error

tests/functional/iframe-consolidate-errors.html::Example with iframe that consolidates errors via fetch_tests_from_window console.error: (new Error("Polling for changes failed: Unexpected content-type \"text/plain;charset=US-ASCII\".", "resource://services-settings/remote-settings.sys.mjs", 430))

console.error: "Could not download new icon" (new ServerInfoError("Server response is invalid SyntaxError: JSON.parse: unexpected end of data at line 1 column 1 of the JSON data", "resource://services-settings/Attachments.sys.mjs", 40))

PASSED [ 35%]

tests/functional/iframe-consolidate-tests.html::Example with iframe that consolidates tests via fetch_tests_from_window PASSED [ 36%]

tests/functional/iframe-msg.html::Example with iframe that notifies containing document via cross document messaging PASSED [ 37%]

tests/functional/log-insertion.html::Log insertion PASSED                [ 38%]

tests/functional/no-title.html::Tests with no title PASSED               [ 39%]

tests/functional/order.html::Ordering PASSED                             [ 40%]

tests/functional/promise-async.html::Async Tests and Promises PASSED     [ 42%]

tests/functional/promise-with-sync.html::Promise Tests and Synchronous Tests PASSED [ 43%]

tests/functional/promise.html::Promise Tests PASSED                      [ 44%]

tests/functional/queue.html::Test queuing synchronous tests PASSED       [ 45%]

tests/functional/setup-worker-service.html::Setup function in a service worker PASSED [ 46%]

JavaScript error: https://web-platform.test:8443/resources/testharness.js, line 1469: uncaught exception: Error: assert_true: expected true got false

tests/functional/single-page-test-fail.html::Example with file_is_test (should fail) PASSED [ 47%]

tests/functional/single-page-test-no-assertions.html::Example single page test with no asserts PASSED [ 48%]

tests/functional/single-page-test-no-body.html::Example single page test with no body PASSED [ 50%]

tests/functional/single-page-test-pass.html::Example with file_is_test PASSED [ 51%]

tests/functional/step_wait.html::Tests for step_wait PASSED              [ 52%]

tests/functional/step_wait_func.html::Tests for step_wait_func and step_wait_func_done PASSED [ 53%]

tests/functional/task-scheduling-promise-test.html::testharness.js - task scheduling PASSED [ 54%]

tests/functional/task-scheduling-test.html::testharness.js - task scheduling PASSED [ 55%]

JavaScript error: https://web-platform.test:8443/resources/test/tests/functional/uncaught-exception-handle.html, line 13: Error: Example Error

tests/functional/uncaught-exception-handle.html::Harness Handling Uncaught Exception PASSED [ 56%]

JavaScript error: https://web-platform.test:8443/resources/test/tests/functional/uncaught-exception-ignore.html, line 15: Error: Example Error

tests/functional/uncaught-exception-ignore.html::Harness Ignoring Uncaught Exception PASSED [ 57%]

tests/functional/worker-dedicated-uncaught-allow.html::Dedicated Worker Tests - Allowed Uncaught Exception PASSED [ 59%]

tests/functional/worker-dedicated-uncaught-single.html::Dedicated Worker Tests - Uncaught Exception in Single-Page Test PASSED [ 60%]

tests/functional/worker-dedicated.sub.html::Dedicated Worker Tests PASSED [ 61%]

tests/functional/worker-service.html::Example with a service worker PASSED [ 62%]

tests/functional/worker-shared.html::Example with a shared worker PASSED [ 63%]

tests/unit/IdlArray/is_json_type.html::IdlArray.prototype.is_json_type() PASSED [ 64%]

tests/unit/IdlDictionary/get_reverse_inheritance_stack.html::IdlDictionary.prototype.get_reverse_inheritance_stack() PASSED [ 65%]

tests/unit/IdlDictionary/test_partial_dictionary.html::idlharness: partial dictionaries PASSED [ 67%]

tests/unit/IdlInterface/constructors.html::IdlInterface.prototype.constructors() PASSED [ 68%]

tests/unit/IdlInterface/default_to_json_operation.html::IdlDictionary.prototype.default_to_json_operation() PASSED [ 69%]

tests/unit/IdlInterface/do_member_unscopable_asserts.html::IdlDictionary.prototype.do_member_unscopable_asserts() PASSED [ 70%]

tests/unit/IdlInterface/get_interface_object.html::IdlInterface.prototype.get_interface_object() PASSED [ 71%]

tests/unit/IdlInterface/get_interface_object_owner.html::IdlInterface.prototype.get_interface_object_owner() PASSED [ 72%]

tests/unit/IdlInterface/get_legacy_namespace.html::IdlInterface.prototype.get_legacy_namespace() PASSED [ 73%]

tests/unit/IdlInterface/get_qualified_name.html::IdlInterface.prototype.get_qualified_name() PASSED [ 75%]

tests/unit/IdlInterface/get_reverse_inheritance_stack.html::IdlInterface.prototype.get_reverse_inheritance_stack() PASSED [ 76%]

tests/unit/IdlInterface/has_default_to_json_regular_operation.html::IdlInterface.prototype.has_default_to_json_regular_operation() PASSED [ 77%]

tests/unit/IdlInterface/has_to_json_regular_operation.html::IdlInterface.prototype.has_to_json_regular_operation() PASSED [ 78%]

tests/unit/IdlInterface/should_have_interface_object.html::IdlInterface.prototype.should_have_interface_object() PASSED [ 79%]

tests/unit/IdlInterface/test_primary_interface_of_undefined.html::idlharness test_primary_interface_of_undefined PASSED [ 80%]

tests/unit/IdlInterfaceMember/is_to_json_regular_operation.html::IdlInterfaceMember.prototype.is_to_json_regular_operation() PASSED [ 81%]

tests/unit/IdlInterfaceMember/toString.html::IdlInterfaceMember.prototype.toString() PASSED [ 82%]

tests/unit/assert_implements.html::assert_implements unittests PASSED    [ 84%]

tests/unit/assert_implements_optional.html::assert_implements_optional unittests PASSED [ 85%]

tests/unit/assert_object_equals.html::Assertion functions PASSED         [ 86%]

tests/unit/async-test-return-restrictions.html::Restrictions on return value from `async_test` PASSED [ 87%]

tests/unit/basic.html::idlharness basic PASSED                           [ 88%]

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases-timeouts.html, line 15: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases-timeouts.html, line 15: Error: this error is expected

tests/unit/exceptional-cases-timeouts.html::Exceptional cases - timeouts PASSED [ 89%]

tests/unit/exceptional-cases.html::Exceptional cases JavaScript error: https://web-platform.test:8443/resources/testharness.js?0.2556268501624501, line 1469: uncaught exception: Error: assert_false: expected false got true

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 11: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 13: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 16: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 17: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 11: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 11: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 11: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 13: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 19: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 14: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 14: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 14: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 14: Error: this error is expected

PASSED              [ 90%]

tests/unit/format-value.html::format_value utility function PASSED       [ 92%]

tests/unit/late-test.html::Test declared after harness completion PASSED [ 93%]

tests/unit/promise_setup-timeout.html::promise_setup - timeout PASSED    [ 94%]

tests/unit/promise_setup.html::promise_setup JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/promise_setup.html, line 15: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/promise_setup.html, line 18: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/promise_setup.html, line 20: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/promise_setup.html, line 17: Error: this error is expected

PASSED                      [ 95%]

JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/single_test.html, line 13: Error: this error is expected

tests/unit/single_test.html::single_test JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/single_test.html, line 13: Error: this error is expected

JavaScript error: https://web-platform.test:8443/resources/testharness.js?0.5234233177070909, line 2493: Error: Tried to create a test with file_is_test

JavaScript error: https://web-platform.test:8443/resources/testharness.js?0.07766745683197374, line 2493: Error: Tried to create a test with file_is_test

JavaScript error: https://web-platform.test:8443/resources/testharness.js?0.7126075632610104, line 2493: Error: Tried to create a test with file_is_test

PASSED                          [ 96%]

tests/unit/test-return-restrictions.html::Restrictions on return value from `test` PASSED [ 97%]

tests/unit/throwing-assertions.html::Test the methods that make assertions about exceptions PASSED [ 98%]

tests/unit/unpaired-surrogates.html::Restrictions on return value from `test` PASSED [100%]



=============================== warnings summary ===============================

conftest.py:32

  /home/test/web-platform-tests/resources/test/conftest.py:32: PytestRemovedIn9Warning: The (path: py.path.local) argument is deprecated, please use (file_path: pathlib.Path)

  see https://docs.pytest.org/en/latest/deprecations.html#py-path-local-arguments-for-hooks-replaced-with-pathlib-path

    def pytest_collect_file(file_path, path, parent):



-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

================== 88 passed, 1 warning in 104.49s (0:01:44) ===================

1739971818182	Marionette	INFO	Stopped listening on port 36093

[GFX1-]: RenderCompositorSWGL failed mapping default framebuffer, no dt

  py312: OK (115.18=setup[2.48]+cmd[112.70] seconds)
  congratulations :) (115.24 seconds)
X connection to :99.0 broken (explicit kill or server shutdown).

[taskcluster 2025-02-19 13:30:19.460Z] === Task Finished ===
[taskcluster 2025-02-19 13:30:19.508Z] Successful task run with exit code: 0 completed in 266.951 seconds