Skip to content

iOS end-to-end tests #1064

iOS end-to-end tests

iOS end-to-end tests #1064

Manually triggered December 17, 2024 12:05
Status Failure
Total duration 20m 2s
Artifacts 5

ios-end-to-end-tests.yml

on: workflow_dispatch
Set up outputs directory
4s
Set up outputs directory
Define test suites matrix
4s
Define test suites matrix
Build for end to end testing
3m 7s
Build for end to end testing
Matrix: Run tests
Clean up outputs directory
7s
Clean up outputs directory
Notify team on failure(if PR related)
0s
Notify team on failure(if PR related)
Fit to window
Zoom out
Zoom in

Annotations

22 errors, 4 warnings, and 2 notices
Run tests (CustomListsTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testAddSingleLocationToCustomList, XCTAssertTrue failed - Page is shown
Run tests (CustomListsTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testCreateCustomListPersistAfterAppRestarts, XCTAssertTrue failed - Page is shown
Run tests (CustomListsTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testDeleteCustomList, XCTAssertTrue failed - Page is shown
Run tests (CustomListsTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testEditCustomListLocations, XCTAssertTrue failed - Page is shown
Run tests (CustomListsTests)
Process completed with exit code 65.
Run tests (ConnectivityTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testAPIReachableWhenBlocked, XCTAssertTrue failed - Page is shown
Run tests (ConnectivityTests)
Process completed with exit code 65.
Run tests (AccountTests): ios/MullvadVPNUITests/Networking/MullvadAPIWrapper.swift#L114
testCreateAccount, failed - Failed to delete account with error: The operation couldn’t be completed. (MullvadVPNUITests.ApiError error 1.)
Run tests (AccountTests): ios/MullvadVPNUITests/Networking/MullvadAPIWrapper.swift#L134
testLoginToAccountWithTooManyDevices, failed - Failed to add device with error: The operation couldn’t be completed. (MullvadVPNUITests.ApiError error 1.)
Run tests (AccountTests): ios/MullvadVPNUITests/Networking/MullvadAPIWrapper.swift#L181
testLogOut, failed - Failed to get devices with error: The operation couldn’t be completed. (MullvadVPNUITests.ApiError error 1.)
Run tests (AccountTests): ios/MullvadVPNUITests/Networking/MullvadAPIWrapper.swift#L161
testTimeLeft, failed - Failed to get account expiry with error: The operation couldn’t be completed. (MullvadVPNUITests.ApiError error 1.)
Run tests (AccountTests)
Process completed with exit code 65.
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testAdBlockingViaDNS, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testAppConnection, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testConnectionRetryLogic, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testCustomDNS, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testDAITASettings, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testMultihopSettings, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testWireGuardOverShadowsocksManually, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testWireGuardOverTCPAutomatically, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testWireGuardOverTCPManually, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testWireGuardPortSettings, XCTAssertTrue failed - Page is shown
Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Run tests (ConnectivityTests)
Skipped MullvadVPNUITests.ConnectivityTests.testAPIConnectionViaBridges
Run tests (ConnectivityTests)
Skipped MullvadVPNUITests.ConnectivityTests.testAppStillFunctioningWhenAPIDown

Artifacts

Produced during runtime
Name Size Digest
MullvadVPNUITests_AccountTests-test-results Expired
83.5 MB
sha256:f5be585223853eb712ea6a78d52d6641f26110a409e099d85721cf0333f474d7
MullvadVPNUITests_ConnectivityTests-test-results Expired
17.9 MB
sha256:b0418a10ea82de5a71509d1d884b511a7a1f644169638fac9c3bd4cc1949bc02
MullvadVPNUITests_CustomListsTests-test-results Expired
86.5 MB
sha256:b5883982e8853674f93bd61365647c0db2cdcc7ac0414436a4f2273eb98d28d0
MullvadVPNUITests_RelayTests-test-results Expired
251 MB
sha256:8bba95a377e2a5cb59bcf6fb579a02918c1a48d26fd402526eba2dbeccb8e35d
MullvadVPNUITests_SettingsTests-test-results Expired
112 KB
sha256:a52f90cc990e8c483e9eec11374f6c379fba64d81bc2c3391495d33acc7d3595