Skip to content
iOS end-to-end nightly tests

iOS end-to-end nightly tests #10

Sign in to view logs

iOS end-to-end nightly tests

iOS end-to-end nightly tests #10

Triggered via schedule August 18, 2024 00:01
@buggmagnetbuggmagnet
⁠ 8b17243
main
Status Failure
Total duration 12m 43s
Artifacts 5

ios-end-to-end-tests-nightly.yml

on: schedule
reuse-e2e-workflow  /  Set up outputs directory
4s
reuse-e2e-workflow  /  Define test suites matrix
4s
reuse-e2e-workflow  /  Build for end to end testing
2m 41s
Matrix: reuse-e2e-workflow / Run tests
reuse-e2e-workflow  /  Clean up outputs directory
6s
reuse-e2e-workflow  /  Notify team on failure(if PR related)
0s

Annotations

24 errors and 6 warnings
reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Pages/LoginPage.swift#L67
testDeleteAccount, XCTAssertTrue failed - Fail icon shown
reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testLogin, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Pages/LoginPage.swift#L57
testLoginToAccountWithTooManyDevices, XCTAssertEqual failed: ("XCTWaiterResult(rawValue: 2)") is not equal to ("XCTWaiterResult(rawValue: 1)") - Success icon shown
reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Pages/LoginPage.swift#L67
testLoginWithIncorrectAccountNumber, XCTAssertTrue failed - Fail icon shown
reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Networking/MullvadAPIWrapper.swift#L104
testLogOut, XCTAssertNil failed: "requestError" - Create account error is nil
reuse-e2e-workflow / Run tests (AccountTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testTimeLeft, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (AccountTests)
Process completed with exit code 65.
reuse-e2e-workflow / Run tests (ConnectivityTests): ios/MullvadVPNUITests/Networking/FirewallAPIClient.swift#L105
testAPIConnectionViaBridges, failed - Failed to remove firewall rules - unexpected server response
reuse-e2e-workflow / Run tests (ConnectivityTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testAPIReachableWhenBlocked, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (ConnectivityTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testAppStillFunctioningWhenAPIDown, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (ConnectivityTests)
Process completed with exit code 65.
reuse-e2e-workflow / Run tests (CustomListsTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testAddSingleLocationToCustomList, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (CustomListsTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testCreateCustomListPersistAfterAppRestarts, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (CustomListsTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testDeleteCustomList, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (CustomListsTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testEditCustomListLocations, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (CustomListsTests)
Process completed with exit code 65.
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testAdBlockingViaDNS, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testAppConnection, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testConnectionRetryLogic, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testCustomDNS, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testWireGuardOverTCPAutomatically, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testWireGuardOverTCPManually, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests): ios/MullvadVPNUITests/Networking/PartnerAPIClient.swift#L110
testWireGuardPortSettings, failed - Request failed with status code 403
reuse-e2e-workflow / Run tests (RelayTests)
Process completed with exit code 65.
reuse-e2e-workflow / Build for end to end testing
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1.0.6. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
reuse-e2e-workflow / Build for end to end testing
The following actions use a deprecated Node.js version and will be forced to run on node20: actions-rs/toolchain@v1.0.6. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
reuse-e2e-workflow / Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
reuse-e2e-workflow / Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
reuse-e2e-workflow / Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
reuse-e2e-workflow / Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

Artifacts

Produced during runtime
Name Size Digest
MullvadVPNUITests_AccountTests-test-results Expired
127 MB
sha256:27eb428941f29e212214f63d692a505c0e74f85f18b15066b94770d939c45d25
MullvadVPNUITests_ConnectivityTests-test-results Expired
33.9 MB
sha256:0619773ae2bcd2fa31f96e6d78233a4e76940b97615513371e4cda031aba7ebb
MullvadVPNUITests_CustomListsTests-test-results Expired
52.8 MB
sha256:7dab05019485070618d7ebaf34119d8b25b9d1b5035db2aa521a484f5d443a4c
MullvadVPNUITests_RelayTests-test-results Expired
76.3 MB
sha256:4b703dc582bc72e5a64653048e850b003fc153d89afbc58e650e56a430c6d604
MullvadVPNUITests_SettingsTests-test-results Expired
112 KB
sha256:1791b0ecd57f93f8d88c97903e7d70101821b5062716b66eee779b9eb39e73e5