[HEALTH] 4.20 Health Check, please don't merge this!

[DaanHoogland]

Description

This PR...

Types of changes

• Breaking change (fix or feature that would cause existing functionality to change)
• New feature (non-breaking change which adds functionality)
• Bug fix (non-breaking change which fixes an issue)
• Enhancement (improves an existing feature and functionality)
• Cleanup (Code refactoring and cleanup, that may add test cases)
• build/CI
• test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

• Major
• Minor

Bug Severity

• BLOCKER
• Critical
• Major
• Minor
• Trivial

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 15.98%. Comparing base (789f94b) to head (5cca988).

Additional details and impacted files

@@             Coverage Diff              @@
##               4.20   #10006      +/-   ##
============================================
- Coverage     15.98%   15.98%   -0.01%     
+ Complexity    13077    13075       -2     
============================================
  Files          5649     5649              
  Lines        495624   495624              
  Branches      60003    60003              
============================================
- Hits          79250    79249       -1     
  Misses       407526   407526              
- Partials       8848     8849       +1     

Flag	Coverage Δ
uitests	4.01% <ø> (ø)
unittests	16.82% <ø> (-0.01%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 11641

[DaanHoogland]

zero day test
@blueorangutan test matrix

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian Build Failed (tid-11818)

[blueorangutan]

[SF] Trillian Build Failed (tid-11817)

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✖️ el8 ✖️ el9 ✖️ debian ✖️ suse15. SL-JID 11785

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 11789

[DaanHoogland]

@blueorangutan test matrix

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian test result (tid-11888)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 54177 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t11888-kvm-ol8.zip
Smoke tests completed. 141 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File

[blueorangutan]

[SF] Trillian test result (tid-11889)
Environment: kvm-ubuntu22 (x2), Advanced Networking with Mgmt server u22
Total time taken: 60776 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t11889-kvm-ubuntu22.zip
Smoke tests completed. 140 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_oobm_multiple_mgmt_server_ownership	Failure	31.79	test_outofbandmanagement.py

[blueorangutan]

[SF] Trillian test result (tid-11895)
Environment: vmware-70u3 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 70916 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t11895-vmware-70u3.zip
Smoke tests completed. 138 look OK, 3 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_deploy_more_vms_than_limit_allows	Error	138.47	test_deploy_vms_in_parallel.py
test_01_deployVMInSharedNetwork	Failure	3603.40	test_network.py
ContextSuite context=TestSharedNetworkWithConfigDrive>:teardown	Error	3604.62	test_network.py
test_02_restore_vm_with_disk_offering	Error	53.00	test_restore_vm.py
test_03_restore_vm_with_disk_offering_custom_size	Error	51.91	test_restore_vm.py

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 11810

[DaanHoogland]

@blueorangutan test matrix

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian test result (tid-11904)
Environment: kvm-ubuntu22 (x2), Advanced Networking with Mgmt server u22
Total time taken: 58240 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t11904-kvm-ubuntu22.zip
Smoke tests completed. 140 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_oobm_multiple_mgmt_server_ownership	Failure	30.75	test_outofbandmanagement.py

[blueorangutan]

[SF] Trillian test result (tid-11903)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 59937 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t11903-kvm-ol8.zip
Smoke tests completed. 141 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File

[DaanHoogland]

@blueorangutan test matrix

[blueorangutan]

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 12313

[sureshanaparti]

@blueorangutan package

[blueorangutan]

@sureshanaparti a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 12420

[sureshanaparti]

@blueorangutan test

[blueorangutan]

@sureshanaparti a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian test result (tid-12377)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 57237 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t12377-kvm-ol8.zip
Smoke tests completed. 138 look OK, 3 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_11_isolated_network_with_dynamic_routed_mode	Error	2.30	test_ipv4_routing.py
test_12_vpc_and_tier_with_dynamic_routed_mode	Error	2.48	test_ipv4_routing.py
test_12_vpc_and_tier_with_dynamic_routed_mode	Error	2.48	test_ipv4_routing.py
test_06_purge_expunged_vm_background_task	Failure	381.38	test_purge_expunged_vms.py
test_12_start_vm_multiple_volumes_allocated	Error	14.84	test_vm_life_cycle.py

[shwstppr]

@blueorangutan package

[blueorangutan]

@shwstppr a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 12476

[shwstppr]

@blueorangutan test matrix

[blueorangutan]

@shwstppr a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian Build Failed (tid-12434)

[blueorangutan]

[SF] Trillian Build Failed (tid-12433)

[blueorangutan]

[SF] Trillian Build Failed (tid-12431)

[blueorangutan]

[SF] Trillian Build Failed (tid-12432)

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 12486

[DaanHoogland]

@blueorangutan test matrix

[blueorangutan]

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian test result (tid-12454)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 55574 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t12454-kvm-ol8.zip
Smoke tests completed. 139 look OK, 2 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_11_isolated_network_with_dynamic_routed_mode	Error	1.24	test_ipv4_routing.py
test_12_vpc_and_tier_with_dynamic_routed_mode	Error	2.34	test_ipv4_routing.py
test_12_vpc_and_tier_with_dynamic_routed_mode	Error	2.34	test_ipv4_routing.py
test_06_purge_expunged_vm_background_task	Failure	385.26	test_purge_expunged_vms.py

[blueorangutan]

[SF] Trillian test result (tid-12455)
Environment: kvm-ubuntu22 (x2), Advanced Networking with Mgmt server u22
Total time taken: 62470 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t12455-kvm-ubuntu22.zip
Smoke tests completed. 138 look OK, 3 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_11_isolated_network_with_dynamic_routed_mode	Error	2.38	test_ipv4_routing.py
test_12_vpc_and_tier_with_dynamic_routed_mode	Error	2.46	test_ipv4_routing.py
test_12_vpc_and_tier_with_dynamic_routed_mode	Error	2.46	test_ipv4_routing.py
test_oobm_multiple_mgmt_server_ownership	Failure	31.86	test_outofbandmanagement.py
test_06_purge_expunged_vm_background_task	Failure	406.87	test_purge_expunged_vms.py

[blueorangutan]

[SF] Trillian test result (tid-12457)
Environment: xcpng82 (x2), Advanced Networking with Mgmt server ol9
Total time taken: 73968 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t12457-xcpng82.zip
Smoke tests completed. 134 look OK, 7 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_condensed_drs_algorithm	Failure	175.38	test_cluster_drs.py
test_02_balanced_drs_algorithm	Failure	175.46	test_cluster_drs.py
test_11_isolated_network_with_dynamic_routed_mode	Error	2.37	test_ipv4_routing.py
test_12_vpc_and_tier_with_dynamic_routed_mode	Error	3.48	test_ipv4_routing.py
test_12_vpc_and_tier_with_dynamic_routed_mode	Error	3.48	test_ipv4_routing.py
ContextSuite context=TestSharedNetworkWithConfigDrive>:setup	Error	7.48	test_network.py
test_01_non_strict_host_anti_affinity	Error	230.06	test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity	Error	119.28	test_nonstrict_affinity_group.py
test_06_purge_expunged_vm_background_task	Failure	410.73	test_purge_expunged_vms.py
test_02_create_volume	Error	3.22	test_resource_names.py
test_05_scale_vm_dont_allow_disk_offering_change	Failure	70.55	test_scale_vm.py

[blueorangutan]

[SF] Trillian test result (tid-12456)
Environment: vmware-70u3 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 123816 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10006-t12456-vmware-70u3.zip
Smoke tests completed. 96 look OK, 45 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_events_resource	Error	345.21	test_events_resource.py
test_01_events_resource	Error	345.22	test_events_resource.py
ContextSuite context=TestClusterDRS>:setup	Error	0.00	test_cluster_drs.py
test_04_deploy_vm_with_extraconfig_throws_exception_vmware	Error	4.65	test_deploy_vm_extra_config_data.py
test_11_isolated_network_with_dynamic_routed_mode	Error	2.34	test_ipv4_routing.py
test_12_vpc_and_tier_with_dynamic_routed_mode	Error	2.50	test_ipv4_routing.py
test_12_vpc_and_tier_with_dynamic_routed_mode	Error	2.50	test_ipv4_routing.py
test_deploy_more_vms_than_limit_allows	Error	177.94	test_deploy_vms_in_parallel.py
test_08_upgrade_kubernetes_ha_cluster	Failure	3688.24	test_kubernetes_clusters.py
test_04_list_domains_level_filter	Failure	0.06	test_list_domains.py
test_05_list_domains_no_filter	Failure	0.04	test_list_domains.py
test_04_deploy_vm_for_other_user_and_test_vm_operations	Error	157.17	test_network_permissions.py
test_01_deployVMInSharedNetwork	Error	162.20	test_network.py
ContextSuite context=TestPurgeExpungedVms>:setup	Error	0.00	test_purge_expunged_vms.py
test_another_user_can_allocate_ip_after_quarantined_has_ended_network	Error	6.63	test_quarantined_ips.py
test_another_user_can_allocate_ip_after_quarantined_has_ended_vpc	Error	0.36	test_quarantined_ips.py
test_only_owner_can_allocate_ip_in_quarantine_network	Error	0.35	test_quarantined_ips.py
test_only_owner_can_allocate_ip_in_quarantine_vpc	Error	0.38	test_quarantined_ips.py
test_CRUD_operations_userdata	Error	1521.73	test_register_userdata.py
test_deploy_vm_with_registered_userdata	Error	7.63	test_register_userdata.py
test_deploy_vm_with_registered_userdata_with_override_policy_allow	Error	7.27	test_register_userdata.py
test_deploy_vm_with_registered_userdata_with_override_policy_append	Error	7.41	test_register_userdata.py
test_deploy_vm_with_registered_userdata_with_override_policy_deny	Error	7.35	test_register_userdata.py
test_deploy_vm_with_registered_userdata_with_params	Error	7.45	test_register_userdata.py
test_link_and_unlink_userdata_to_template	Error	7.08	test_register_userdata.py
test_user_userdata_crud	Error	7.52	test_register_userdata.py
ContextSuite context=TestResetVmOnReboot>:setup	Error	0.00	test_reset_vm_on_reboot.py
ContextSuite context=TestRAMCPUResourceAccounting>:setup	Error	0.00	test_resource_accounting.py
ContextSuite context=TestResourceNames>:setup	Error	0.00	test_resource_names.py
ContextSuite context=TestRestoreVM>:setup	Error	0.00	test_restore_vm.py
ContextSuite context=TestRouterDHCPHosts>:setup	Error	0.00	test_router_dhcphosts.py
ContextSuite context=TestRouterDHCPOpts>:setup	Error	0.00	test_router_dhcphosts.py
ContextSuite context=TestCreateVolume>:setup	Error	0.00	test_volumes.py
ContextSuite context=TestVolumes>:setup	Error	1517.73	test_volumes.py
ContextSuite context=TestRouterDns>:setup	Error	0.00	test_router_dns.py
test_01_register_vnf_template	Error	0.07	test_vnf_templates.py
test_02_list_vnf_template	Error	0.07	test_vnf_templates.py
test_03_edit_vnf_template	Error	0.09	test_vnf_templates.py
test_04_deploy_vnf_appliance	Error	0.07	test_vnf_templates.py
test_05_delete_vnf_template	Error	0.07	test_vnf_templates.py
ContextSuite context=TestRouterDnsService>:setup	Error	0.00	test_router_dnsservice.py
ContextSuite context=TestRouterIpTablesPolicies>:setup	Error	0.00	test_routers_iptables_default_policy.py
ContextSuite context=TestVPCIpTablesPolicies>:setup	Error	0.00	test_routers_iptables_default_policy.py
test_change_service_offering_for_vm_with_snapshots	Error	1.45	test_vm_snapshots.py
ContextSuite context=TestVmSnapshot>:setup	Error	12.20	test_vm_snapshots.py
ContextSuite context=TestIsolatedNetworks>:setup	Error	0.00	test_routers_network_ops.py
ContextSuite context=TestRedundantIsolateNetworks>:setup	Error	0.00	test_routers_network_ops.py
ContextSuite context=TestRouterServices>:setup	Error	0.00	test_routers.py
test_01_scale_vm	Error	1.39	test_scale_vm.py
test_02_scale_vm_negative_offering_disable_scaling	Error	1.32	test_scale_vm.py
test_03_scale_vm_negative_vm_disable_scaling	Error	1.27	test_scale_vm.py
test_04_scale_vm_with_user_account	Error	5.98	test_scale_vm.py
test_05_scale_vm_dont_allow_disk_offering_change	Error	1.40	test_scale_vm.py
ContextSuite context=TestServiceOfferings>:setup	Error	1517.67	test_service_offerings.py
ContextSuite context=TestSetSourceNatIp>:setup	Error	0.00	test_set_sourcenat.py
ContextSuite context=TestSharedFSLifecycle>:setup	Error	0.00	test_sharedfs_lifecycle.py
ContextSuite context=TestSnapshotRootDisk>:setup	Error	0.00	test_snapshots.py
ContextSuite context=TestSnapshotStandaloneBackup>:setup	Error	0.00	test_snapshots.py
test_01_list_sec_storage_vm	Failure	0.04	test_ssvm.py
test_02_list_cpvm_vm	Failure	0.06	test_ssvm.py
test_03_ssvm_internals	Failure	0.04	test_ssvm.py
test_04_cpvm_internals	Failure	0.04	test_ssvm.py
test_05_stop_ssvm	Failure	0.04	test_ssvm.py
test_06_stop_cpvm	Failure	0.04	test_ssvm.py
test_07_reboot_ssvm	Failure	0.05	test_ssvm.py
test_08_reboot_cpvm	Failure	0.05	test_ssvm.py
test_09_reboot_ssvm_forced	Failure	0.04	test_ssvm.py
test_10_reboot_cpvm_forced	Failure	0.04	test_ssvm.py
test_11_destroy_ssvm	Failure	0.04	test_ssvm.py
test_12_destroy_cpvm	Error	1.16	test_ssvm.py
ContextSuite context=TestIpv6Vpc>:setup	Error	0.00	test_vpc_ipv6.py
ContextSuite context=TestVMWareStoragePolicies>:setup	Error	0.00	test_storage_policy.py
test_02_create_template_with_checksum_sha1	Error	65.80	test_templates.py
test_03_create_template_with_checksum_sha256	Error	65.76	test_templates.py
test_04_create_template_with_checksum_md5	Error	65.69	test_templates.py
test_05_create_template_with_no_checksum	Error	65.75	test_templates.py
ContextSuite context=TestTemplates>:setup	Error	12.04	test_templates.py
ContextSuite context=TestISOUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestLBRuleUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestNatRuleUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestPublicIPUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestSnapshotUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestVmUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestVolumeUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestVpnUsage>:setup	Error	0.00	test_usage.py
ContextSuite context=TestVmAutoScaling>:setup	Error	0.00	test_vm_autoscaling.py
test_01_deploy_vm_on_specific_host	Error	1.45	test_vm_deployment_planner.py
test_02_deploy_vm_on_specific_cluster	Error	1.40	test_vm_deployment_planner.py
test_03_deploy_vm_on_specific_pod	Error	1.36	test_vm_deployment_planner.py
test_04_deploy_vm_on_host_override_pod_and_cluster	Error	1.40	test_vm_deployment_planner.py
test_05_deploy_vm_on_cluster_override_pod	Error	1.35	test_vm_deployment_planner.py
ContextSuite context=TestDeployVM>:setup	Error	0.00	test_vm_life_cycle.py
test_01_offline_migrate_VM_and_root_volume	Error	1.45	test_vm_life_cycle.py
test_02_offline_migrate_VM_with_two_data_disks	Error	1.33	test_vm_life_cycle.py
test_03_live_migrate_VM_with_two_data_disks	Error	1.30	test_vm_life_cycle.py
test_04_migrate_detached_volume	Error	1.35	test_vm_life_cycle.py
ContextSuite context=TestVAppsVM>:setup	Error	1522.77	test_vm_life_cycle.py
ContextSuite context=TestVMLifeCycle>:setup	Error	1529.49	test_vm_life_cycle.py
test_01_unmanage_vm_cycle	Error	3.88	test_vm_lifecycle_unmanage_import.py
ContextSuite context=TestUnmanageVM>:teardown	Error	3.92	test_vm_lifecycle_unmanage_import.py
ContextSuite context=TestVMSchedule>:setup	Error	0.00	test_vm_schedule.py
ContextSuite context=TestMigrateVMStrictTags>:setup	Error	0.00	test_vm_strict_host_tags.py
ContextSuite context=TestRestoreVMStrictTags>:setup	Error	0.00	test_vm_strict_host_tags.py
ContextSuite context=TestScaleVMStrictTags>:setup	Error	0.00	test_vm_strict_host_tags.py
ContextSuite context=TestVMDeploymentPlannerStrictTags>:setup	Error	0.00	test_vm_strict_host_tags.py
ContextSuite context=TestVPCRedundancy>:setup	Error	0.00	test_vpc_redundant.py
ContextSuite context=TestVPCNics>:setup	Error	0.00	test_vpc_router_nics.py
ContextSuite context=TestRVPCSite2SiteVpn>:setup	Error	0.00	test_vpc_vpn.py
ContextSuite context=TestVPCSite2SiteVPNMultipleOptions>:setup	Error	0.00	test_vpc_vpn.py
ContextSuite context=TestVpcRemoteAccessVpn>:setup	Error	0.00	test_vpc_vpn.py
ContextSuite context=TestVpcSite2SiteVpn>:setup	Error	0.00	test_vpc_vpn.py
test_02_cancel_host_maintenace_with_migration_jobs	Error	1.65	test_host_maintenance.py
test_03_cancel_host_maintenace_with_migration_jobs_failure	Error	4.47	test_host_maintenance.py