ReFrame 4.2.2

Release Notes

Enhancements

• Add note about test generation options and --ci-generate (#2929)
• Fail on errors in bootstrap.sh and add a new --ignore-errors option (#2925)
• Fix broken docs links in valid_systems and valid_prog_environs sections (#2920)
• Fixed a typo in documentation - JobLaucher to JobLauncher (#2922)
• Fix broken formatting in extractall_s() docs (#2921)
• Update Slack link in README_minimal.md (#2891)

Bug fixes

• Properly dump json_formatter with --show-config option (#2930)
• Use tests's short name as the name of the job (#2928)
• Properly cleanup resources of dependencies when their dependents are filtered (#2927)

ReFrame 4.2.1

Release Notes

Enhancements

• Improve docs on how access options are treated for PBS-based backends (#2889)
• List the httpjson and filelog handlers as perflog handlers only (#2878)
• Add EUM'23 slides (#2881, #2888)
• New tutorial example on how to use make_test() (#2866)

Bug fixes

• Fix definition of default values for sched_options parameters (#2885)
• Fix in-class updates of inherited mutable variables (#2880)

Other

• Update requests package version and add a Python 3.6 disclaimer (#2883)

ReFrame 4.2.0

Release Notes

New features

• Allow custom HTTP headers with the httpjson log handler (#2854)
• Add support for repeated testing through two new options: --reruns and --duration (#2839)
• Add new ci_extras test variable that allows passing test-specific options to the pipeline generated by --ci-generate (#2833)
• Add a symlink to the latest run report (#2834)
• Simplify custom user imports in tests (#2801)
• Support arbitrary Spack environment configuration (#2819)

Enhancements

• Use official Slack permanent invite link (#2862)
• Set the module of test created by make_test (#2818)

Bug fixes

• Do not symlink against report files in non-default locations (#2855)

Other

• Replace codecov with coverage in CI (#2863)

ReFrame 4.1.3

Release Notes

Bug fixes

• Fix test selection in Gitlab child pipelines (#2856)
• Fix log record attribute names of performance thresholds (#2852)

ReFrame 4.1.2

Release Notes

Enhancements

• Improve help message of --detect-host-topology option (#2835)
• Add a .readthedocs.yaml for generating the docs (#2829)

Other

• Use ghcr.io to retrieve CI images (#2831)

ReFrame 4.1.1

Release Notes

Enhancements

• Include log files in the run report (#2828)
• Add a note about sched_options being broken in 4.0 (#2827)
• Provide further documentation about the pipeline_timeout attribute (#2816)
• Fix typo in make_test docs (#2817)

Bug fixes

• Allow proper assignment of time_limit from command line (#2823)

Test library

• Set executable_opts of GPU burn test in a pre-run hook (#2826)

ReFrame 4.1.0

Release Notes

Changes since 4.0.5

New features

• Introduce a --dry-run option (#2746)
• Allow num_tasks to be None (#2778)
• Allow custom JSON formatting for log records in the httpjson handler (#2752)
• Print the first lines of stderr and stdout in case of sanity failures (#2762)
• Relax the regex matching for test names and tags (#2736)

Enhancements

• Properly combine append-type command-line options defined in execution modes (#2788)

Bug fixes

• Fix listing of non-fixture-based dependencies (#2798)
• Fix use of sched_options by the backend schedulers (#2796)

Other

• Update GitHub Actions to use setup-python@v4 (#2775)

ReFrame 4.0.5

Release Notes

Enhancements

• Warn if an invalid mode option is passed to --mode (#2790)
• Print the fixture variable names in test listings (#2783)

Bug fixes

• Properly define sched_options in the configuration schema (#2793)
• Do not issue a name conflict error for the same fixture imported from different test files (#2780)
• Register performance functions even if perf_variables are defined in the class body and improve the performance function docs (#2770)
• Correctly silence the stream handlers only when the -q option is passed (#2786)

Other

• Use release/v1 version for the publish Github action (#2791)
• Improve the release notes generation (#2782)

ReFrame 4.0.4

Release Notes

Bug fixes

• Warn for unset variables only for the tests that are selected (#2774)

Test library

• Update the syntax of the ipcmagic hpclib test to match ipcmagic-1.1.0 (#2777)

ReFrame 4.0.3

Release Notes

New features and enhancements

n/a

Bug fixes

• Fix confusing stack trace dump when a logging error occurs (#2769)
• Pass long job options with = (#2766)
• Fix broken --cpu-only and --gpu-only options (#2765)
• Fix performance logging when perf_variables are set in a performance stage hook (#2751)

Test library

• Change execution stage in OSU test library (#2767)

Other

• Use master branch for deployment (#2750)