Testing Farm release 2024-10.5

The result.xunit field was removed from the API. Please use result.xunit_url and download the xUnit output instead.

The Testing Farm CLI v0.0.21 has changed parsing of key=value options, which can break in certain cases. See the documentation for more details.

Tests defined directly under the discover step using the shell method are now sorted alphabetically. If you rely on specific order in which tests are executed, use explicitly the order attribute as a workaround. This change will be fixed in the next release.

Testing Farm CLI tool updated to v0.0.22, please update your installation.

Artemis was updated to v0.0.72 on both ranches.

tmt was updated to 1.39, see also release notes for 1.36, 1.37 and 1.38.

fmf was updated to 1.5.

Testing Farm onboarding to Red Hat ranch is now self service using Red Hat Employee SSO. See the onboarding documentation for more information.

Preliminary support for Image Mode for RHEL-9.6.0, Fedora-40 and CentOS-Stream 9 is available. Read more about the support and possible use cases in our RFD5.

Reservations in Public ranch do not require an ssh proxy anymore and you can directly connect to the provisioned machines and access all the ports. (TFT-2678)

Support for dedicated (non-spot) AWS instances was added in Red Hat ranch. This can help with stability of long-running tests and prevents pre-mature test machine termination by AWS. See official documentation for details how to enable this for your requests.

The TMT_SSH_* options can now be set by the requests in the environments[].tmt.environment field. This can help to workaround unstable network conditions for certain Beaker labs. (TFT-2936)

For plans the tmt running log is shown during execution. (TFT-2845)

The tmt plans workdir is exposed during tests execution. (TFT-2740)

The poweruser role was introduced, making it possible to cancel any job on Testing Farm. Improves the experience for teams using automation accounts. (TFT-2706)

Bug causing failed jobs reported as passed in some corner cases was fixed. (TFT-2847)

Fix the long-term problem with archiving causing occasionally incomplete logs. (TFT-2750)

Fix Artemis API call failed: Condition 'api_call' failed to pass within given time occasional error. (TFT-2734)

Fixed a problem when very long secrets would not be hidden in the logs. (TFT-2698)

Fix a problem when the hiding of secrets in logs was currupting yaml files. (TFT-2487)

List of important packages bundled in the worker image.

Testing Farm is on track to surpass 1.33M requests per year \o/.

The average error rate for Testing Farm was approximately 3.10%.