Testing Farm release 2024-02.1

The multihost testing from now uses tmt run provision --update-missing, see docs. This means it will update the image attribute in provision step with the environments[].compose API field only if it is not set in the plan. This might break your current multihost plans. Please update your plans accordingly.

Testing Farm CLI tool updated from v0.0.16 to v0.0.17, please update your installation.

Created RFD2 for the Testing Farm in config repo which allows configuring secrets in the repository(TFT-1813). Feel free to provide feedback to this planned major feature of Testing Farm.

Added support by selecting tmt tests by name via the --test option in CLI or test.tmt.test_name field in the API (TFT-2421).

RHEL-9.5.0 available on Red Hat ranch (TFT-2434).

CentOS Stream 10 available on Public ranch (TFT-2442).

Multi-host now uses tmt run provision --update-missing improving the multi-host testing by filling in only missing compose (TFT-2379).

Testing Farm now prints a warning when how: artemis is used in provision step (TFT-2306) and crashes when anything else other than how: container or how is unspecified (TFT-2320).

Fedora CI docs now document Testing Farm as their testing infrastructure (TFT-938).

Added support for configuring how many plans should be executed in parallel via the --parallel-limit option in the CLI or settings.pipeline.parallel-limit field in the API (TFT-2262).

Automated importing of updates-nightly composes (TFT-2401).

Added an artifacts link to results viewer page of a running TF test (TFT-2405).

Xunit is generated also in case of pipeline errors (TFT-544).

Time attribute is now show in xunit and results viewer (TFT-2007).

Test environment variable TESTING_FARM_REQUEST_USERNAME is now available again (TFT-2433).

Leakage of secrets in testout.log was fixed (TFT-2462).

Fixed a bug where volumes from deployments in EKS clusters were not tagged (TFT-2313).

Fixed showing incomplete pipeline.log file in the artifacts (TFT-2451).

Fixed incorrect Beaker filter for virtualization.is-supported and aarch64 (TFT-2453).

Fixed an issue with artifact artifaction at the end of the pipeline (TFT-2413).

We would like to thank the following external contributors for contributing to Testing Farm.

List of important packages bundled in the worker image.

Testing Farm is on track to surpass 1.1M requests per year \o/.

Error rate in February was approximately 2.88%.

Around 98k testing requests were recorded in February.

Average queue time in February was 1.33 minutes on the Public ranch and 3.54 minutes on the Red Hat ranch.