Testing Farm release 2023-04.1

Testing Farm release 2023-04.1 is deployed 🎉.

Incompatible Changes

Upgrades

Highlights

  • Cloud costs reporting for Testing Farm is now available to Red Hat Ranch users. Check out the documentation for details.

  • Errors in tmt execution are now correctly shown in our Oculus results viewer (TFT-1982).

  • Support for arbitrary tmt metadata root directory is now supported via test.fmf.path in the request (TFT-1586).

  • XUnit generation delay is now mitigated (TFT-1690), a RHIVOS blocker.

  • Automatic routing to Beaker had been fixed, forcing Beaker pool is not needed anymore (TFT-2005).

  • Testing Farm 12h global timeout is not correctly enforced, customization is coming in 2023-05.1 release (TFT-1729).

  • Added support for filtering plans in the request (TFT-1532).

  • Implemented support for testing MRs with sidetags in CentOS Stream (TFT-1805).

  • Support for merging git repos has landed (TFT-756), fixing parity with Packit.

  • The -aarch64 suffix for composes in Public Ranch is not needed anymore when testing on Arm64.

Bugfixes

  • Long running jobs should be more stable now (TFT-1781).

  • Fix unexpected behaviour of is-virtualized and is-supported hardware requirements combination (TFT-1787).

  • Completely rewritten xunit generation and removed tfxunit2junit.py script from the worker (TFT-1690).

Packages

List of important packages bundled in the worker image.

❯ podman run --entrypoint rpm quay.io/testing-farm/worker:2023-03.1 -q tmt standard-test-roles ansible-core podman beakerlib | sort | uniq
ansible-core-2.14.2-2.el8.x86_64
beakerlib-1.29.3-1.el8.noarch
podman-4.3.1-2.module_el8.8.0+1254+78119b6e.x86_64
standard-test-roles-4.10-6.el8.noarch
tmt-1.22.0-1.el8.noarch

Statistics

  • Error rate ~ 4.54% in the last 30 days

  • ~ 52k testing requests in the last 30 days