weston/tests
Pekka Paalanen a5a2b3abb1 tests/color-icc-output: gate by average error as well
Maximum error is fragile: radeonsi on Polaris 11 has one error spike
that would force the the tolerances for everything to be much higher
than desired, and it masks changes to usual error levels.

Add a new condition to opaque_pixel_conversion: average two-norm error
statistic. The average is not as susceptible to outliers as maximum is.
We still keep the maximum error tolerance as well, to detect gross
outliers that might not sway the average enough to cause a test failure.

The new average error tolerances have been collected from the worst case
among the following + 0.01:
- GL renderer: Mesa Intel(R) HD Graphics 4600 (HSW GT2)
- GL renderer: AMD Radeon RX 550 Series (radeonsi, polaris11, ACO,
  DRM 3.61, 6.12.35+deb13-amd64)
- GL renderer: llvmpipe (LLVM 19.1.7, 256 bits)

(There is no need to separately print matrix vs. clut, it is already in
the fixture name.)

Signed-off-by: Pekka Paalanen <pekka.paalanen@collabora.com>
2025-07-24 11:30:07 +03:00
..
reference color-lcms: change stock sRGB to true power-2.2 2025-06-03 15:47:20 +03:00
visualization tests/alpha-blending: replace compare_float() with rgb_diff_stat 2022-06-30 09:08:32 +00:00
alpha-blending-test.c color-lcms: change stock sRGB to true power-2.2 2025-06-03 15:47:20 +03:00
assert-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
bad-buffer-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
buffer-transforms-test.c tests: Add support for Vulkan renderer 2025-05-23 20:36:05 +01:00
client-buffer-test.c tests: Add support for Vulkan renderer 2025-05-23 20:36:05 +01:00
color-icc-output-test.c tests/color-icc-output: gate by average error as well 2025-07-24 11:30:07 +03:00
color-lcms-optimizer-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
color-management-parametric-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
color-management-test.c tests: drop EOTF from TRANSFER_FN_SRGB_EOTF 2025-06-03 15:47:20 +03:00
color-math-test.c tests: add color-math-test 2025-05-13 17:36:52 +03:00
color-metadata-errors-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
color-metadata-parsing-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
color_util.c color-lcms: change stock sRGB to true power-2.2 2025-06-03 15:47:20 +03:00
color_util.h tests/color_util: add power-2.2 transfer function 2025-06-03 15:47:20 +03:00
config-parser-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
constraints-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
custom-env-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
devices-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
drm-formats-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
drm-smoke-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
drm-writeback-screenshot-test.c tests: Use new buffer for second screenshot 2025-07-17 10:42:30 +03:00
event-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
idalloc-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
image-iter.h tests: Port all test clients to the new test asserts 2025-02-26 23:50:41 +01:00
input-timestamps-helper.c tests: Port all test clients to the new test asserts 2025-02-26 23:50:41 +01:00
input-timestamps-helper.h tests: Introduce input timestamps helper 2018-02-20 10:20:29 +02:00
internal-screenshot-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
iterate-debug-scopes-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
ivi-layout-internal-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
ivi-layout-test-client.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
ivi-layout-test-plugin.c Revert "shared/helpers.h: Migrate helpers.h to libweston" 2025-01-17 10:18:26 +02:00
ivi-shell-app-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
ivi-test.h ivi-shell: implement surface_on_many_layer test 2016-06-29 11:32:23 +03:00
keyboard-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
kiosk-shell-test.c weston-test-client-helper: Move helpers into weston-test-client-helper 2025-05-06 15:27:58 +03:00
lcms-util-test.c tests: drop EOTF from TRANSFER_FN_SRGB_EOTF 2025-06-03 15:47:20 +03:00
lcms_util.c color-lcms: change stock sRGB to true power-2.2 2025-06-03 15:47:20 +03:00
lcms_util.h tests: replace lcmsMAT3 with weston_mat3f 2025-04-01 15:59:54 +03:00
linalg-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
linux-explicit-synchronization-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
lua-shell-test.c lua-shell: Add lua-shell 2025-06-04 15:47:06 +03:00
matrix-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
matrix-transform-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
meson.build lua-shell: Add lua-shell 2025-06-04 15:47:06 +03:00
output-capture-protocol-test.c tests: Add support for Vulkan renderer 2025-05-23 20:36:05 +01:00
output-damage-test.c tests: Add support for Vulkan renderer 2025-05-23 20:36:05 +01:00
output-decorations-test.c tests: Add support for Vulkan renderer 2025-05-23 20:36:05 +01:00
output-transforms-test.c tests: Add support for Vulkan renderer 2025-05-23 20:36:05 +01:00
paint-node-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
plugin-registry-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
pointer-shot-test.c tests: Add support for Vulkan renderer 2025-05-23 20:36:05 +01:00
pointer-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
presentation-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
roles-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
safe-signal-output-removal-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
safe-signal-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
setbacklight.c tests: Update boilerplate from MIT X11 license to MIT Expat license 2015-06-15 13:04:19 -07:00
single-pixel-buffer-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
string-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
subsurface-shot-test.c tests: Add support for Vulkan renderer 2025-05-23 20:36:05 +01:00
subsurface-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
surface-global-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
surface-screenshot-test.c Rename compositor/ to frontend/ 2023-12-18 15:34:26 +00:00
surface-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
text-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
timespec-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
touch-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
vertex-clip-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
viewporter-shot-test.c tests: Add support for Vulkan renderer 2025-05-23 20:36:05 +01:00
viewporter-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00
weston-test-assert.h tests: Don't abort on failure 2025-02-26 23:50:45 +01:00
weston-test-client-helper.c weston-test-client-helper: Move helpers into weston-test-client-helper 2025-05-06 15:27:58 +03:00
weston-test-client-helper.h weston-test-client-helper: Move helpers into weston-test-client-helper 2025-05-06 15:27:58 +03:00
weston-test-desktop-shell.c Revert "shared/helpers.h: Migrate helpers.h to libweston" 2025-01-17 10:18:26 +02:00
weston-test-fixture-compositor.c lua-shell: Add lua-shell 2025-06-04 15:47:06 +03:00
weston-test-fixture-compositor.h lua-shell: Add lua-shell 2025-06-04 15:47:06 +03:00
weston-test-runner.c gitlab-ci: Create some jobs for Vulkan build coverage 2025-05-23 20:36:05 +01:00
weston-test-runner.h tests: return status from each test definition 2025-04-30 15:07:35 +03:00
weston-test.c tests: Don't abort on failure 2025-02-26 23:50:45 +01:00
weston-testsuite-data.h tests: Don't abort on failure 2025-02-26 23:50:45 +01:00
xcb-client-helper.c tests: Port all test clients to the new test asserts 2025-02-26 23:50:41 +01:00
xcb-client-helper.h tests: Port all test clients to the new test asserts 2025-02-26 23:50:41 +01:00
xdg-client-helper.c xdg-client-helper: Use a default WINDOW size value 2025-05-06 15:30:37 +03:00
xdg-client-helper.h xdg-client-helper: Use a default WINDOW size value 2025-05-06 15:30:37 +03:00
xwayland-test.c tests: return status from each test definition 2025-04-30 15:07:35 +03:00