mesa/.gitlab-ci
Eric Anholt bf29daa1b5 ci/deqp: Switch to a new dEQP runner written in Rust.
I found the C++ runner hard to develop on, and we had stability issues and
outstanding feature needs that made me want something I felt good about
hacking on.  Thus, Rewrite It In Rust of the deqp runner.

The new runner includes:

- Skip lists don't reshuffle the test list.
- Known-flake handling without resorting to skip lists (fixing our main CI
  reliability issue on a3xx right now).
- Per-thread Vulkan shader caches should speed up VK CI runtime.
- Tracking of crashes separate from fails (so we can see progress on that
  front).
- Logging of deqp stderr spam (particularly assertion failures!) in the CI
  log.
- Integrated QPA filtering so we don't have bash perf issues for it.
- Logging of what caselist to go look at for a given error report (in red,
  so it's easier to find in your CI log).
- The code is 1/3 unit tests, and easy to extend for more coverage.
- Non-LAVA CI runs create a failures.csv in artifacts that you can check
  in as your deqp-*-fails.txt file.
- Test runtime is included in results.csv so you can debug how to speed up
  your CI job.
- Pretty summary at the end of the run of slow/flaky/failed tests.

Since this is a new runner with a different RNG, the test groups are
shuffled one more time.  This seems to result in some panfrost T720
stability issues (See its new deqp-panfrost-t720-flakes.txt), and one new
flake in freedreno a630.

Reviewed-by: Tomeu Vizoso <tomeu.vizoso@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/7434>
2020-11-06 19:48:39 +00:00
..
bare-metal ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
container ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
fossils gitlab-ci: attach the Fossilize log file as artifact on failure 2020-06-26 06:45:23 +00:00
piglit CI: remove llvmpipe cl flake test 2020-10-28 05:18:54 +10:00
tracie tracie: Produce JUnit XML results 2020-09-08 10:44:52 +03:00
windows CI: Windows: Use separate config file for Docker 2020-08-28 10:15:40 +00:00
arm.config gitlab-ci: Build kernel drivers for a few ethernet USB dongles 2020-07-07 11:52:30 +00:00
arm64.config ci: Update kernel for LAVA 2020-10-08 12:14:59 +02:00
build-apitrace.sh ci: Switch to using gold as the linker. 2020-08-31 17:50:30 +00:00
build-deqp-runner.sh ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
build-deqp.sh ci: fix deqp clone + fetch 2020-10-10 06:12:43 +10:00
build-fossilize.sh
build-gfxreconstruct.sh gitlab-ci: build gfxreconstruct from the "dev" branch 2020-07-21 16:41:22 +00:00
build-libclc.sh ci: enable piglit testing of clover/llvmpipe. 2020-10-08 00:41:30 +00:00
build-libdrm.sh ci: do not build libdrm for vc4, reedreno and etnaviv 2020-09-10 14:13:37 +00:00
build-piglit.sh ci: piglit: conditionally build OpenCL tests 2020-10-10 11:56:03 +00:00
build-renderdoc.sh ci: Include trace replay support in ARM rootfses. 2020-06-25 17:33:28 +00:00
build-rust.sh ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
build-spirv-tools.sh CI: build our own spirv tools 2020-10-10 06:13:17 +10:00
build-virglrenderer.sh
build-vulkantools.sh
create-android-cross-file.sh ci/android: Switch to using the Android NDK. 2020-10-14 16:54:59 +00:00
create-android-ndk-pc.sh ci/android: Switch to using the Android NDK. 2020-10-14 16:54:59 +00:00
create-cross-file.sh ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
create-rootfs.sh ci: move to using clang 10 for meson + clover 2020-10-08 04:23:41 +10:00
cross-xfail-i386
cross-xfail-ppc64el
cross-xfail-s390x
deqp-default-skips.txt
deqp-freedreno-a307-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-freedreno-a307-flakes.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-freedreno-a530-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-freedreno-a530-flakes.txt ci/freedreno: List more common flakes reported recently. 2020-08-20 23:59:50 +00:00
deqp-freedreno-a630-565nozs-fails.txt ci: Enable remaining (non-rotate) mustpass CTS tests 2020-09-29 19:58:50 +00:00
deqp-freedreno-a630-bypass-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-freedreno-a630-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-freedreno-a630-flakes.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-freedreno-a630-multisample-fails.txt ci: Enable remaining (non-rotate) mustpass CTS tests 2020-09-29 19:58:50 +00:00
deqp-lima-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-lima-skips.txt
deqp-llvmpipe-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-panfrost-g52-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-panfrost-g52-flakes.txt ci: Update dEQP skips and fails for Bifrost on G52 2020-11-05 17:09:53 +01:00
deqp-panfrost-g52-skips.txt ci: Update dEQP skips and fails for Bifrost on G52 2020-11-05 17:09:53 +01:00
deqp-panfrost-t720-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-panfrost-t720-flakes.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-panfrost-t720-skips.txt panfrost: Report CAPs more honestly 2020-07-16 19:59:43 +00:00
deqp-panfrost-t760-fails.txt panfrost: Use Midgard-specific reloads 2020-07-16 15:10:55 +00:00
deqp-panfrost-t760-skips.txt
deqp-panfrost-t820-fails.txt panfrost: Use Midgard-specific reloads 2020-07-16 15:10:55 +00:00
deqp-panfrost-t820-skips.txt
deqp-panfrost-t860-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-panfrost-t860-skips.txt gitlab-ci: Run all of GLES3 tests for Panfrost 2020-07-16 21:18:45 +00:00
deqp-radeonsi-stoney-fails.txt ci: Build kernels and rootfs for x86 devices 2020-07-29 12:41:45 +00:00
deqp-radeonsi-stoney-skips.txt ci: Build kernels and rootfs for x86 devices 2020-07-29 12:41:45 +00:00
deqp-radv-default-skips.txt ci: add dEQP-VK.info.device_extensions to the list of skipped tests 2020-09-28 06:32:18 +00:00
deqp-radv-fiji-aco-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-radv-navi10-aco-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-radv-navi14-aco-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-radv-pitcairn-aco-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-radv-polaris10-aco-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-radv-polaris10-skips.txt
deqp-radv-raven-aco-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-radv-raven-aco-skips.txt
deqp-radv-vega10-aco-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-runner.sh ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-softpipe-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-softpipe-flakes.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-softpipe-skips.txt ci: Add the new timeout-prone softpipe-gl test to the skips list. 2020-10-22 16:49:41 +00:00
deqp-virgl-gl-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
deqp-virgl-gl-skips.txt CI: Skip flaky CS test on VirGL 2020-08-18 09:11:37 +02:00
deqp-virgl-gles-fails.txt ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
docs docs: Move the current CI .rst doc to docs/ci/ and link to it from .gitlab-ci. 2020-07-08 20:13:11 +00:00
download-git-cache.sh CI: reduce bandwidth for git pull 2020-07-03 09:44:36 +02:00
fossilize-runner.sh gitlab-ci: attach the Fossilize log file as artifact on failure 2020-06-26 06:45:23 +00:00
fossils.yml gitlab-ci: add parallel-rdp fossils 2020-06-25 08:03:09 +02:00
generate_lava.py ci: Set date in LAVA DUTs from NTP servers 2020-07-31 14:14:38 +02:00
lava-deqp.yml.jinja2 ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
lava-gitlab-ci.yml ci/deqp: Switch to a new dEQP runner written in Rust. 2020-11-06 19:48:39 +00:00
lava-tracie.yml.jinja2 ci: Distribute ADMGPU driver to LAVA as a module 2020-11-05 17:09:58 +01:00
meson-build.bat
meson-build.sh
prepare-artifacts.sh ci/deqp-runner: Add a post-deqp-run filter list for known flakes. 2020-08-20 23:59:50 +00:00
run-shader-db.sh ci: Use FDO_CI_CONCURRENT in run-shader-db.sh as well 2020-07-23 09:26:30 +00:00
scons-build.sh
test-source-dep.yml CI: Only run OpenCL tests when we need to 2020-10-27 12:37:11 +00:00
traces-freedreno.yml nir: scalarize fdot in reverse 2020-11-03 14:56:00 +00:00
traces-llvmpipe.yml nir: scalarize fdot in reverse 2020-11-03 14:56:00 +00:00
traces-panfrost.yml panfrost: Z16 depth buffer support 2020-10-27 17:11:47 +00:00
traces-radeonsi.yml nir: scalarize fdot in reverse 2020-11-03 14:56:00 +00:00
traces-radv.yml ci: Split traces.yml file per driver 2020-08-19 07:47:48 +02:00
traces-virgl.yml nir/algebraic: better propagate constants up fadd chains 2020-11-03 14:56:00 +00:00
tracie-runner-gl.sh tracie: Make tests independent of environment 2020-09-08 10:43:07 +03:00
tracie-runner-vk.sh ci: Split traces.yml file per driver 2020-08-19 07:47:48 +02:00
x86_64-w64-mingw32
x86_64.config ci: Distribute ADMGPU driver to LAVA as a module 2020-11-05 17:09:58 +01:00