[PATCH v3 0/6] drm/ci: uprev mesa/IGT and generate testlist

Vignesh Raman posted 6 patches 3 months, 3 weeks ago
drivers/gpu/drm/ci/build-igt.sh               |   41 +-
drivers/gpu/drm/ci/build.sh                   |    6 +-
drivers/gpu/drm/ci/container.yml              |   12 +-
drivers/gpu/drm/ci/gitlab-ci.yml              |   46 +-
drivers/gpu/drm/ci/igt_runner.sh              |    9 +-
drivers/gpu/drm/ci/image-tags.yml             |    2 +-
drivers/gpu/drm/ci/lava-submit.sh             |    4 +-
drivers/gpu/drm/ci/test.yml                   |   17 +-
drivers/gpu/drm/ci/testlist.txt               | 2761 -----------------
.../gpu/drm/ci/xfails/amdgpu-stoney-fails.txt |   41 +-
.../drm/ci/xfails/amdgpu-stoney-flakes.txt    |    7 +
.../gpu/drm/ci/xfails/amdgpu-stoney-skips.txt |   33 +-
drivers/gpu/drm/ci/xfails/i915-amly-fails.txt |   31 +
.../gpu/drm/ci/xfails/i915-amly-flakes.txt    |    9 +
drivers/gpu/drm/ci/xfails/i915-amly-skips.txt |   22 +-
drivers/gpu/drm/ci/xfails/i915-apl-fails.txt  |   46 +-
drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt |    6 +
drivers/gpu/drm/ci/xfails/i915-apl-skips.txt  |   26 +-
drivers/gpu/drm/ci/xfails/i915-cml-fails.txt  |   38 +
drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt |    6 +
drivers/gpu/drm/ci/xfails/i915-cml-skips.txt  |   23 +
drivers/gpu/drm/ci/xfails/i915-glk-fails.txt  |   41 +-
drivers/gpu/drm/ci/xfails/i915-glk-flakes.txt |    7 +
drivers/gpu/drm/ci/xfails/i915-glk-skips.txt  |   26 +-
drivers/gpu/drm/ci/xfails/i915-kbl-fails.txt  |   42 +-
drivers/gpu/drm/ci/xfails/i915-kbl-flakes.txt |    7 +-
drivers/gpu/drm/ci/xfails/i915-kbl-skips.txt  |   36 +-
drivers/gpu/drm/ci/xfails/i915-tgl-fails.txt  |   77 +-
drivers/gpu/drm/ci/xfails/i915-tgl-skips.txt  |   28 +-
drivers/gpu/drm/ci/xfails/i915-whl-fails.txt  |   63 +-
drivers/gpu/drm/ci/xfails/i915-whl-flakes.txt |    6 +
drivers/gpu/drm/ci/xfails/i915-whl-skips.txt  |   22 +-
.../drm/ci/xfails/mediatek-mt8173-fails.txt   |   30 +-
.../drm/ci/xfails/mediatek-mt8173-flakes.txt  |   11 +
.../drm/ci/xfails/mediatek-mt8173-skips.txt   |   16 +
.../drm/ci/xfails/mediatek-mt8183-fails.txt   |   21 +-
.../drm/ci/xfails/mediatek-mt8183-skips.txt   |   18 +
.../gpu/drm/ci/xfails/meson-g12b-fails.txt    |   24 +-
.../gpu/drm/ci/xfails/meson-g12b-skips.txt    |   18 +
.../gpu/drm/ci/xfails/msm-apq8016-fails.txt   |   12 +-
.../gpu/drm/ci/xfails/msm-apq8016-skips.txt   |   15 +
.../gpu/drm/ci/xfails/msm-apq8096-fails.txt   |    7 +
.../gpu/drm/ci/xfails/msm-apq8096-flakes.txt  |    6 +
.../gpu/drm/ci/xfails/msm-apq8096-skips.txt   |   26 +-
.../msm-sc7180-trogdor-kingoftown-fails.txt   |  175 +-
.../msm-sc7180-trogdor-kingoftown-flakes.txt  |    8 +
.../msm-sc7180-trogdor-kingoftown-skips.txt   |   19 +
...sm-sc7180-trogdor-lazor-limozeen-fails.txt |  175 +-
...m-sc7180-trogdor-lazor-limozeen-flakes.txt |    6 +
...sm-sc7180-trogdor-lazor-limozeen-skips.txt |   16 +
.../gpu/drm/ci/xfails/msm-sdm845-fails.txt    |   38 +-
.../gpu/drm/ci/xfails/msm-sdm845-flakes.txt   |   25 +-
.../gpu/drm/ci/xfails/msm-sdm845-skips.txt    |   19 +
.../drm/ci/xfails/rockchip-rk3288-fails.txt   |   62 +-
.../drm/ci/xfails/rockchip-rk3288-skips.txt   |   21 +-
.../drm/ci/xfails/rockchip-rk3399-fails.txt   |   83 +-
.../drm/ci/xfails/rockchip-rk3399-flakes.txt  |   13 +-
.../drm/ci/xfails/rockchip-rk3399-skips.txt   |   19 +
drivers/gpu/drm/ci/xfails/update-xfails.py    |    4 +-
.../drm/ci/xfails/virtio_gpu-none-fails.txt   |   94 +-
.../drm/ci/xfails/virtio_gpu-none-skips.txt   |   20 +-
61 files changed, 1348 insertions(+), 3194 deletions(-)
delete mode 100644 drivers/gpu/drm/ci/testlist.txt
create mode 100644 drivers/gpu/drm/ci/xfails/i915-amly-flakes.txt
create mode 100644 drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt
create mode 100644 drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt
create mode 100644 drivers/gpu/drm/ci/xfails/i915-glk-flakes.txt
create mode 100644 drivers/gpu/drm/ci/xfails/i915-whl-flakes.txt
create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8173-skips.txt
create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8183-skips.txt
create mode 100644 drivers/gpu/drm/ci/xfails/meson-g12b-skips.txt
create mode 100644 drivers/gpu/drm/ci/xfails/msm-apq8016-skips.txt
create mode 100644 drivers/gpu/drm/ci/xfails/msm-apq8096-flakes.txt
create mode 100644 drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-flakes.txt
create mode 100644 drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-flakes.txt
[PATCH v3 0/6] drm/ci: uprev mesa/IGT and generate testlist
Posted by Vignesh Raman 3 months, 3 weeks ago
Uprev mesa and IGT to the latest version and stop vendoring the
testlist into the kernel. Instead, use the testlist from the
IGT build to ensure we do not miss renamed or newly added tests.
Update the xfails with the latest testlist run.

Add farm variable and update device type variable.

https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1187556

Vignesh Raman (6):
  drm/ci: uprev mesa version
  drm/ci: add farm variable
  drm/ci: generate testlist from build
  drm/ci: uprev IGT
  drm/ci: skip driver specific tests
  drm/ci: update xfails for the new testlist

 drivers/gpu/drm/ci/build-igt.sh               |   41 +-
 drivers/gpu/drm/ci/build.sh                   |    6 +-
 drivers/gpu/drm/ci/container.yml              |   12 +-
 drivers/gpu/drm/ci/gitlab-ci.yml              |   46 +-
 drivers/gpu/drm/ci/igt_runner.sh              |    9 +-
 drivers/gpu/drm/ci/image-tags.yml             |    2 +-
 drivers/gpu/drm/ci/lava-submit.sh             |    4 +-
 drivers/gpu/drm/ci/test.yml                   |   17 +-
 drivers/gpu/drm/ci/testlist.txt               | 2761 -----------------
 .../gpu/drm/ci/xfails/amdgpu-stoney-fails.txt |   41 +-
 .../drm/ci/xfails/amdgpu-stoney-flakes.txt    |    7 +
 .../gpu/drm/ci/xfails/amdgpu-stoney-skips.txt |   33 +-
 drivers/gpu/drm/ci/xfails/i915-amly-fails.txt |   31 +
 .../gpu/drm/ci/xfails/i915-amly-flakes.txt    |    9 +
 drivers/gpu/drm/ci/xfails/i915-amly-skips.txt |   22 +-
 drivers/gpu/drm/ci/xfails/i915-apl-fails.txt  |   46 +-
 drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt |    6 +
 drivers/gpu/drm/ci/xfails/i915-apl-skips.txt  |   26 +-
 drivers/gpu/drm/ci/xfails/i915-cml-fails.txt  |   38 +
 drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt |    6 +
 drivers/gpu/drm/ci/xfails/i915-cml-skips.txt  |   23 +
 drivers/gpu/drm/ci/xfails/i915-glk-fails.txt  |   41 +-
 drivers/gpu/drm/ci/xfails/i915-glk-flakes.txt |    7 +
 drivers/gpu/drm/ci/xfails/i915-glk-skips.txt  |   26 +-
 drivers/gpu/drm/ci/xfails/i915-kbl-fails.txt  |   42 +-
 drivers/gpu/drm/ci/xfails/i915-kbl-flakes.txt |    7 +-
 drivers/gpu/drm/ci/xfails/i915-kbl-skips.txt  |   36 +-
 drivers/gpu/drm/ci/xfails/i915-tgl-fails.txt  |   77 +-
 drivers/gpu/drm/ci/xfails/i915-tgl-skips.txt  |   28 +-
 drivers/gpu/drm/ci/xfails/i915-whl-fails.txt  |   63 +-
 drivers/gpu/drm/ci/xfails/i915-whl-flakes.txt |    6 +
 drivers/gpu/drm/ci/xfails/i915-whl-skips.txt  |   22 +-
 .../drm/ci/xfails/mediatek-mt8173-fails.txt   |   30 +-
 .../drm/ci/xfails/mediatek-mt8173-flakes.txt  |   11 +
 .../drm/ci/xfails/mediatek-mt8173-skips.txt   |   16 +
 .../drm/ci/xfails/mediatek-mt8183-fails.txt   |   21 +-
 .../drm/ci/xfails/mediatek-mt8183-skips.txt   |   18 +
 .../gpu/drm/ci/xfails/meson-g12b-fails.txt    |   24 +-
 .../gpu/drm/ci/xfails/meson-g12b-skips.txt    |   18 +
 .../gpu/drm/ci/xfails/msm-apq8016-fails.txt   |   12 +-
 .../gpu/drm/ci/xfails/msm-apq8016-skips.txt   |   15 +
 .../gpu/drm/ci/xfails/msm-apq8096-fails.txt   |    7 +
 .../gpu/drm/ci/xfails/msm-apq8096-flakes.txt  |    6 +
 .../gpu/drm/ci/xfails/msm-apq8096-skips.txt   |   26 +-
 .../msm-sc7180-trogdor-kingoftown-fails.txt   |  175 +-
 .../msm-sc7180-trogdor-kingoftown-flakes.txt  |    8 +
 .../msm-sc7180-trogdor-kingoftown-skips.txt   |   19 +
 ...sm-sc7180-trogdor-lazor-limozeen-fails.txt |  175 +-
 ...m-sc7180-trogdor-lazor-limozeen-flakes.txt |    6 +
 ...sm-sc7180-trogdor-lazor-limozeen-skips.txt |   16 +
 .../gpu/drm/ci/xfails/msm-sdm845-fails.txt    |   38 +-
 .../gpu/drm/ci/xfails/msm-sdm845-flakes.txt   |   25 +-
 .../gpu/drm/ci/xfails/msm-sdm845-skips.txt    |   19 +
 .../drm/ci/xfails/rockchip-rk3288-fails.txt   |   62 +-
 .../drm/ci/xfails/rockchip-rk3288-skips.txt   |   21 +-
 .../drm/ci/xfails/rockchip-rk3399-fails.txt   |   83 +-
 .../drm/ci/xfails/rockchip-rk3399-flakes.txt  |   13 +-
 .../drm/ci/xfails/rockchip-rk3399-skips.txt   |   19 +
 drivers/gpu/drm/ci/xfails/update-xfails.py    |    4 +-
 .../drm/ci/xfails/virtio_gpu-none-fails.txt   |   94 +-
 .../drm/ci/xfails/virtio_gpu-none-skips.txt   |   20 +-
 61 files changed, 1348 insertions(+), 3194 deletions(-)
 delete mode 100644 drivers/gpu/drm/ci/testlist.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/i915-amly-flakes.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/i915-glk-flakes.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/i915-whl-flakes.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8173-skips.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8183-skips.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/meson-g12b-skips.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/msm-apq8016-skips.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/msm-apq8096-flakes.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-flakes.txt
 create mode 100644 drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-flakes.txt

-- 
2.40.1
Re: [PATCH v3 0/6] drm/ci: uprev mesa/IGT and generate testlist
Posted by Helen Koike 3 months, 2 weeks ago

On 28/05/2024 23:40, Vignesh Raman wrote:
> Uprev mesa and IGT to the latest version and stop vendoring the
> testlist into the kernel. Instead, use the testlist from the
> IGT build to ensure we do not miss renamed or newly added tests.
> Update the xfails with the latest testlist run.
> 
> Add farm variable and update device type variable.
> 
> https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1187556
> 
> Vignesh Raman (6):
>    drm/ci: uprev mesa version
>    drm/ci: add farm variable
>    drm/ci: generate testlist from build
>    drm/ci: uprev IGT
>    drm/ci: skip driver specific tests
>    drm/ci: update xfails for the new testlist
> 
>   drivers/gpu/drm/ci/build-igt.sh               |   41 +-
>   drivers/gpu/drm/ci/build.sh                   |    6 +-
>   drivers/gpu/drm/ci/container.yml              |   12 +-
>   drivers/gpu/drm/ci/gitlab-ci.yml              |   46 +-
>   drivers/gpu/drm/ci/igt_runner.sh              |    9 +-
>   drivers/gpu/drm/ci/image-tags.yml             |    2 +-
>   drivers/gpu/drm/ci/lava-submit.sh             |    4 +-
>   drivers/gpu/drm/ci/test.yml                   |   17 +-
>   drivers/gpu/drm/ci/testlist.txt               | 2761 -----------------
>   .../gpu/drm/ci/xfails/amdgpu-stoney-fails.txt |   41 +-
>   .../drm/ci/xfails/amdgpu-stoney-flakes.txt    |    7 +
>   .../gpu/drm/ci/xfails/amdgpu-stoney-skips.txt |   33 +-
>   drivers/gpu/drm/ci/xfails/i915-amly-fails.txt |   31 +
>   .../gpu/drm/ci/xfails/i915-amly-flakes.txt    |    9 +
>   drivers/gpu/drm/ci/xfails/i915-amly-skips.txt |   22 +-
>   drivers/gpu/drm/ci/xfails/i915-apl-fails.txt  |   46 +-
>   drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt |    6 +
>   drivers/gpu/drm/ci/xfails/i915-apl-skips.txt  |   26 +-
>   drivers/gpu/drm/ci/xfails/i915-cml-fails.txt  |   38 +
>   drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt |    6 +
>   drivers/gpu/drm/ci/xfails/i915-cml-skips.txt  |   23 +
>   drivers/gpu/drm/ci/xfails/i915-glk-fails.txt  |   41 +-
>   drivers/gpu/drm/ci/xfails/i915-glk-flakes.txt |    7 +
>   drivers/gpu/drm/ci/xfails/i915-glk-skips.txt  |   26 +-
>   drivers/gpu/drm/ci/xfails/i915-kbl-fails.txt  |   42 +-
>   drivers/gpu/drm/ci/xfails/i915-kbl-flakes.txt |    7 +-
>   drivers/gpu/drm/ci/xfails/i915-kbl-skips.txt  |   36 +-
>   drivers/gpu/drm/ci/xfails/i915-tgl-fails.txt  |   77 +-
>   drivers/gpu/drm/ci/xfails/i915-tgl-skips.txt  |   28 +-
>   drivers/gpu/drm/ci/xfails/i915-whl-fails.txt  |   63 +-
>   drivers/gpu/drm/ci/xfails/i915-whl-flakes.txt |    6 +
>   drivers/gpu/drm/ci/xfails/i915-whl-skips.txt  |   22 +-
>   .../drm/ci/xfails/mediatek-mt8173-fails.txt   |   30 +-
>   .../drm/ci/xfails/mediatek-mt8173-flakes.txt  |   11 +
>   .../drm/ci/xfails/mediatek-mt8173-skips.txt   |   16 +
>   .../drm/ci/xfails/mediatek-mt8183-fails.txt   |   21 +-
>   .../drm/ci/xfails/mediatek-mt8183-skips.txt   |   18 +
>   .../gpu/drm/ci/xfails/meson-g12b-fails.txt    |   24 +-
>   .../gpu/drm/ci/xfails/meson-g12b-skips.txt    |   18 +
>   .../gpu/drm/ci/xfails/msm-apq8016-fails.txt   |   12 +-
>   .../gpu/drm/ci/xfails/msm-apq8016-skips.txt   |   15 +
>   .../gpu/drm/ci/xfails/msm-apq8096-fails.txt   |    7 +
>   .../gpu/drm/ci/xfails/msm-apq8096-flakes.txt  |    6 +
>   .../gpu/drm/ci/xfails/msm-apq8096-skips.txt   |   26 +-
>   .../msm-sc7180-trogdor-kingoftown-fails.txt   |  175 +-
>   .../msm-sc7180-trogdor-kingoftown-flakes.txt  |    8 +
>   .../msm-sc7180-trogdor-kingoftown-skips.txt   |   19 +
>   ...sm-sc7180-trogdor-lazor-limozeen-fails.txt |  175 +-
>   ...m-sc7180-trogdor-lazor-limozeen-flakes.txt |    6 +
>   ...sm-sc7180-trogdor-lazor-limozeen-skips.txt |   16 +
>   .../gpu/drm/ci/xfails/msm-sdm845-fails.txt    |   38 +-
>   .../gpu/drm/ci/xfails/msm-sdm845-flakes.txt   |   25 +-
>   .../gpu/drm/ci/xfails/msm-sdm845-skips.txt    |   19 +
>   .../drm/ci/xfails/rockchip-rk3288-fails.txt   |   62 +-
>   .../drm/ci/xfails/rockchip-rk3288-skips.txt   |   21 +-
>   .../drm/ci/xfails/rockchip-rk3399-fails.txt   |   83 +-
>   .../drm/ci/xfails/rockchip-rk3399-flakes.txt  |   13 +-
>   .../drm/ci/xfails/rockchip-rk3399-skips.txt   |   19 +
>   drivers/gpu/drm/ci/xfails/update-xfails.py    |    4 +-
>   .../drm/ci/xfails/virtio_gpu-none-fails.txt   |   94 +-
>   .../drm/ci/xfails/virtio_gpu-none-skips.txt   |   20 +-
>   61 files changed, 1348 insertions(+), 3194 deletions(-)
>   delete mode 100644 drivers/gpu/drm/ci/testlist.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/i915-amly-flakes.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/i915-glk-flakes.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/i915-whl-flakes.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8173-skips.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8183-skips.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/meson-g12b-skips.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/msm-apq8016-skips.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/msm-apq8096-flakes.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-flakes.txt
>   create mode 100644 drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-flakes.txt
> 


Applied to drm-misc-next

Thanks
Helen