[PATCH 0/5] testing/next - arm custom runner tweaks

Alex Bennée posted 5 patches 1 month ago
Patches applied successfully (tree, apply log)
git fetch https://github.com/patchew-project/qemu tags/patchew/20251014104323.3023714-1-alex.bennee@linaro.org
Maintainers: "Alex Bennée" <alex.bennee@linaro.org>, "Philippe Mathieu-Daudé" <philmd@linaro.org>, Thomas Huth <thuth@redhat.com>
.../custom-runners/ubuntu-24.04-aarch32.yml   |  15 +-
.../custom-runners/ubuntu-24.04-aarch64.yml   | 230 ++++++++----------
scripts/ci/setup/ubuntu/build-environment.yml |  22 +-
.../ci/setup/ubuntu/ubuntu-2404-aarch64.yaml  |   4 +-
...armhf-cross.yml => ubuntu-2404-armhf.yaml} |  67 +----
.../ci/setup/ubuntu/ubuntu-2404-s390x.yaml    |   4 +-
tests/docker/dockerfiles/alpine.docker        |  10 +-
tests/docker/dockerfiles/centos9.docker       |  10 +-
.../dockerfiles/debian-amd64-cross.docker     |  16 +-
.../dockerfiles/debian-arm64-cross.docker     |  16 +-
.../dockerfiles/debian-armhf-cross.docker     |  16 +-
.../dockerfiles/debian-i686-cross.docker      |  16 +-
.../dockerfiles/debian-mips64el-cross.docker  |  16 +-
.../dockerfiles/debian-mipsel-cross.docker    |  16 +-
.../dockerfiles/debian-ppc64el-cross.docker   |  16 +-
.../dockerfiles/debian-riscv64-cross.docker   |  16 +-
.../dockerfiles/debian-s390x-cross.docker     |  16 +-
tests/docker/dockerfiles/debian.docker        |  10 +-
.../dockerfiles/fedora-rust-nightly.docker    |  10 +-
.../dockerfiles/fedora-win64-cross.docker     |  14 +-
tests/docker/dockerfiles/fedora.docker        |  10 +-
tests/docker/dockerfiles/opensuse-leap.docker |  10 +-
tests/docker/dockerfiles/ubuntu2204.docker    |  10 +-
tests/lcitool/libvirt-ci                      |   2 +-
tests/lcitool/refresh                         |  11 +
25 files changed, 259 insertions(+), 324 deletions(-)
rename scripts/ci/setup/ubuntu/{ubuntu-2204-armhf-cross.yml => ubuntu-2404-armhf.yaml} (63%)
[PATCH 0/5] testing/next - arm custom runner tweaks
Posted by Alex Bennée 1 month ago
This isn't quite ready yet as there is an in-flight MR for libvirt-ci
and the final patch has to manually drop a couple of packages which
don't cleanly install. I don't know if we should deal with that
upstream or in the lcitool metadata. For reference the two packages
are:

  libcurl4-gnutls-dev:armhf
  libglusterfs-dev:armhf

which I don't think are crucial to coverage. The main motivation was
to include the crypto libs so the block io tests don't fail.

However the the bulk of it works to:

  - improve utilisation of the new CI machines
  - remove hacks that get in the way of private test runners
  - fully drive ansible packages with lcitool
  - widen the testing of 32 bit Arm on the custom runner

Please review.

Alex.

Alex Bennée (5):
  tests/lcitool: bump to latest version and regenerate (!wait on
    upstream)
  gitlab: use template for ubuntu-24.04-aarch64 jobs
  gitlab: modernise the ubuntu24.04-aarch32 jobs
  scripts/setup: update the armhf overlay
  scripts/setup: update build-environment to use armhf yaml (!WIP)

 .../custom-runners/ubuntu-24.04-aarch32.yml   |  15 +-
 .../custom-runners/ubuntu-24.04-aarch64.yml   | 230 ++++++++----------
 scripts/ci/setup/ubuntu/build-environment.yml |  22 +-
 .../ci/setup/ubuntu/ubuntu-2404-aarch64.yaml  |   4 +-
 ...armhf-cross.yml => ubuntu-2404-armhf.yaml} |  67 +----
 .../ci/setup/ubuntu/ubuntu-2404-s390x.yaml    |   4 +-
 tests/docker/dockerfiles/alpine.docker        |  10 +-
 tests/docker/dockerfiles/centos9.docker       |  10 +-
 .../dockerfiles/debian-amd64-cross.docker     |  16 +-
 .../dockerfiles/debian-arm64-cross.docker     |  16 +-
 .../dockerfiles/debian-armhf-cross.docker     |  16 +-
 .../dockerfiles/debian-i686-cross.docker      |  16 +-
 .../dockerfiles/debian-mips64el-cross.docker  |  16 +-
 .../dockerfiles/debian-mipsel-cross.docker    |  16 +-
 .../dockerfiles/debian-ppc64el-cross.docker   |  16 +-
 .../dockerfiles/debian-riscv64-cross.docker   |  16 +-
 .../dockerfiles/debian-s390x-cross.docker     |  16 +-
 tests/docker/dockerfiles/debian.docker        |  10 +-
 .../dockerfiles/fedora-rust-nightly.docker    |  10 +-
 .../dockerfiles/fedora-win64-cross.docker     |  14 +-
 tests/docker/dockerfiles/fedora.docker        |  10 +-
 tests/docker/dockerfiles/opensuse-leap.docker |  10 +-
 tests/docker/dockerfiles/ubuntu2204.docker    |  10 +-
 tests/lcitool/libvirt-ci                      |   2 +-
 tests/lcitool/refresh                         |  11 +
 25 files changed, 259 insertions(+), 324 deletions(-)
 rename scripts/ci/setup/ubuntu/{ubuntu-2204-armhf-cross.yml => ubuntu-2404-armhf.yaml} (63%)

-- 
2.47.3


Re: [PATCH 0/5] testing/next - arm custom runner tweaks
Posted by Thomas Huth 1 month ago
On 14/10/2025 12.43, Alex Bennée wrote:
> This isn't quite ready yet as there is an in-flight MR for libvirt-ci
> and the final patch has to manually drop a couple of packages which
> don't cleanly install. I don't know if we should deal with that
> upstream or in the lcitool metadata. For reference the two packages
> are:
> 
>    libcurl4-gnutls-dev:armhf
>    libglusterfs-dev:armhf

FYI, glusterfs is deprecated in QEMU since a while:

  https://gitlab.com/qemu-project/qemu/-/commit/b873463821343c6f702c4195f2168790b09cf44e

... so you could also add a patch that removes it from QEMU now, I guess.

  Thomas


Re: [PATCH 0/5] testing/next - arm custom runner tweaks
Posted by Alex Bennée 1 month ago
Thomas Huth <thuth@redhat.com> writes:

> On 14/10/2025 12.43, Alex Bennée wrote:
>> This isn't quite ready yet as there is an in-flight MR for libvirt-ci
>> and the final patch has to manually drop a couple of packages which
>> don't cleanly install. I don't know if we should deal with that
>> upstream or in the lcitool metadata. For reference the two packages
>> are:
>>    libcurl4-gnutls-dev:armhf
>>    libglusterfs-dev:armhf
>
> FYI, glusterfs is deprecated in QEMU since a while:
>
>  https://gitlab.com/qemu-project/qemu/-/commit/b873463821343c6f702c4195f2168790b09cf44e
>
> ... so you could also add a patch that removes it from QEMU now, I
> guess.

I can do that.


Richard and Phillipe reminded me that we are due to drop 32 bit hosts
real soon now so maybe I should just remove the runner and the hacks
needed to get it working?

>
>  Thomas

-- 
Alex Bennée
Virtualisation Tech Lead @ Linaro
Re: [PATCH 0/5] testing/next - arm custom runner tweaks
Posted by Thomas Huth 1 month ago
On 14/10/2025 19.29, Alex Bennée wrote:
> Thomas Huth <thuth@redhat.com> writes:
> 
>> On 14/10/2025 12.43, Alex Bennée wrote:
>>> This isn't quite ready yet as there is an in-flight MR for libvirt-ci
>>> and the final patch has to manually drop a couple of packages which
>>> don't cleanly install. I don't know if we should deal with that
>>> upstream or in the lcitool metadata. For reference the two packages
>>> are:
>>>     libcurl4-gnutls-dev:armhf
>>>     libglusterfs-dev:armhf
>>
>> FYI, glusterfs is deprecated in QEMU since a while:
>>
>>   https://gitlab.com/qemu-project/qemu/-/commit/b873463821343c6f702c4195f2168790b09cf44e
>>
>> ... so you could also add a patch that removes it from QEMU now, I
>> guess.
> 
> I can do that.
> 
> 
> Richard and Phillipe reminded me that we are due to drop 32 bit hosts
> real soon now so maybe I should just remove the runner and the hacks
> needed to get it working?

Let see ... the last time I tried to deprecate 32-bit arm, I've been told 
that the Raspberry Pis still use a 32-bit OS by default:

  https://lore.kernel.org/qemu-devel/F852C238-77B8-4E24-9494-8D060EB78F9F@livius.net/

... and the right time to drop 32-bit arm is when most Pi users install a 
64-bit OS by default:

  https://lore.kernel.org/qemu-devel/379B4C23-61C2-4AA3-A851-EEFC98A9AFF6@livius.net/

So looking at https://www.raspberrypi.com/software/operating-systems/ now, 
it seems like the 64-bit version is the default nowadays (at least it is the 
first option there, and no more recommendation for the 32-bit version), so 
yes, it's likely about time to get rid of the 32-bit arm hosts now!

  Thomas


Re: [PATCH 0/5] testing/next - arm custom runner tweaks
Posted by Richard Henderson 1 month ago
On 10/14/25 10:29, Alex Bennée wrote:
> Thomas Huth <thuth@redhat.com> writes:
> 
>> On 14/10/2025 12.43, Alex Bennée wrote:
>>> This isn't quite ready yet as there is an in-flight MR for libvirt-ci
>>> and the final patch has to manually drop a couple of packages which
>>> don't cleanly install. I don't know if we should deal with that
>>> upstream or in the lcitool metadata. For reference the two packages
>>> are:
>>>     libcurl4-gnutls-dev:armhf
>>>     libglusterfs-dev:armhf
>>
>> FYI, glusterfs is deprecated in QEMU since a while:
>>
>>   https://gitlab.com/qemu-project/qemu/-/commit/b873463821343c6f702c4195f2168790b09cf44e
>>
>> ... so you could also add a patch that removes it from QEMU now, I
>> guess.
> 
> I can do that.
> 
> 
> Richard and Phillipe reminded me that we are due to drop 32 bit hosts
> real soon now so maybe I should just remove the runner and the hacks
> needed to get it working?

I think that's for the best.


r~