Hi,

This is the next iteration of my testing/next queue. The main changes
from the last post:

  https://patchew.org/QEMU/20200624140446.15380-1-alex.bennee@linaro.org/

The GitLab docker patches are almost ready although there are a couple
of problems running on GitLab's infrastructure which need to be ironed
out. I finally got the caching working so a local build is seeded from
the REGISTRY.

There is also a minor fix to optparse/argparse change for tests/vm.

There are two build fixes that I thought were going in via other trees
but I'll include them in the PR I plan to cut on Tuesday if their
respective sources haven't been merged by then.

The following need review:

  - containers.yml: build with docker.py tooling
  - gitlab: limit re-builds of the containers
  - gitlab: split build-disabled into two phases
  - gitlab: enable check-tcg for linux-user tests
  - tests/docker: add a linux-user testing focused image
  - gitlab: add acceptance testing to system builds
  - tests/docker: add packages needed for check-acceptance
  - tests/docker: add --registry support to tooling
  - gitlab: build containers with buildkit and metadata
  - .gitignore: un-ignore .gitlab-ci.d
  - tests/docker: change tag naming scheme of our images

Alex Bennée (15):
  tests/vm: switch from optsparse to argparse
  tests/vm: allow us to take advantage of MTTCG
  tests/docker: check for an parameters not empty string
  tests/docker: change tag naming scheme of our images
  .gitignore: un-ignore .gitlab-ci.d
  gitlab: build containers with buildkit and metadata
  tests/docker: add --registry support to tooling
  tests/docker: add packages needed for check-acceptance
  gitlab: add acceptance testing to system builds
  tests/docker: add a linux-user testing focused image
  gitlab: enable check-tcg for linux-user tests
  gitlab: add avocado asset caching
  gitlab: split build-disabled into two phases
  gitlab: limit re-builds of the containers
  containers.yml: build with docker.py tooling

Daniel P. Berrangé (3):
  gitlab: introduce explicit "container" and "build" stages
  gitlab: build all container images during CI
  gitlab: convert jobs to use custom built containers

David Edmondson (1):
  crypto/linux_keyring: fix 'secret_keyring' configure test

Philippe Mathieu-Daudé (1):
  iotests: Fix 051 output after qdev_init_nofail() removal

Robert Foley (9):
  tests/vm: pass args through to BaseVM's __init__
  tests/vm: Add configuration to basevm.py
  tests/vm: Added configuration file support
  tests/vm: Add common Ubuntu python module
  tests/vm: Added a new script for ubuntu.aarch64.
  tests/vm: Added a new script for centos.aarch64.
  tests/vm: change scripts to use self._config
  python/qemu: Add ConsoleSocket for optional use in QEMUMachine
  tests/vm: Add workaround to consume console

Thomas Huth (1):
  gitlab-ci: Fix the change rules after moving the YML files

 configure                                     |  31 +-
 .gitignore                                    |   1 +
 .gitlab-ci.d/containers.yml                   | 264 ++++++++++++++
 .gitlab-ci.d/edk2.yml                         |   5 +-
 .gitlab-ci.d/opensbi.yml                      |   5 +-
 .gitlab-ci.yml                                | 275 ++++++++------
 .travis.yml                                   |  23 --
 python/qemu/console_socket.py                 | 110 ++++++
 python/qemu/machine.py                        |  23 +-
 tests/docker/Makefile.include                 |   8 +-
 tests/docker/common.rc                        |   2 +-
 tests/docker/docker.py                        |  39 +-
 .../dockerfiles/debian-all-test-cross.docker  |  53 +++
 .../dockerfiles/debian-alpha-cross.docker     |   2 +-
 .../dockerfiles/debian-amd64-cross.docker     |   2 +-
 tests/docker/dockerfiles/debian-amd64.docker  |   2 +-
 .../dockerfiles/debian-arm64-cross.docker     |   2 +-
 .../debian-arm64-test-cross.docker            |   2 +-
 .../dockerfiles/debian-armel-cross.docker     |   2 +-
 .../dockerfiles/debian-armhf-cross.docker     |   2 +-
 .../dockerfiles/debian-hppa-cross.docker      |   2 +-
 .../dockerfiles/debian-m68k-cross.docker      |   2 +-
 .../dockerfiles/debian-mips-cross.docker      |   2 +-
 .../dockerfiles/debian-mips64-cross.docker    |   2 +-
 .../dockerfiles/debian-mips64el-cross.docker  |   2 +-
 .../dockerfiles/debian-mipsel-cross.docker    |   2 +-
 .../dockerfiles/debian-powerpc-cross.docker   |   2 +-
 .../dockerfiles/debian-ppc64-cross.docker     |   2 +-
 .../dockerfiles/debian-ppc64el-cross.docker   |   2 +-
 .../dockerfiles/debian-riscv64-cross.docker   |   2 +-
 .../dockerfiles/debian-s390x-cross.docker     |   2 +-
 .../dockerfiles/debian-sh4-cross.docker       |   2 +-
 .../dockerfiles/debian-sparc64-cross.docker   |   2 +-
 .../dockerfiles/debian-tricore-cross.docker   |   2 +-
 .../dockerfiles/debian-win32-cross.docker     |   2 +-
 .../dockerfiles/debian-win64-cross.docker     |   2 +-
 tests/docker/dockerfiles/debian9-mxe.docker   |   2 +-
 tests/docker/dockerfiles/fedora.docker        |   7 +
 tests/docker/dockerfiles/ubuntu2004.docker    |  10 +-
 tests/qemu-iotests/051.pc.out                 |   4 +-
 tests/vm/Makefile.include                     |  22 ++
 tests/vm/aarch64vm.py                         | 106 ++++++
 tests/vm/basevm.py                            | 339 +++++++++++++-----
 tests/vm/centos-8-aarch64.ks                  |  51 +++
 tests/vm/centos.aarch64                       | 227 ++++++++++++
 tests/vm/conf_example_aarch64.yml             |  51 +++
 tests/vm/conf_example_x86.yml                 |  50 +++
 tests/vm/fedora                               |  17 +-
 tests/vm/freebsd                              |  16 +-
 tests/vm/netbsd                               |  19 +-
 tests/vm/openbsd                              |  17 +-
 tests/vm/ubuntu.aarch64                       |  68 ++++
 tests/vm/ubuntu.i386                          |  46 +--
 tests/vm/ubuntuvm.py                          |  60 ++++
 54 files changed, 1669 insertions(+), 328 deletions(-)
 create mode 100644 .gitlab-ci.d/containers.yml
 create mode 100644 python/qemu/console_socket.py
 create mode 100644 tests/docker/dockerfiles/debian-all-test-cross.docker
 create mode 100644 tests/vm/aarch64vm.py
 create mode 100644 tests/vm/centos-8-aarch64.ks
 create mode 100755 tests/vm/centos.aarch64
 create mode 100644 tests/vm/conf_example_aarch64.yml
 create mode 100644 tests/vm/conf_example_x86.yml
 create mode 100755 tests/vm/ubuntu.aarch64
 create mode 100644 tests/vm/ubuntuvm.py

-- 
2.20.1

Patchew URL: https://patchew.org/QEMU/20200626181357.26211-1-alex.bennee@linaro.org/



Hi,

This series failed the docker-mingw@fedora build test. Please find the testing commands and
their output below. If you have Docker installed, you can probably reproduce it
locally.

=== TEST SCRIPT BEGIN ===
#! /bin/bash
export ARCH=x86_64
make docker-image-fedora V=1 NETWORK=1
time make docker-test-mingw@fedora J=14 NETWORK=1
=== TEST SCRIPT END ===

Using default tag: latest
Trying to pull repository registry.gitlab.com/stsquad/qemu/qemu/fedora ... 
Pulling repository registry.gitlab.com/stsquad/qemu/qemu/fedora
Error: image stsquad/qemu/qemu/fedora:latest not found
Sending build context to Docker daemon 4.096 kB
Step 1/9 : FROM fedora:32
 ---> 2a8d315e6208
---
 perl-Encode-devel                       x86_64  4:3.06-445.fc32                  updates   42 k
 perl-Env                                noarch  1.04-440.fc32                    fedora    19 k
 perl-Errno                              x86_64  1.30-453.fc32                    updates   24 k
 perl-Error                              noarch  1:0.17029-1.fc32                 fedora    42 k
 perl-Exporter                           noarch  5.74-2.fc32                      fedora    32 k
 perl-Exporter-Tiny                      noarch  1.002001-5.fc32                  fedora    51 k
 perl-ExtUtils-CBuilder                  noarch  1:0.280234-2.fc32                fedora    47 k
---
(633/842): perl-Encode-Locale-1.05-15.fc32.noar 159 kB/s |  19 kB     00:00    
(634/842): perl-Env-1.04-440.fc32.noarch.rpm    160 kB/s |  19 kB     00:00    
(635/842): perl-Digest-SHA-6.02-442.fc32.x86_64 149 kB/s |  64 kB     00:00    
(636/842): perl-Error-0.17029-1.fc32.noarch.rpm 201 kB/s |  42 kB     00:00    
(637/842): perl-Exporter-5.74-2.fc32.noarch.rpm 152 kB/s |  32 kB     00:00    
(638/842): perl-Exporter-Tiny-1.002001-5.fc32.n 182 kB/s |  51 kB     00:00    
(639/842): perl-ExtUtils-CBuilder-0.280234-2.fc 149 kB/s |  47 kB     00:00    
---
  Installing       : perl-DB_File-1.853-2.fc32.x86_64                   233/856 
  Installing       : perl-Devel-Size-0.83-5.fc32.x86_64                 234/856 
  Installing       : perl-Env-1.04-440.fc32.noarch                      235/856 
  Installing       : perl-Error-1:0.17029-1.fc32.noarch                 236/856 
  Installing       : perl-IPC-SysV-2.07-442.fc32.x86_64                 237/856 
  Installing       : perl-IPC-System-Simple-1.30-1.fc32.noarch          238/856 
  Installing       : perl-autodie-2.32-2.fc32.noarch                    239/856 
---
  Verifying        : perl-Digest-SHA-1:6.02-442.fc32.x86_64             634/856 
  Verifying        : perl-Encode-Locale-1.05-15.fc32.noarch             635/856 
  Verifying        : perl-Env-1.04-440.fc32.noarch                      636/856 
  Verifying        : perl-Error-1:0.17029-1.fc32.noarch                 637/856 
  Verifying        : perl-Exporter-5.74-2.fc32.noarch                   638/856 
  Verifying        : perl-Exporter-Tiny-1.002001-5.fc32.noarch          639/856 
  Verifying        : perl-ExtUtils-CBuilder-1:0.280234-2.fc32.noarch    640/856 
---
  perl-Encode-devel-4:3.06-445.fc32.x86_64                                      
  perl-Env-1.04-440.fc32.noarch                                                 
  perl-Errno-1.30-453.fc32.x86_64                                               
  perl-Error-1:0.17029-1.fc32.noarch                                            
  perl-Exporter-5.74-2.fc32.noarch                                              
  perl-Exporter-Tiny-1.002001-5.fc32.noarch                                     
  perl-ExtUtils-CBuilder-1:0.280234-2.fc32.noarch                               
---
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['sudo', '-n', 'docker', 'run', '--label', 'com.qemu.instance.uuid=d630ec3f8c244b0a962bacd54db3f24e', '-u', '1001', '--security-opt', 'seccomp=unconfined', '--rm', '-e', 'TARGET_LIST=', '-e', 'EXTRA_CONFIGURE_OPTS=', '-e', 'V=', '-e', 'J=14', '-e', 'DEBUG=', '-e', 'SHOW_ENV=', '-e', 'CCACHE_DIR=/var/tmp/ccache', '-v', '/home/patchew/.cache/qemu-docker-ccache:/var/tmp/ccache:z', '-v', '/var/tmp/patchew-tester-tmp-daltld3f/src/docker-src.2020-06-26-15.04.20.25276:/var/tmp/qemu:z,ro', 'qemu/fedora', '/var/tmp/qemu/run', 'test-mingw']' returned non-zero exit status 2.
filter=--filter=label=com.qemu.instance.uuid=d630ec3f8c244b0a962bacd54db3f24e
make[1]: *** [docker-run] Error 1
make[1]: Leaving directory `/var/tmp/patchew-tester-tmp-daltld3f/src'
make: *** [docker-run-test-mingw@fedora] Error 2

real    9m48.635s
user    0m10.299s


The full log is available at
http://patchew.org/logs/20200626181357.26211-1-alex.bennee@linaro.org/testing.docker-mingw@fedora/?type=message.
---
Email generated automatically by Patchew [https://patchew.org/].
Please send your feedback to patchew-devel@redhat.com