[v1] Acceptance Tests: update assets location and cancel tests if missing

[PATCH 0/4] Acceptance Tests: update assets location and cancel tests if missing

Cleber Rosa posted 4 patches 3 years, 7 months ago

Diff against v2
Download series mbox

Test docker-quick@centos7 failed

Test docker-mingw@fedora failed

Test checkpatch failed

Test FreeBSD failed

Patches applied successfully (tree, apply log)
git fetch https://github.com/patchew-project/qemu tags/patchew/20200907042000.415931-1-crosa@redhat.com

Maintainers: Jiaxun Yang <jiaxun.yang@flygoat.com>, Aleksandar Rikalo <aleksandar.rikalo@syrmia.com>, Peter Maydell <peter.maydell@linaro.org>, "Philippe Mathieu-Daudé" <philmd@redhat.com>, Pavel Dovgalyuk <pavel.dovgaluk@ispras.ru>, Andrzej Zaborowski <balrogg@gmail.com>, Michael Rolnik <mrolnik@gmail.com>, Aurelien Jarno <aurelien@aurel32.net>, Sarah Harris <S.E.Harris@kent.ac.uk>, Wainer dos Santos Moschetta <wainersm@redhat.com>, Mark Cave-Ayland <mark.cave-ayland@ilande.co.uk>, Cleber Rosa <crosa@redhat.com>, Yoshinori Sato <ysato@users.sourceforge.jp>, Aleksandar Markovic <aleksandar.qemu.devel@gmail.com>, KONRAD Frederic <frederic.konrad@adacore.com>, Fabien Chouteau <chouteau@adacore.com>, "Hervé Poussineau" <hpoussin@reactos.org>, Paolo Bonzini <pbonzini@redhat.com>, Antony Pavlov <antonynpavlov@gmail.com>

There is a newer version of this series

tests/Makefile.include                       |   2 +-
tests/acceptance/boot_linux_console.py       | 164 +++++++++++--------
tests/acceptance/linux_initrd.py             |   6 +-
tests/acceptance/linux_ssh_mips_malta.py     |   6 +-
tests/acceptance/machine_arm_canona1100.py   |   3 +-
tests/acceptance/machine_arm_integratorcp.py |   9 +-
tests/acceptance/machine_arm_n8x0.py         |   3 +-
tests/acceptance/machine_avr6.py             |   3 +-
tests/acceptance/machine_m68k_nextcube.py    |   3 +-
tests/acceptance/machine_mips_malta.py       |   6 +-
tests/acceptance/machine_rx_gdbsim.py        |   9 +-
tests/acceptance/machine_sparc64_sun4u.py    |   3 +-
tests/acceptance/machine_sparc_leon3.py      |   3 +-
tests/acceptance/ppc_prep_40p.py             |   8 +-
tests/acceptance/replay_kernel.py            |  51 ++++--
tests/requirements.txt                       |   2 +-
16 files changed, 171 insertions(+), 110 deletions(-)

Expand all Fold all

[PATCH 0/4] Acceptance Tests: update assets location and cancel tests if missing

Posted by Cleber Rosa 3 years, 7 months ago

This updates a couple of asset locations, because their locations on
their origin distributions are not permanently stable.

To minimize the inconvenciente caused by test and job failures in the
future, an option is enabled that will cancel (AKA skip) tests early
when those assets are not available.

Cleber Rosa (3):
  Acceptance tests: use an available kernel image package for arm
  boot linux test: update arm bionic URL
  Acceptance tests: cancel tests on missing assets

Pavel Dovgaluk (1):
  tests: bump avocado version

 tests/Makefile.include                       |   2 +-
 tests/acceptance/boot_linux_console.py       | 164 +++++++++++--------
 tests/acceptance/linux_initrd.py             |   6 +-
 tests/acceptance/linux_ssh_mips_malta.py     |   6 +-
 tests/acceptance/machine_arm_canona1100.py   |   3 +-
 tests/acceptance/machine_arm_integratorcp.py |   9 +-
 tests/acceptance/machine_arm_n8x0.py         |   3 +-
 tests/acceptance/machine_avr6.py             |   3 +-
 tests/acceptance/machine_m68k_nextcube.py    |   3 +-
 tests/acceptance/machine_mips_malta.py       |   6 +-
 tests/acceptance/machine_rx_gdbsim.py        |   9 +-
 tests/acceptance/machine_sparc64_sun4u.py    |   3 +-
 tests/acceptance/machine_sparc_leon3.py      |   3 +-
 tests/acceptance/ppc_prep_40p.py             |   8 +-
 tests/acceptance/replay_kernel.py            |  51 ++++--
 tests/requirements.txt                       |   2 +-
 16 files changed, 171 insertions(+), 110 deletions(-)

-- 
2.25.4

Re: [PATCH 0/4] Acceptance Tests: update assets location and cancel tests if missing

Posted by Philippe Mathieu-Daudé 3 years, 7 months ago

Hi Cleber,

On 9/7/20 6:19 AM, Cleber Rosa wrote:
> This updates a couple of asset locations, because their locations on
> their origin distributions are not permanently stable.
> 
> To minimize the inconvenciente caused by test and job failures in the
> future, an option is enabled that will cancel (AKA skip) tests early
> when those assets are not available.
> 
> Cleber Rosa (3):
>   Acceptance tests: use an available kernel image package for arm
>   boot linux test: update arm bionic URL
>   Acceptance tests: cancel tests on missing assets
> 
> Pavel Dovgaluk (1):
>   tests: bump avocado version

I value your patches but I prefer to consider them as
new tests added, and not tests fixed (as discussed elsewhere
in this series). Therefore I'll post another simpler approach
until the discussion gets a consensus.

Regards,

Phil.