[Qemu-devel] [PATCH v2 0/4] mips: Add more Avocado tests

Philippe Mathieu-Daudé posted 4 patches 4 years, 10 months ago
Test docker-clang@ubuntu passed
Test s390x passed
Test asan passed
Test FreeBSD passed
Test docker-mingw@fedora passed
Test checkpatch passed
Patches applied successfully (tree, apply log)
git fetch https://github.com/patchew-project/qemu tags/patchew/20190523161832.22490-1-f4bug@amsat.org
Maintainers: Aleksandar Rikalo <arikalo@wavecomp.com>, Aleksandar Markovic <amarkovic@wavecomp.com>, Aurelien Jarno <aurelien@aurel32.net>
There is a newer version of this series
MAINTAINERS                              |   1 +
tests/acceptance/boot_linux_console.py   | 113 ++++++++++-
tests/acceptance/linux_ssh_mips_malta.py | 230 +++++++++++++++++++++++
tests/requirements.txt                   |   1 +
4 files changed, 343 insertions(+), 2 deletions(-)
create mode 100644 tests/acceptance/linux_ssh_mips_malta.py
[Qemu-devel] [PATCH v2 0/4] mips: Add more Avocado tests
Posted by Philippe Mathieu-Daudé 4 years, 10 months ago
Hi,

It was a rainy week-end here, so I invested it to automatize some
of my MIPS tests.

The BootLinuxSshTest is not Global warming friendly, it is not
meant to run on a CI system but rather on a workstation previous
to post a pull request.
It can surely be improved, but it is a good starting point.

v2: Decorate slow tests with skipIf(CONTINUOUS_INTEGRATION):

  VENV    /home/travis/build/philmd/qemu/tests/venv
  PIP     /home/travis/build/philmd/qemu/tests/requirements.txt
  MKDIR   /home/travis/build/philmd/qemu/tests/results
  AVOCADO tests/acceptance
JOB ID     : 02a2b1c585c12aebfbd8db2f330ed9730a547ae0
JOB LOG    : /home/travis/build/philmd/qemu/tests/results/job-2019-05-23T16.05-02a2b1c/job.log
 (01/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_x86_64_pc:  PASS (5.41 s)
 (02/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_mips_malta:  PASS (3.33 s)
 (03/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_mips64el_malta:  PASS (3.47 s)
 (04/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_mips_malta_cpio:  PASS (15.09 s)
 (05/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt:  PASS (2.48 s)
 (06/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_arm_virt:  PASS (7.25 s)
 (07/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_s390x_s390_ccw_virtio:  PASS (4.66 s)
 (08/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_alpha_clipper:  PASS (3.37 s)
 (09/22) acceptance/cpu_queries.py:QueryCPUModelExpansion.test:  PASS (0.16 s)
 (10/22) acceptance/empty_cpu_model.py:EmptyCPUModel.test:  PASS (0.02 s)
 (11/22) acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_exit_error_msg_with_linux_v3_6:  PASS (3.89 s)
 (12/22) acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_work_with_linux_v4_16:  PASS (15.14 s)
 (13/22) acceptance/linux_ssh_mips_malta.py:LinuxSSH.test_mips_malta32eb_kernel3_2_0:  SKIP: Running on Travis-CI
 (14/22) acceptance/linux_ssh_mips_malta.py:LinuxSSH.test_mips_malta64el_kernel3_2_0:  SKIP: Running on Travis-CI
 (15/22) acceptance/migration.py:Migration.test_migration_with_tcp_localhost:  PASS (0.23 s)
 (16/22) acceptance/version.py:Version.test_qmp_human_info_version:  PASS (0.04 s)
 (17/22) acceptance/virtio_version.py:VirtioVersionCheck.test_conventional_devs:  PASS (1.20 s)
 (18/22) acceptance/virtio_version.py:VirtioVersionCheck.test_modern_only_devs:  PASS (0.41 s)
 (19/22) acceptance/vnc.py:Vnc.test_no_vnc:  PASS (0.03 s)
 (20/22) acceptance/vnc.py:Vnc.test_no_vnc_change_password:  PASS (0.04 s)
 (21/22) acceptance/vnc.py:Vnc.test_vnc_change_password_requires_a_password:  PASS (0.04 s)
 (22/22) acceptance/vnc.py:Vnc.test_vnc_change_password:  PASS (0.04 s)
RESULTS    : PASS 20 | ERROR 0 | FAIL 0 | SKIP 2 | WARN 0 | INTERRUPT 0 | CANCEL 0
JOB TIME   : 68.64 s

Regards,

Phil.

Philippe Mathieu-Daudé (4):
  BootLinuxConsoleTest: Let extract_from_deb handle various compressions
  BootLinuxConsoleTest: Test nanoMIPS kernels on the I7200 CPU
  BootLinuxConsoleTest: Run kerneltests BusyBox on Malta
  BootLinuxSshTest: Test some userspace commands on Malta

 MAINTAINERS                              |   1 +
 tests/acceptance/boot_linux_console.py   | 113 ++++++++++-
 tests/acceptance/linux_ssh_mips_malta.py | 230 +++++++++++++++++++++++
 tests/requirements.txt                   |   1 +
 4 files changed, 343 insertions(+), 2 deletions(-)
 create mode 100644 tests/acceptance/linux_ssh_mips_malta.py

-- 
2.19.1


Re: [Qemu-devel] [PATCH v2 0/4] mips: Add more Avocado tests
Posted by Philippe Mathieu-Daudé 4 years, 10 months ago
On Thu, May 23, 2019 at 6:18 PM Philippe Mathieu-Daudé <f4bug@amsat.org> wrote:
>
> Hi,
>
> It was a rainy week-end here, so I invested it to automatize some
> of my MIPS tests.
>
> The BootLinuxSshTest is not Global warming friendly, it is not
> meant to run on a CI system but rather on a workstation previous
> to post a pull request.
> It can surely be improved, but it is a good starting point.
>
> v2: Decorate slow tests with skipIf(CONTINUOUS_INTEGRATION):
>
>   VENV    /home/travis/build/philmd/qemu/tests/venv
>   PIP     /home/travis/build/philmd/qemu/tests/requirements.txt
>   MKDIR   /home/travis/build/philmd/qemu/tests/results
>   AVOCADO tests/acceptance
> JOB ID     : 02a2b1c585c12aebfbd8db2f330ed9730a547ae0
> JOB LOG    : /home/travis/build/philmd/qemu/tests/results/job-2019-05-23T16.05-02a2b1c/job.log
>  (01/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_x86_64_pc:  PASS (5.41 s)
>  (02/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_mips_malta:  PASS (3.33 s)
>  (03/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_mips64el_malta:  PASS (3.47 s)
>  (04/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_mips_malta_cpio:  PASS (15.09 s)
>  (05/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_aarch64_virt:  PASS (2.48 s)
>  (06/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_arm_virt:  PASS (7.25 s)
>  (07/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_s390x_s390_ccw_virtio:  PASS (4.66 s)
>  (08/22) acceptance/boot_linux_console.py:BootLinuxConsole.test_alpha_clipper:  PASS (3.37 s)
>  (09/22) acceptance/cpu_queries.py:QueryCPUModelExpansion.test:  PASS (0.16 s)
>  (10/22) acceptance/empty_cpu_model.py:EmptyCPUModel.test:  PASS (0.02 s)
>  (11/22) acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_exit_error_msg_with_linux_v3_6:  PASS (3.89 s)
>  (12/22) acceptance/linux_initrd.py:LinuxInitrd.test_with_2gib_file_should_work_with_linux_v4_16:  PASS (15.14 s)
>  (13/22) acceptance/linux_ssh_mips_malta.py:LinuxSSH.test_mips_malta32eb_kernel3_2_0:  SKIP: Running on Travis-CI
>  (14/22) acceptance/linux_ssh_mips_malta.py:LinuxSSH.test_mips_malta64el_kernel3_2_0:  SKIP: Running on Travis-CI

Job output here:
https://travis-ci.org/philmd/qemu/jobs/536369687
"Ran for 16 min 26 sec"

>  (15/22) acceptance/migration.py:Migration.test_migration_with_tcp_localhost:  PASS (0.23 s)
>  (16/22) acceptance/version.py:Version.test_qmp_human_info_version:  PASS (0.04 s)
>  (17/22) acceptance/virtio_version.py:VirtioVersionCheck.test_conventional_devs:  PASS (1.20 s)
>  (18/22) acceptance/virtio_version.py:VirtioVersionCheck.test_modern_only_devs:  PASS (0.41 s)
>  (19/22) acceptance/vnc.py:Vnc.test_no_vnc:  PASS (0.03 s)
>  (20/22) acceptance/vnc.py:Vnc.test_no_vnc_change_password:  PASS (0.04 s)
>  (21/22) acceptance/vnc.py:Vnc.test_vnc_change_password_requires_a_password:  PASS (0.04 s)
>  (22/22) acceptance/vnc.py:Vnc.test_vnc_change_password:  PASS (0.04 s)
> RESULTS    : PASS 20 | ERROR 0 | FAIL 0 | SKIP 2 | WARN 0 | INTERRUPT 0 | CANCEL 0
> JOB TIME   : 68.64 s