1. Patchew
  2. QEMU
  3. View series

[Qemu-devel] [PATCH 0/6] tests/qemu-iotests: Run basic iotests during "make check"

Thomas Huth posted 6 patches 5 years ago
Test checkpatch passed
Test asan failed
Test docker-clang@ubuntu failed
Test docker-mingw@fedora passed
Patches applied successfully (tree, apply log)
git fetch https://github.com/patchew-project/qemu tags/patchew/20190424103747.10173-1-thuth@redhat.com
Maintainers: "Alex Bennée" <alex.bennee@linaro.org>, "Philippe Mathieu-Daudé" <philmd@redhat.com>, Li-Wen Hsu <lwhsu@freebsd.org>, Kevin Wolf <kwolf@redhat.com>, Fam Zheng <fam@euphon.net>, Max Reitz <mreitz@redhat.com>, Ed Maste <emaste@freebsd.org>
There is a newer version of this series
.cirrus.yml                 |   4 +-
.travis.yml                 |   1 +
tests/Makefile.include      |   2 +-
tests/qemu-iotests-quick.sh |  17 +++-
tests/qemu-iotests/001      |   1 -
tests/qemu-iotests/002      |   1 -
tests/qemu-iotests/003      |   1 -
tests/qemu-iotests/004      |   1 -
tests/qemu-iotests/005      |   1 -
tests/qemu-iotests/007      |   1 -
tests/qemu-iotests/008      |   1 -
tests/qemu-iotests/009      |   1 -
tests/qemu-iotests/010      |   1 -
tests/qemu-iotests/011      |   1 -
tests/qemu-iotests/012      |   1 -
tests/qemu-iotests/013      |   1 -
tests/qemu-iotests/014      |   1 -
tests/qemu-iotests/015      |   1 -
tests/qemu-iotests/017      |   1 -
tests/qemu-iotests/020      |   1 -
tests/qemu-iotests/021      |   1 -
tests/qemu-iotests/022      |   1 -
tests/qemu-iotests/023      |   1 -
tests/qemu-iotests/025      |   1 -
tests/qemu-iotests/026      |   1 -
tests/qemu-iotests/027      |   1 -
tests/qemu-iotests/028      |   1 -
tests/qemu-iotests/029      |   1 -
tests/qemu-iotests/031      |   1 -
tests/qemu-iotests/032      |   1 -
tests/qemu-iotests/033      |   1 -
tests/qemu-iotests/035      |   1 -
tests/qemu-iotests/036      |   1 -
tests/qemu-iotests/037      |   1 -
tests/qemu-iotests/042      |   1 -
tests/qemu-iotests/043      |   1 -
tests/qemu-iotests/046      |   1 -
tests/qemu-iotests/047      |   1 -
tests/qemu-iotests/049      |   1 -
tests/qemu-iotests/050      |   1 -
tests/qemu-iotests/051      |   1 -
tests/qemu-iotests/052      |   1 -
tests/qemu-iotests/053      |   1 -
tests/qemu-iotests/054      |   1 -
tests/qemu-iotests/060      |   1 -
tests/qemu-iotests/061      |   1 -
tests/qemu-iotests/062      |   1 -
tests/qemu-iotests/063      |   1 -
tests/qemu-iotests/066      |   1 -
tests/qemu-iotests/067      |   1 -
tests/qemu-iotests/068      |   1 -
tests/qemu-iotests/069      |   1 -
tests/qemu-iotests/071      |   1 -
tests/qemu-iotests/072      |   1 -
tests/qemu-iotests/073      |   1 -
tests/qemu-iotests/079      |   1 -
tests/qemu-iotests/080      |   1 -
tests/qemu-iotests/082      |   1 -
tests/qemu-iotests/085      |   1 -
tests/qemu-iotests/089      |   1 -
tests/qemu-iotests/090      |   1 -
tests/qemu-iotests/091      |   1 -
tests/qemu-iotests/094      |   1 -
tests/qemu-iotests/095      |   1 -
tests/qemu-iotests/097      |   1 -
tests/qemu-iotests/098      |   1 -
tests/qemu-iotests/102      |   1 -
tests/qemu-iotests/103      |   1 -
tests/qemu-iotests/104      |   1 -
tests/qemu-iotests/105      |   1 -
tests/qemu-iotests/107      |   1 -
tests/qemu-iotests/110      |   1 -
tests/qemu-iotests/111      |   1 -
tests/qemu-iotests/112      |   1 -
tests/qemu-iotests/114      |   1 -
tests/qemu-iotests/115      |   1 -
tests/qemu-iotests/117      |   1 -
tests/qemu-iotests/120      |   1 -
tests/qemu-iotests/121      |   1 -
tests/qemu-iotests/122      |   1 -
tests/qemu-iotests/125      |   1 -
tests/qemu-iotests/126      |   1 -
tests/qemu-iotests/127      |   1 -
tests/qemu-iotests/130      |   1 -
tests/qemu-iotests/133      |   1 -
tests/qemu-iotests/134      |   1 -
tests/qemu-iotests/137      |   1 -
tests/qemu-iotests/138      |   1 -
tests/qemu-iotests/141      |   1 -
tests/qemu-iotests/142      |   1 -
tests/qemu-iotests/143      |   1 -
tests/qemu-iotests/144      |   1 -
tests/qemu-iotests/145      |   1 -
tests/qemu-iotests/153      |   1 -
tests/qemu-iotests/156      |   1 -
tests/qemu-iotests/157      |   1 -
tests/qemu-iotests/158      |   1 -
tests/qemu-iotests/159      |   1 -
tests/qemu-iotests/161      |   1 -
tests/qemu-iotests/162      |   1 -
tests/qemu-iotests/170      |   1 -
tests/qemu-iotests/172      |   1 -
tests/qemu-iotests/173      |   1 -
tests/qemu-iotests/176      |   1 -
tests/qemu-iotests/178      |   1 -
tests/qemu-iotests/181      |   1 -
tests/qemu-iotests/182      |   1 -
tests/qemu-iotests/183      |   1 -
tests/qemu-iotests/185      |   1 -
tests/qemu-iotests/186      |   1 -
tests/qemu-iotests/187      |   1 -
tests/qemu-iotests/189      |   1 -
tests/qemu-iotests/190      |   1 -
tests/qemu-iotests/191      |   1 -
tests/qemu-iotests/192      |   1 -
tests/qemu-iotests/195      |   1 -
tests/qemu-iotests/197      |   1 -
tests/qemu-iotests/198      |   1 -
tests/qemu-iotests/200      |   1 -
tests/qemu-iotests/201      |   1 -
tests/qemu-iotests/214      |   1 -
tests/qemu-iotests/215      |   1 -
tests/qemu-iotests/217      |   1 -
tests/qemu-iotests/220      |   1 -
tests/qemu-iotests/227      |   1 -
tests/qemu-iotests/229      |   1 -
tests/qemu-iotests/231      |   1 -
tests/qemu-iotests/232      |   1 -
tests/qemu-iotests/233      |   1 -
tests/qemu-iotests/239      |   2 +-
tests/qemu-iotests/240      |   3 +-
tests/qemu-iotests/241      |   2 +-
tests/qemu-iotests/243      |   2 +-
tests/qemu-iotests/244      |   2 +-
tests/qemu-iotests/247      |   1 -
tests/qemu-iotests/check    |  13 ++-
tests/qemu-iotests/group    | 194 +++++++++++++++++++-----------------
137 files changed, 139 insertions(+), 229 deletions(-)
[Qemu-devel] [PATCH 0/6] tests/qemu-iotests: Run basic iotests during "make check"
Posted by Thomas Huth 5 years ago 
People often forget to run the iotests before submitting patches or
pull requests - this is likely due to the fact that we do not run the
tests during our mandatory "make check" tests yet.
This patch series now introduces a new "ci" iotests group that should
be safe to run in all CI environments (including FreeBSD and macOS!).
Thus these iotests can now always be run during "make check" automati-
cally, too.

Thomas Huth (6):
  tests/qemu-iotests/check: Pick a default machine if necessary
  tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines
  tests/qemu-iotests: Do not hard-code the path to bash
  cirrus / travis: Add gnu-sed and bash for macOS and FreeBSD
  tests: Run the iotests during "make check" again
  tests/qemu-iotests: Remove the "_supported_os Linux" line from many
    tests

 .cirrus.yml                 |   4 +-
 .travis.yml                 |   1 +
 tests/Makefile.include      |   2 +-
 tests/qemu-iotests-quick.sh |  17 +++-
 tests/qemu-iotests/001      |   1 -
 tests/qemu-iotests/002      |   1 -
 tests/qemu-iotests/003      |   1 -
 tests/qemu-iotests/004      |   1 -
 tests/qemu-iotests/005      |   1 -
 tests/qemu-iotests/007      |   1 -
 tests/qemu-iotests/008      |   1 -
 tests/qemu-iotests/009      |   1 -
 tests/qemu-iotests/010      |   1 -
 tests/qemu-iotests/011      |   1 -
 tests/qemu-iotests/012      |   1 -
 tests/qemu-iotests/013      |   1 -
 tests/qemu-iotests/014      |   1 -
 tests/qemu-iotests/015      |   1 -
 tests/qemu-iotests/017      |   1 -
 tests/qemu-iotests/020      |   1 -
 tests/qemu-iotests/021      |   1 -
 tests/qemu-iotests/022      |   1 -
 tests/qemu-iotests/023      |   1 -
 tests/qemu-iotests/025      |   1 -
 tests/qemu-iotests/026      |   1 -
 tests/qemu-iotests/027      |   1 -
 tests/qemu-iotests/028      |   1 -
 tests/qemu-iotests/029      |   1 -
 tests/qemu-iotests/031      |   1 -
 tests/qemu-iotests/032      |   1 -
 tests/qemu-iotests/033      |   1 -
 tests/qemu-iotests/035      |   1 -
 tests/qemu-iotests/036      |   1 -
 tests/qemu-iotests/037      |   1 -
 tests/qemu-iotests/042      |   1 -
 tests/qemu-iotests/043      |   1 -
 tests/qemu-iotests/046      |   1 -
 tests/qemu-iotests/047      |   1 -
 tests/qemu-iotests/049      |   1 -
 tests/qemu-iotests/050      |   1 -
 tests/qemu-iotests/051      |   1 -
 tests/qemu-iotests/052      |   1 -
 tests/qemu-iotests/053      |   1 -
 tests/qemu-iotests/054      |   1 -
 tests/qemu-iotests/060      |   1 -
 tests/qemu-iotests/061      |   1 -
 tests/qemu-iotests/062      |   1 -
 tests/qemu-iotests/063      |   1 -
 tests/qemu-iotests/066      |   1 -
 tests/qemu-iotests/067      |   1 -
 tests/qemu-iotests/068      |   1 -
 tests/qemu-iotests/069      |   1 -
 tests/qemu-iotests/071      |   1 -
 tests/qemu-iotests/072      |   1 -
 tests/qemu-iotests/073      |   1 -
 tests/qemu-iotests/079      |   1 -
 tests/qemu-iotests/080      |   1 -
 tests/qemu-iotests/082      |   1 -
 tests/qemu-iotests/085      |   1 -
 tests/qemu-iotests/089      |   1 -
 tests/qemu-iotests/090      |   1 -
 tests/qemu-iotests/091      |   1 -
 tests/qemu-iotests/094      |   1 -
 tests/qemu-iotests/095      |   1 -
 tests/qemu-iotests/097      |   1 -
 tests/qemu-iotests/098      |   1 -
 tests/qemu-iotests/102      |   1 -
 tests/qemu-iotests/103      |   1 -
 tests/qemu-iotests/104      |   1 -
 tests/qemu-iotests/105      |   1 -
 tests/qemu-iotests/107      |   1 -
 tests/qemu-iotests/110      |   1 -
 tests/qemu-iotests/111      |   1 -
 tests/qemu-iotests/112      |   1 -
 tests/qemu-iotests/114      |   1 -
 tests/qemu-iotests/115      |   1 -
 tests/qemu-iotests/117      |   1 -
 tests/qemu-iotests/120      |   1 -
 tests/qemu-iotests/121      |   1 -
 tests/qemu-iotests/122      |   1 -
 tests/qemu-iotests/125      |   1 -
 tests/qemu-iotests/126      |   1 -
 tests/qemu-iotests/127      |   1 -
 tests/qemu-iotests/130      |   1 -
 tests/qemu-iotests/133      |   1 -
 tests/qemu-iotests/134      |   1 -
 tests/qemu-iotests/137      |   1 -
 tests/qemu-iotests/138      |   1 -
 tests/qemu-iotests/141      |   1 -
 tests/qemu-iotests/142      |   1 -
 tests/qemu-iotests/143      |   1 -
 tests/qemu-iotests/144      |   1 -
 tests/qemu-iotests/145      |   1 -
 tests/qemu-iotests/153      |   1 -
 tests/qemu-iotests/156      |   1 -
 tests/qemu-iotests/157      |   1 -
 tests/qemu-iotests/158      |   1 -
 tests/qemu-iotests/159      |   1 -
 tests/qemu-iotests/161      |   1 -
 tests/qemu-iotests/162      |   1 -
 tests/qemu-iotests/170      |   1 -
 tests/qemu-iotests/172      |   1 -
 tests/qemu-iotests/173      |   1 -
 tests/qemu-iotests/176      |   1 -
 tests/qemu-iotests/178      |   1 -
 tests/qemu-iotests/181      |   1 -
 tests/qemu-iotests/182      |   1 -
 tests/qemu-iotests/183      |   1 -
 tests/qemu-iotests/185      |   1 -
 tests/qemu-iotests/186      |   1 -
 tests/qemu-iotests/187      |   1 -
 tests/qemu-iotests/189      |   1 -
 tests/qemu-iotests/190      |   1 -
 tests/qemu-iotests/191      |   1 -
 tests/qemu-iotests/192      |   1 -
 tests/qemu-iotests/195      |   1 -
 tests/qemu-iotests/197      |   1 -
 tests/qemu-iotests/198      |   1 -
 tests/qemu-iotests/200      |   1 -
 tests/qemu-iotests/201      |   1 -
 tests/qemu-iotests/214      |   1 -
 tests/qemu-iotests/215      |   1 -
 tests/qemu-iotests/217      |   1 -
 tests/qemu-iotests/220      |   1 -
 tests/qemu-iotests/227      |   1 -
 tests/qemu-iotests/229      |   1 -
 tests/qemu-iotests/231      |   1 -
 tests/qemu-iotests/232      |   1 -
 tests/qemu-iotests/233      |   1 -
 tests/qemu-iotests/239      |   2 +-
 tests/qemu-iotests/240      |   3 +-
 tests/qemu-iotests/241      |   2 +-
 tests/qemu-iotests/243      |   2 +-
 tests/qemu-iotests/244      |   2 +-
 tests/qemu-iotests/247      |   1 -
 tests/qemu-iotests/check    |  13 ++-
 tests/qemu-iotests/group    | 194 +++++++++++++++++++-----------------
 137 files changed, 139 insertions(+), 229 deletions(-)

-- 
2.21.0
Re: [Qemu-devel] [PATCH 0/6] tests/qemu-iotests: Run basic iotests during "make check"
Posted by no-reply@patchew.org 5 years ago 
Patchew URL: https://patchew.org/QEMU/20190424103747.10173-1-thuth@redhat.com/



Hi,

This series failed the asan build test. Please find the testing commands and
their output below. If you have Docker installed, you can probably reproduce it
locally.

=== TEST SCRIPT BEGIN ===
#!/bin/bash
time make docker-test-debug@fedora TARGET_LIST=x86_64-softmmu J=14 NETWORK=1
=== TEST SCRIPT END ===




The full log is available at
http://patchew.org/logs/20190424103747.10173-1-thuth@redhat.com/testing.asan/?type=message.
---
Email generated automatically by Patchew [https://patchew.org/].
Please send your feedback to patchew-devel@redhat.com
Re: [Qemu-devel] [PATCH 0/6] tests/qemu-iotests: Run basic iotests during "make check"
Posted by Christian Borntraeger 5 years ago 
On 24.04.19 12:37, Thomas Huth wrote:
> People often forget to run the iotests before submitting patches or
> pull requests - this is likely due to the fact that we do not run the
> tests during our mandatory "make check" tests yet.
> This patch series now introduces a new "ci" iotests group that should
> be safe to run in all CI environments (including FreeBSD and macOS!).
> Thus these iotests can now always be run during "make check" automati-
> cally, too.

Given that the iotests have been broken heavily immediately after the 4.0
release (e.g. by a qemu-io change) consider the series

Acked-by: Christian Borntraeger <borntraeger@de.ibm.com>


> 
> Thomas Huth (6):
>   tests/qemu-iotests/check: Pick a default machine if necessary
>   tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines
>   tests/qemu-iotests: Do not hard-code the path to bash
>   cirrus / travis: Add gnu-sed and bash for macOS and FreeBSD
>   tests: Run the iotests during "make check" again
>   tests/qemu-iotests: Remove the "_supported_os Linux" line from many
>     tests
> 
>  .cirrus.yml                 |   4 +-
>  .travis.yml                 |   1 +
>  tests/Makefile.include      |   2 +-
>  tests/qemu-iotests-quick.sh |  17 +++-
>  tests/qemu-iotests/001      |   1 -
>  tests/qemu-iotests/002      |   1 -
>  tests/qemu-iotests/003      |   1 -
>  tests/qemu-iotests/004      |   1 -
>  tests/qemu-iotests/005      |   1 -
>  tests/qemu-iotests/007      |   1 -
>  tests/qemu-iotests/008      |   1 -
>  tests/qemu-iotests/009      |   1 -
>  tests/qemu-iotests/010      |   1 -
>  tests/qemu-iotests/011      |   1 -
>  tests/qemu-iotests/012      |   1 -
>  tests/qemu-iotests/013      |   1 -
>  tests/qemu-iotests/014      |   1 -
>  tests/qemu-iotests/015      |   1 -
>  tests/qemu-iotests/017      |   1 -
>  tests/qemu-iotests/020      |   1 -
>  tests/qemu-iotests/021      |   1 -
>  tests/qemu-iotests/022      |   1 -
>  tests/qemu-iotests/023      |   1 -
>  tests/qemu-iotests/025      |   1 -
>  tests/qemu-iotests/026      |   1 -
>  tests/qemu-iotests/027      |   1 -
>  tests/qemu-iotests/028      |   1 -
>  tests/qemu-iotests/029      |   1 -
>  tests/qemu-iotests/031      |   1 -
>  tests/qemu-iotests/032      |   1 -
>  tests/qemu-iotests/033      |   1 -
>  tests/qemu-iotests/035      |   1 -
>  tests/qemu-iotests/036      |   1 -
>  tests/qemu-iotests/037      |   1 -
>  tests/qemu-iotests/042      |   1 -
>  tests/qemu-iotests/043      |   1 -
>  tests/qemu-iotests/046      |   1 -
>  tests/qemu-iotests/047      |   1 -
>  tests/qemu-iotests/049      |   1 -
>  tests/qemu-iotests/050      |   1 -
>  tests/qemu-iotests/051      |   1 -
>  tests/qemu-iotests/052      |   1 -
>  tests/qemu-iotests/053      |   1 -
>  tests/qemu-iotests/054      |   1 -
>  tests/qemu-iotests/060      |   1 -
>  tests/qemu-iotests/061      |   1 -
>  tests/qemu-iotests/062      |   1 -
>  tests/qemu-iotests/063      |   1 -
>  tests/qemu-iotests/066      |   1 -
>  tests/qemu-iotests/067      |   1 -
>  tests/qemu-iotests/068      |   1 -
>  tests/qemu-iotests/069      |   1 -
>  tests/qemu-iotests/071      |   1 -
>  tests/qemu-iotests/072      |   1 -
>  tests/qemu-iotests/073      |   1 -
>  tests/qemu-iotests/079      |   1 -
>  tests/qemu-iotests/080      |   1 -
>  tests/qemu-iotests/082      |   1 -
>  tests/qemu-iotests/085      |   1 -
>  tests/qemu-iotests/089      |   1 -
>  tests/qemu-iotests/090      |   1 -
>  tests/qemu-iotests/091      |   1 -
>  tests/qemu-iotests/094      |   1 -
>  tests/qemu-iotests/095      |   1 -
>  tests/qemu-iotests/097      |   1 -
>  tests/qemu-iotests/098      |   1 -
>  tests/qemu-iotests/102      |   1 -
>  tests/qemu-iotests/103      |   1 -
>  tests/qemu-iotests/104      |   1 -
>  tests/qemu-iotests/105      |   1 -
>  tests/qemu-iotests/107      |   1 -
>  tests/qemu-iotests/110      |   1 -
>  tests/qemu-iotests/111      |   1 -
>  tests/qemu-iotests/112      |   1 -
>  tests/qemu-iotests/114      |   1 -
>  tests/qemu-iotests/115      |   1 -
>  tests/qemu-iotests/117      |   1 -
>  tests/qemu-iotests/120      |   1 -
>  tests/qemu-iotests/121      |   1 -
>  tests/qemu-iotests/122      |   1 -
>  tests/qemu-iotests/125      |   1 -
>  tests/qemu-iotests/126      |   1 -
>  tests/qemu-iotests/127      |   1 -
>  tests/qemu-iotests/130      |   1 -
>  tests/qemu-iotests/133      |   1 -
>  tests/qemu-iotests/134      |   1 -
>  tests/qemu-iotests/137      |   1 -
>  tests/qemu-iotests/138      |   1 -
>  tests/qemu-iotests/141      |   1 -
>  tests/qemu-iotests/142      |   1 -
>  tests/qemu-iotests/143      |   1 -
>  tests/qemu-iotests/144      |   1 -
>  tests/qemu-iotests/145      |   1 -
>  tests/qemu-iotests/153      |   1 -
>  tests/qemu-iotests/156      |   1 -
>  tests/qemu-iotests/157      |   1 -
>  tests/qemu-iotests/158      |   1 -
>  tests/qemu-iotests/159      |   1 -
>  tests/qemu-iotests/161      |   1 -
>  tests/qemu-iotests/162      |   1 -
>  tests/qemu-iotests/170      |   1 -
>  tests/qemu-iotests/172      |   1 -
>  tests/qemu-iotests/173      |   1 -
>  tests/qemu-iotests/176      |   1 -
>  tests/qemu-iotests/178      |   1 -
>  tests/qemu-iotests/181      |   1 -
>  tests/qemu-iotests/182      |   1 -
>  tests/qemu-iotests/183      |   1 -
>  tests/qemu-iotests/185      |   1 -
>  tests/qemu-iotests/186      |   1 -
>  tests/qemu-iotests/187      |   1 -
>  tests/qemu-iotests/189      |   1 -
>  tests/qemu-iotests/190      |   1 -
>  tests/qemu-iotests/191      |   1 -
>  tests/qemu-iotests/192      |   1 -
>  tests/qemu-iotests/195      |   1 -
>  tests/qemu-iotests/197      |   1 -
>  tests/qemu-iotests/198      |   1 -
>  tests/qemu-iotests/200      |   1 -
>  tests/qemu-iotests/201      |   1 -
>  tests/qemu-iotests/214      |   1 -
>  tests/qemu-iotests/215      |   1 -
>  tests/qemu-iotests/217      |   1 -
>  tests/qemu-iotests/220      |   1 -
>  tests/qemu-iotests/227      |   1 -
>  tests/qemu-iotests/229      |   1 -
>  tests/qemu-iotests/231      |   1 -
>  tests/qemu-iotests/232      |   1 -
>  tests/qemu-iotests/233      |   1 -
>  tests/qemu-iotests/239      |   2 +-
>  tests/qemu-iotests/240      |   3 +-
>  tests/qemu-iotests/241      |   2 +-
>  tests/qemu-iotests/243      |   2 +-
>  tests/qemu-iotests/244      |   2 +-
>  tests/qemu-iotests/247      |   1 -
>  tests/qemu-iotests/check    |  13 ++-
>  tests/qemu-iotests/group    | 194 +++++++++++++++++++-----------------
>  137 files changed, 139 insertions(+), 229 deletions(-)
>

Patchew 2.1-devel-0870f84

© 2016 - 2024 Red Hat, Inc.