[Qemu-devel] [PATCH] ci: store Patchew configuration in the tree

Paolo Bonzini posted 1 patch 5 years, 1 month ago
Test checkpatch passed
Test docker-clang@ubuntu passed
Test asan passed
Test docker-mingw@fedora passed
Failed in applying to current master (apply log)
.patchew.yml | 204 +++++++++++++++++++++++++++++++++++++++++++++++++++
1 file changed, 204 insertions(+)
create mode 100644 .patchew.yml
[Qemu-devel] [PATCH] ci: store Patchew configuration in the tree
Posted by Paolo Bonzini 5 years, 1 month ago
Patchew cannot yet retrieve the configuration from the QEMU Git tree, but
this is planned.  In the meanwhile, let's start storing it as YAML
so that the Patchew configuration (currently accessible only to administrators)
is public and documented.

Signed-off-by: Paolo Bonzini <pbonzini@redhat.com>
---
 .patchew.yml | 204 +++++++++++++++++++++++++++++++++++++++++++++++++++
 1 file changed, 204 insertions(+)
 create mode 100644 .patchew.yml

diff --git a/.patchew.yml b/.patchew.yml
new file mode 100644
index 0000000000..54feda823e
--- /dev/null
+++ b/.patchew.yml
@@ -0,0 +1,204 @@
+# Note: this file is still unused.  It serves as a documentation for the
+# Patchew configuration in case patchew.org disappears or has to be
+# reinstalled.
+
+git:
+  push_to: git@github.com:patchew-project/qemu
+  public_repo: https://github.com/patchew-project/qemu
+  url_template: https://github.com/patchew-project/qemu/tree/%t
+
+email:
+  ENOSPC:
+    event: TestingReport
+    to: fam@euphon.net
+    reply_subject: false
+    set_reply_to: false
+    subject_template: 'Out of space error for {{ tester }}'
+    body_template: |
+      {% if passed %}
+      {{ cancel }}
+      {% endif %}
+
+      {% if 'No space left on device' in log %}
+      Tester {{ tester }} out of space when running {{ test }}
+
+      {{ log | ansi2text }}
+      {% else %}
+      {{ cancel }}
+      {% endif %}
+
+  timeouts:
+    event: TestingReport
+    to: fam@euphon.net
+    body_template: |
+      {% if not is_timeout %} {{ cancel }} {% endif %}
+
+      Test '{{ test }}' timeout, log:
+
+      {{ log | ansi2text }}
+
+  failures:
+    event: TestingReport
+    reply_to_all: true
+    body_template: |
+      {% if passed or not obj.message_id or is_timeout %}
+        {{ cancel }}
+      {% endif %}
+      {% if 'No space left on device' in log %}
+        {{ cancel }}
+      {% endif %}
+      Patchew URL: https://patchew.org/QEMU/{{ obj.message_id }}/
+
+      {% ansi2text log as logtext %}
+      {% if test == "checkpatch" %}
+      Hi,
+
+      This series seems to have some coding style problems. See output below for
+      more information:
+
+      {{ logtext }}
+      {% elif test == "docker-mingw@fedora" or test == "docker-quick@centos7" or test == "asan" %}
+      Hi,
+
+      This series failed the {{ test }} build test. Please find the testing commands and
+      their output below. If you have Docker installed, you can probably reproduce it
+      locally.
+
+      {% lines_between logtext start="^=== TEST SCRIPT BEGIN ===$" stop="^=== TEST SCRIPT END ===$" %}
+      {% lines_between logtext start="^=== OUTPUT BEGIN ===$" stop="=== OUTPUT END ===$" as output %}
+      {% grep_C output regex="\b(FAIL|XPASS|ERROR|WARN|error:|warning:)" n=3 %}
+      {% elif test == "s390x" or test == "FreeBSD" or test == "ppcle" or test == "ppcbe" %}
+      Hi,
+
+      This series failed build test on {{test}} host. Please find the details below.
+
+      {% lines_between logtext start="^=== TEST SCRIPT BEGIN ===$" stop="^=== TEST SCRIPT END ===$" %}
+      {% lines_between logtext start="^=== OUTPUT BEGIN ===$" stop="=== OUTPUT END ===$" as output %}
+      {% grep_C output regex="\b(FAIL|XPASS|ERROR|WARN|error:|warning:)" n=3 %}
+      {% else %}
+      {{ cancel }}
+      {% endif %}
+
+      The full log is available at
+      {{ log_url }}.
+      ---
+      Email generated automatically by Patchew [http://patchew.org/].
+      Please send your feedback to patchew-devel@redhat.com
+
+testing:
+  defaults:
+    - timeout: 3600
+
+  requirements:
+    docker: |
+      #!/bin/bash
+      docker ps || sudo -n docker ps
+    x86-kvm: |
+      #!/bin/bash
+      set -e
+      test "$(uname -m)" = x86_64
+      test -r /dev/kvm
+      if qemu-system-x86_64 --help >/dev/null 2>&1; then
+        :
+      elif /usr/libexec/qemu-kvm --help >/dev/null 2>&1; then
+        :
+      else
+        false
+      fi
+    ppcle: |
+      #!/bin/sh
+      test "$(uname -m)" = ppc64le
+    ppcbe: |
+      #!/bin/sh
+      test "$(uname -m)" = ppc64
+    s390x: |
+      #!/bin/sh
+      test "$(uname -m)" = s390x
+
+  tests:
+    asan:
+      requirements: docker
+      script: |
+        #!/bin/bash
+        time make docker-test-debug@fedora TARGET_LIST=x86_64-softmmu J=14 NETWORK=1
+
+    docker-clang@ubuntu:
+      requirements: docker
+      script: |
+        #!/bin/bash
+        time make docker-test-clang@ubuntu SHOW_ENV=1 J=14 NETWORK=1
+
+    docker-mingw@fedora:
+      requirements: docker
+      script: |
+        #!/bin/bash
+        time make docker-test-mingw@fedora SHOW_ENV=1 J=14 NETWORK=1
+
+    docker-quick@centos7:
+      requirements: docker
+      script: |
+        #!/bin/bash
+        time make docker-test-quick@centos7 SHOW_ENV=1 J=14 NETWORK=1
+
+    checkpatch:
+      script: |
+        #!/bin/bash
+        git rev-parse base > /dev/null || exit 0
+        git config --local diff.renamelimit 0
+        git config --local diff.renames True
+        git config --local diff.algorithm histogram
+        ./scripts/checkpatch.pl --mailback base..
+
+    FreeBSD:
+      enabled: false
+      requirements: x86-kvm
+      script: |
+        #!/bin/bash
+        if qemu-system-x86_64 --help >/dev/null 2>&1; then
+          QEMU=qemu-system-x86_64
+        elif /usr/libexec/qemu-kvm --help >/dev/null 2>&1; then
+          QEMU=/usr/libexec/qemu-kvm
+        else
+          exit 1
+        fi
+        make vm-build-freebsd J=14 QEMU=$QEMU
+        exit 0
+
+    ppcle:
+      enabled: false
+      requirements: ppcle
+      script: |
+        #!/bin/bash
+        INSTALL=$PWD/install
+        BUILD=$PWD/build
+        mkdir -p $BUILD $INSTALL
+        SRC=$PWD
+        cd $BUILD
+        $SRC/configure --prefix=$INSTALL
+        make -j14
+
+    ppcbe:
+      enabled: false
+      requirements: ppcbe
+      script: |
+        #!/bin/bash
+        INSTALL=$PWD/install
+        BUILD=$PWD/build
+        mkdir -p $BUILD $INSTALL
+        SRC=$PWD
+        cd $BUILD
+        $SRC/configure --prefix=$INSTALL
+        make -j14
+
+    s390x:
+      enabled: false
+      requirements: ppcle
+      script: |
+        #!/bin/bash
+        INSTALL=$PWD/install
+        BUILD=$PWD/build
+        mkdir -p $BUILD $INSTALL
+        SRC=$PWD
+        cd $BUILD
+        $SRC/configure --prefix=$INSTALL
+        make -j14
-- 
2.20.1


Re: [Qemu-devel] [PATCH] ci: store Patchew configuration in the tree
Posted by Alex Bennée 5 years, 1 month ago
Paolo Bonzini <pbonzini@redhat.com> writes:

> Patchew cannot yet retrieve the configuration from the QEMU Git tree, but
> this is planned.  In the meanwhile, let's start storing it as YAML
> so that the Patchew configuration (currently accessible only to administrators)
> is public and documented.
>
> Signed-off-by: Paolo Bonzini <pbonzini@redhat.com>
> ---
>  .patchew.yml | 204 +++++++++++++++++++++++++++++++++++++++++++++++++++
>  1 file changed, 204 insertions(+)
>  create mode 100644 .patchew.yml
>
> diff --git a/.patchew.yml b/.patchew.yml
> new file mode 100644
> index 0000000000..54feda823e
> --- /dev/null
> +++ b/.patchew.yml
> @@ -0,0 +1,204 @@
> +# Note: this file is still unused.  It serves as a documentation for the
> +# Patchew configuration in case patchew.org disappears or has to be
> +# reinstalled.
> +
> +git:
> +  push_to: git@github.com:patchew-project/qemu
> +  public_repo: https://github.com/patchew-project/qemu
> +  url_template: https://github.com/patchew-project/qemu/tree/%t

So this is actually Patchew's copy of the QEMU repo where it keeps its
branches that it builds from the emails? It might be worth making that
clear as it is not git.qemu.org.

> +
> +email:
> +  ENOSPC:
> +    event: TestingReport
> +    to: fam@euphon.net
> +    reply_subject: false
> +    set_reply_to: false
> +    subject_template: 'Out of space error for {{ tester }}'
> +    body_template: |
> +      {% if passed %}
> +      {{ cancel }}
> +      {% endif %}
> +
> +      {% if 'No space left on device' in log %}
> +      Tester {{ tester }} out of space when running {{ test }}
> +
> +      {{ log | ansi2text }}
> +      {% else %}
> +      {{ cancel }}
> +      {% endif %}
> +
> +  timeouts:
> +    event: TestingReport
> +    to: fam@euphon.net
> +    body_template: |
> +      {% if not is_timeout %} {{ cancel }} {% endif %}
> +
> +      Test '{{ test }}' timeout, log:
> +
> +      {{ log | ansi2text }}
> +
> +  failures:
> +    event: TestingReport
> +    reply_to_all: true
> +    body_template: |
> +      {% if passed or not obj.message_id or is_timeout %}
> +        {{ cancel }}
> +      {% endif %}
> +      {% if 'No space left on device' in log %}
> +        {{ cancel }}
> +      {% endif %}
> +      Patchew URL: https://patchew.org/QEMU/{{ obj.message_id }}/
> +
> +      {% ansi2text log as logtext %}
> +      {% if test == "checkpatch" %}
> +      Hi,
> +
> +      This series seems to have some coding style problems. See output below for
> +      more information:
> +
> +      {{ logtext }}
> +      {% elif test == "docker-mingw@fedora" or test == "docker-quick@centos7" or test == "asan" %}
> +      Hi,
> +
> +      This series failed the {{ test }} build test. Please find the testing commands and
> +      their output below. If you have Docker installed, you can probably reproduce it
> +      locally.
> +
> +      {% lines_between logtext start="^=== TEST SCRIPT BEGIN ===$" stop="^=== TEST SCRIPT END ===$" %}
> +      {% lines_between logtext start="^=== OUTPUT BEGIN ===$" stop="=== OUTPUT END ===$" as output %}
> +      {% grep_C output regex="\b(FAIL|XPASS|ERROR|WARN|error:|warning:)" n=3 %}
> +      {% elif test == "s390x" or test == "FreeBSD" or test == "ppcle" or test == "ppcbe" %}
> +      Hi,
> +
> +      This series failed build test on {{test}} host. Please find the details below.
> +
> +      {% lines_between logtext start="^=== TEST SCRIPT BEGIN ===$" stop="^=== TEST SCRIPT END ===$" %}
> +      {% lines_between logtext start="^=== OUTPUT BEGIN ===$" stop="=== OUTPUT END ===$" as output %}
> +      {% grep_C output regex="\b(FAIL|XPASS|ERROR|WARN|error:|warning:)" n=3 %}
> +      {% else %}
> +      {{ cancel }}
> +      {% endif %}
> +
> +      The full log is available at
> +      {{ log_url }}.
> +      ---
> +      Email generated automatically by Patchew [http://patchew.org/].
> +      Please send your feedback to patchew-devel@redhat.com
> +
> +testing:
> +  defaults:
> +    - timeout: 3600
> +
> +  requirements:
> +    docker: |
> +      #!/bin/bash
> +      docker ps || sudo -n docker ps

FWIW the docker.py script now uses "docker version" as the test.

> +    x86-kvm: |
> +      #!/bin/bash
> +      set -e
> +      test "$(uname -m)" = x86_64
> +      test -r /dev/kvm
> +      if qemu-system-x86_64 --help >/dev/null 2>&1; then
> +        :
> +      elif /usr/libexec/qemu-kvm --help >/dev/null 2>&1; then
> +        :
> +      else
> +        false
> +      fi
> +    ppcle: |
> +      #!/bin/sh
> +      test "$(uname -m)" = ppc64le
> +    ppcbe: |
> +      #!/bin/sh
> +      test "$(uname -m)" = ppc64
> +    s390x: |
> +      #!/bin/sh
> +      test "$(uname -m)" = s390x
> +
> +  tests:
> +    asan:
> +      requirements: docker
> +      script: |
> +        #!/bin/bash
> +        time make docker-test-debug@fedora TARGET_LIST=x86_64-softmmu J=14 NETWORK=1
> +
> +    docker-clang@ubuntu:
> +      requirements: docker
> +      script: |
> +        #!/bin/bash
> +        time make docker-test-clang@ubuntu SHOW_ENV=1 J=14 NETWORK=1
> +
> +    docker-mingw@fedora:
> +      requirements: docker
> +      script: |
> +        #!/bin/bash
> +        time make docker-test-mingw@fedora SHOW_ENV=1 J=14 NETWORK=1
> +
> +    docker-quick@centos7:
> +      requirements: docker
> +      script: |
> +        #!/bin/bash
> +        time make docker-test-quick@centos7 SHOW_ENV=1 J=14 NETWORK=1
> +
> +    checkpatch:
> +      script: |
> +        #!/bin/bash
> +        git rev-parse base > /dev/null || exit 0
> +        git config --local diff.renamelimit 0
> +        git config --local diff.renames True
> +        git config --local diff.algorithm histogram
> +        ./scripts/checkpatch.pl --mailback base..
> +
> +    FreeBSD:
> +      enabled: false
> +      requirements: x86-kvm
> +      script: |
> +        #!/bin/bash
> +        if qemu-system-x86_64 --help >/dev/null 2>&1; then
> +          QEMU=qemu-system-x86_64
> +        elif /usr/libexec/qemu-kvm --help >/dev/null 2>&1; then
> +          QEMU=/usr/libexec/qemu-kvm
> +        else
> +          exit 1
> +        fi
> +        make vm-build-freebsd J=14 QEMU=$QEMU
> +        exit 0
> +
> +    ppcle:
> +      enabled: false
> +      requirements: ppcle
> +      script: |
> +        #!/bin/bash
> +        INSTALL=$PWD/install
> +        BUILD=$PWD/build
> +        mkdir -p $BUILD $INSTALL
> +        SRC=$PWD
> +        cd $BUILD
> +        $SRC/configure --prefix=$INSTALL
> +        make -j14
> +
> +    ppcbe:
> +      enabled: false
> +      requirements: ppcbe
> +      script: |
> +        #!/bin/bash
> +        INSTALL=$PWD/install
> +        BUILD=$PWD/build
> +        mkdir -p $BUILD $INSTALL
> +        SRC=$PWD
> +        cd $BUILD
> +        $SRC/configure --prefix=$INSTALL
> +        make -j14
> +
> +    s390x:
> +      enabled: false
> +      requirements: ppcle
> +      script: |
> +        #!/bin/bash
> +        INSTALL=$PWD/install
> +        BUILD=$PWD/build
> +        mkdir -p $BUILD $INSTALL
> +        SRC=$PWD
> +        cd $BUILD
> +        $SRC/configure --prefix=$INSTALL
> +        make -j14


--
Alex Bennée

Re: [Qemu-devel] [PATCH] ci: store Patchew configuration in the tree
Posted by Fam Zheng 5 years, 1 month ago

> On Mar 15, 2019, at 17:19, Paolo Bonzini <pbonzini@redhat.com> wrote:
> 
> Patchew cannot yet retrieve the configuration from the QEMU Git tree, but
> this is planned.  In the meanwhile, let's start storing it as YAML
> so that the Patchew configuration (currently accessible only to administrators)
> is public and documented.
> 
> Signed-off-by: Paolo Bonzini <pbonzini@redhat.com>
> ---
> .patchew.yml | 204 +++++++++++++++++++++++++++++++++++++++++++++++++++
> 1 file changed, 204 insertions(+)
> create mode 100644 .patchew.yml
> 
> diff --git a/.patchew.yml b/.patchew.yml
> new file mode 100644
> index 0000000000..54feda823e
> --- /dev/null
> +++ b/.patchew.yml
> @@ -0,0 +1,204 @@
> +# Note: this file is still unused.  It serves as a documentation for the
> +# Patchew configuration in case patchew.org disappears or has to be
> +# reinstalled.
> +
> +git:
> +  push_to: git@github.com:patchew-project/qemu
> +  public_repo: https://github.com/patchew-project/qemu
> +  url_template: https://github.com/patchew-project/qemu/tree/%t
> +
> +email:
> +  ENOSPC:
> +    event: TestingReport
> +    to: fam@euphon.net
> +    reply_subject: false
> +    set_reply_to: false
> +    subject_template: 'Out of space error for {{ tester }}'
> +    body_template: |
> +      {% if passed %}
> +      {{ cancel }}
> +      {% endif %}
> +
> +      {% if 'No space left on device' in log %}
> +      Tester {{ tester }} out of space when running {{ test }}
> +
> +      {{ log | ansi2text }}
> +      {% else %}
> +      {{ cancel }}
> +      {% endif %}
> +
> +  timeouts:
> +    event: TestingReport
> +    to: fam@euphon.net
> +    body_template: |
> +      {% if not is_timeout %} {{ cancel }} {% endif %}
> +
> +      Test '{{ test }}' timeout, log:
> +
> +      {{ log | ansi2text }}
> +
> +  failures:
> +    event: TestingReport
> +    reply_to_all: true
> +    body_template: |
> +      {% if passed or not obj.message_id or is_timeout %}
> +        {{ cancel }}
> +      {% endif %}
> +      {% if 'No space left on device' in log %}
> +        {{ cancel }}
> +      {% endif %}
> +      Patchew URL: https://patchew.org/QEMU/{{ obj.message_id }}/
> +
> +      {% ansi2text log as logtext %}
> +      {% if test == "checkpatch" %}
> +      Hi,
> +
> +      This series seems to have some coding style problems. See output below for
> +      more information:
> +
> +      {{ logtext }}
> +      {% elif test == "docker-mingw@fedora" or test == "docker-quick@centos7" or test == "asan" %}
> +      Hi,
> +
> +      This series failed the {{ test }} build test. Please find the testing commands and
> +      their output below. If you have Docker installed, you can probably reproduce it
> +      locally.
> +
> +      {% lines_between logtext start="^=== TEST SCRIPT BEGIN ===$" stop="^=== TEST SCRIPT END ===$" %}
> +      {% lines_between logtext start="^=== OUTPUT BEGIN ===$" stop="=== OUTPUT END ===$" as output %}
> +      {% grep_C output regex="\b(FAIL|XPASS|ERROR|WARN|error:|warning:)" n=3 %}
> +      {% elif test == "s390x" or test == "FreeBSD" or test == "ppcle" or test == "ppcbe" %}
> +      Hi,
> +
> +      This series failed build test on {{test}} host. Please find the details below.
> +
> +      {% lines_between logtext start="^=== TEST SCRIPT BEGIN ===$" stop="^=== TEST SCRIPT END ===$" %}
> +      {% lines_between logtext start="^=== OUTPUT BEGIN ===$" stop="=== OUTPUT END ===$" as output %}
> +      {% grep_C output regex="\b(FAIL|XPASS|ERROR|WARN|error:|warning:)" n=3 %}
> +      {% else %}
> +      {{ cancel }}
> +      {% endif %}
> +
> +      The full log is available at
> +      {{ log_url }}.
> +      ---
> +      Email generated automatically by Patchew [http://patchew.org/].
> +      Please send your feedback to patchew-devel@redhat.com
> +
> +testing:
> +  defaults:
> +    - timeout: 3600
> +
> +  requirements:
> +    docker: |
> +      #!/bin/bash
> +      docker ps || sudo -n docker ps
> +    x86-kvm: |
> +      #!/bin/bash
> +      set -e
> +      test "$(uname -m)" = x86_64
> +      test -r /dev/kvm
> +      if qemu-system-x86_64 --help >/dev/null 2>&1; then
> +        :
> +      elif /usr/libexec/qemu-kvm --help >/dev/null 2>&1; then
> +        :
> +      else
> +        false
> +      fi
> +    ppcle: |
> +      #!/bin/sh
> +      test "$(uname -m)" = ppc64le
> +    ppcbe: |
> +      #!/bin/sh
> +      test "$(uname -m)" = ppc64
> +    s390x: |
> +      #!/bin/sh
> +      test "$(uname -m)" = s390x
> +
> +  tests:
> +    asan:
> +      requirements: docker
> +      script: |
> +        #!/bin/bash
> +        time make docker-test-debug@fedora TARGET_LIST=x86_64-softmmu J=14 NETWORK=1
> +
> +    docker-clang@ubuntu:
> +      requirements: docker
> +      script: |
> +        #!/bin/bash
> +        time make docker-test-clang@ubuntu SHOW_ENV=1 J=14 NETWORK=1
> +
> +    docker-mingw@fedora:
> +      requirements: docker
> +      script: |
> +        #!/bin/bash
> +        time make docker-test-mingw@fedora SHOW_ENV=1 J=14 NETWORK=1
> +
> +    docker-quick@centos7:
> +      requirements: docker
> +      script: |
> +        #!/bin/bash
> +        time make docker-test-quick@centos7 SHOW_ENV=1 J=14 NETWORK=1
> +
> +    checkpatch:
> +      script: |
> +        #!/bin/bash
> +        git rev-parse base > /dev/null || exit 0
> +        git config --local diff.renamelimit 0
> +        git config --local diff.renames True
> +        git config --local diff.algorithm histogram
> +        ./scripts/checkpatch.pl --mailback base..
> +
> +    FreeBSD:
> +      enabled: false
> +      requirements: x86-kvm
> +      script: |
> +        #!/bin/bash
> +        if qemu-system-x86_64 --help >/dev/null 2>&1; then
> +          QEMU=qemu-system-x86_64
> +        elif /usr/libexec/qemu-kvm --help >/dev/null 2>&1; then
> +          QEMU=/usr/libexec/qemu-kvm
> +        else
> +          exit 1
> +        fi
> +        make vm-build-freebsd J=14 QEMU=$QEMU
> +        exit 0
> +
> +    ppcle:
> +      enabled: false
> +      requirements: ppcle
> +      script: |
> +        #!/bin/bash
> +        INSTALL=$PWD/install
> +        BUILD=$PWD/build
> +        mkdir -p $BUILD $INSTALL
> +        SRC=$PWD
> +        cd $BUILD
> +        $SRC/configure --prefix=$INSTALL
> +        make -j14
> +
> +    ppcbe:
> +      enabled: false
> +      requirements: ppcbe
> +      script: |
> +        #!/bin/bash
> +        INSTALL=$PWD/install
> +        BUILD=$PWD/build
> +        mkdir -p $BUILD $INSTALL
> +        SRC=$PWD
> +        cd $BUILD
> +        $SRC/configure --prefix=$INSTALL
> +        make -j14
> +
> +    s390x:
> +      enabled: false
> +      requirements: ppcle
> +      script: |
> +        #!/bin/bash
> +        INSTALL=$PWD/install
> +        BUILD=$PWD/build
> +        mkdir -p $BUILD $INSTALL
> +        SRC=$PWD
> +        cd $BUILD
> +        $SRC/configure --prefix=$INSTALL
> +        make -j14
> -- 
> 2.20.1
> 
> 

Reviewed-by: Fam Zheng <fam@euphon.net>



Re: [Qemu-devel] [PATCH] ci: store Patchew configuration in the tree
Posted by Andrea Bolognani 5 years, 1 month ago
On Fri, 2019-03-15 at 10:19 +0100, Paolo Bonzini wrote:
[...]
> +    s390x:
> +      enabled: false
> +      requirements: ppcle

This doesn't look right :)

-- 
Andrea Bolognani / Red Hat / Virtualization