From nobody Wed May 22 02:05:47 2024 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Authentication-Results: mx.zohomail.com; dkim=fail; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail(p=none dis=none) header.from=linaro.org ARC-Seal: i=1; a=rsa-sha256; t=1578523862; cv=none; d=zohomail.com; s=zohoarc; b=Vv0UI1xzIGuq1vbIKqw7TiXIiiv4Fa25HB9+lq7XKPDwN6vem6/QjA7ltJKc0g7mlomurzJrTT7/iDNbNk2yiDlSPopzNPTb6TA/D2AGeZKUNaheyJqnr0qc59hsAoRzrV5K8TgaEk7oKJrdV0WJtM7ccTuSd2NQXBWMahuLZuA= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1578523862; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:Sender:Subject:To; bh=juWdlFfCQgG7NNhvtKKXUAUEZcw1xkA/MgzcDE7RTAk=; b=WbLLTHERMA40MFnTeBo9nY5nS7bqWfCRiOojHA0E2Pz9JwNn4ExD77JrtntAz6T/U0Yad2/uH1qr+TIc1qEOtxXgBsR7mJadHKnSd6ctOfUMuQSIxy0B6Bi8M4a4e7RS/phGdpR5IMJOIajyKm1C9wyuuE7fB6fh8lhDq5K0+ww= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=fail; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1578523862125619.0057244416951; Wed, 8 Jan 2020 14:51:02 -0800 (PST) Received: from localhost ([::1]:50154 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ipKAG-0003OB-HA for importer@patchew.org; Wed, 08 Jan 2020 17:51:00 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:36116) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ipK9N-0002eg-GA for qemu-devel@nongnu.org; Wed, 08 Jan 2020 17:50:07 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ipK9L-00067Q-JW for qemu-devel@nongnu.org; Wed, 08 Jan 2020 17:50:05 -0500 Received: from mail-wr1-x442.google.com ([2a00:1450:4864:20::442]:46848) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1ipK9L-00065W-BD for qemu-devel@nongnu.org; Wed, 08 Jan 2020 17:50:03 -0500 Received: by mail-wr1-x442.google.com with SMTP id z7so5168776wrl.13 for ; Wed, 08 Jan 2020 14:50:02 -0800 (PST) Received: from zen.linaroharston ([51.148.130.216]) by smtp.gmail.com with ESMTPSA id z21sm654697wml.5.2020.01.08.14.50.00 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 08 Jan 2020 14:50:00 -0800 (PST) Received: from zen.lan (localhost [127.0.0.1]) by zen.linaroharston (Postfix) with ESMTP id 6CA3A1FF87; Wed, 8 Jan 2020 22:49:59 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=juWdlFfCQgG7NNhvtKKXUAUEZcw1xkA/MgzcDE7RTAk=; b=HYDgFLIDUDXKgOP07UDaydZIbNTBp6QgOJOSYg75Er5ZkkVO5AaRKPfSNTGVLfAGVt M3DTLE7OOxrjfaaXWMH/p/7Vc/bKKCBoQdi0ZzFxbFg6xtBZ4XYCmIhi97g6n0Y4fK+O PUrjvq165UwomTUZdf7fUax8BW9ItjaYR7ptvHld5DJ5RlmVLvCJGs6Zax0TtGm4vGst lRH+WkaPr4UGMVeyRAccz+xkA5In5YESyjoFCr0c4443/tepj0vZ9SNt623InEnPUST9 KOBFS+yPqrziJOxRoDZnl07GjRQm3Ryi3rXT2FRpcWlth+30jMtuiEJ6jswpNjj/EhLn IPhA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=juWdlFfCQgG7NNhvtKKXUAUEZcw1xkA/MgzcDE7RTAk=; b=RhsHOPTaKs+U8MlrcsOBzywBWkCa889LCKxVWinSjfRW43YdjXy8JREoLEXSDL60jn eUK/v+pPCRQqQm0R1hZv7QwA7cHdpE9H1vmzzpB9ubgOTGmS/itBYVPF3iqTZ3RI6k10 /6OHYXRjb0Qdms+Laxfw5ZVXXhWtI+Ajq/z3LFsoMzd6+F0ManPhL6Iv94No0Mc6BSO5 yxAPTtQ+g0iDEHv0nspI6qfLA4bTH4MjUB1GWodEEEiduHrN52J2SryD7439TfHv1QTZ qQeCJsLAbJNBgKd0qisx5PlmrsnZRiuxSrH2y97XRQ9EIPvV9yxQ4U/apathW1WscFdN oePQ== X-Gm-Message-State: APjAAAVrGuWg1zxaTHOZkk/W2w7YmPfPPPTIHmu1hkKH5QmxQA8AQCz1 u/Q9HAGSPBDL59rTvxaqHwv6Yw== X-Google-Smtp-Source: APXvYqzdt3NnHuoXWGxwimKwDbVTrAdM3YC/vyFyvDxCkoCY4/sjG0sajdokPlyvBbRdlrl0DGaBEw== X-Received: by 2002:a5d:494b:: with SMTP id r11mr7218190wrs.184.1578523801559; Wed, 08 Jan 2020 14:50:01 -0800 (PST) From: =?UTF-8?q?Alex=20Benn=C3=A9e?= To: qemu-devel@nongnu.org Subject: [RFC PATCH] travis.yml: split into build stages Date: Wed, 8 Jan 2020 22:49:52 +0000 Message-Id: <20200108224952.17988-1-alex.bennee@linaro.org> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2a00:1450:4864:20::442 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Fam Zheng , =?UTF-8?q?Philippe=20Mathieu-Daud=C3=A9?= , =?UTF-8?q?Alex=20Benn=C3=A9e?= Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) The idea of this is split the build across stages so any failure in one stage will save time running later stages. So far I have have arbitrarily chosen: canary: up-front quick to build and run platforms: common build configurations rest: everything else The ideal should be canary and platforms catch the most common and frequent build breakages and the "rest" aims for completeness. Signed-off-by: Alex Benn=C3=A9e --- .travis.yml | 37 +++++++++++++++++++++++++++++++++++-- 1 file changed, 35 insertions(+), 2 deletions(-) diff --git a/.travis.yml b/.travis.yml index 6c1038a0f1a..648c523ce59 100644 --- a/.travis.yml +++ b/.travis.yml @@ -17,8 +17,12 @@ cache: pip: true directories: - $HOME/avocado/data/cache +stages: + - canary + - platforms + - rest =20 - + =20 addons: apt: packages: @@ -97,17 +101,20 @@ matrix: - env: - CONFIG=3D"--disable-system --static" - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-gcc-default" + stage: canary =20 =20 # we split the system builds as it takes a while to build them all - env: - CONFIG=3D"--disable-user --target-list=3D${MAIN_SOFTMMU_TARGETS}" - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-gcc-default" + stage: canary =20 =20 - env: - CONFIG=3D"--disable-user --target-list-exclude=3D${MAIN_SOFTMMU_= TARGETS}" - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-gcc-default" + stage: canary =20 =20 # Just build tools and run minimal unit and softfloat checks @@ -116,28 +123,33 @@ matrix: - CONFIG=3D"--disable-user --disable-system" - TEST_CMD=3D"make check-unit check-softfloat -j3" - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-gcc-default" + stage: canary =20 =20 # --enable-debug implies --enable-debug-tcg, also runs quite a bit slo= wer - env: - CONFIG=3D"--enable-debug --target-list=3D${MAIN_SOFTMMU_TARGETS}" - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-gcc-debug" + stage: rest =20 =20 # TCG debug can be run just on its own and is mostly agnostic to user/= softmmu distinctions - env: - CONFIG=3D"--enable-debug-tcg --disable-system" - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-gcc-debug-tcg" + stage: rest =20 - + =20 - env: - CONFIG=3D"--disable-linux-aio --disable-cap-ng --disable-attr --= disable-brlapi --disable-libusb --disable-replication --target-list=3D${MAI= N_SOFTMMU_TARGETS}" + stage: rest =20 =20 # Module builds are mostly of interest to major distros - env: - CONFIG=3D"--enable-modules --target-list=3D${MAIN_SOFTMMU_TARGET= S}" - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-gcc-default" + stage: rest =20 =20 # Alternate coroutines implementations are only really of interest to = KVM users @@ -145,11 +157,13 @@ matrix: - env: - CONFIG=3D"--with-coroutine=3Ducontext --disable-tcg" - TEST_CMD=3D"make check-unit -j3 V=3D1" + stage: rest =20 =20 - env: - CONFIG=3D"--with-coroutine=3Dsigaltstack --disable-tcg" - TEST_CMD=3D"make check-unit -j3 V=3D1" + stage: rest =20 =20 # Check we can build docs and tools (out of tree) @@ -158,6 +172,7 @@ matrix: - BASE_CONFIG=3D"--enable-tools --enable-docs" - CONFIG=3D"--target-list=3Dx86_64-softmmu,aarch64-linux-user" - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-gcc-default" + stage: rest addons: apt: packages: @@ -171,11 +186,13 @@ matrix: - CONFIG=3D"--disable-system" - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-clang-default" compiler: clang + stage: platforms =20 =20 - env: - CONFIG=3D"--target-list=3D${MAIN_SOFTMMU_TARGETS} " - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-clang-sanitize" + stage: platforms compiler: clang before_script: - mkdir -p ${BUILD_DIR} && cd ${BUILD_DIR} @@ -185,12 +202,14 @@ matrix: - env: - CONFIG=3D"--disable-user --target-list-exclude=3D${MAIN_SOFTMMU_= TARGETS}" - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-clang-default" + stage: platforms compiler: clang =20 =20 # gprof/gcov are GCC features - env: - CONFIG=3D"--enable-gprof --enable-gcov --disable-pie --target-li= st=3D${MAIN_SOFTMMU_TARGETS}" + stage: rest after_success: - ${SRC_DIR}/scripts/travis/coverage-summary.sh =20 @@ -200,6 +219,7 @@ matrix: - CONFIG=3D"--without-default-devices --disable-user" - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-gcc-default" - TEST_CMD=3D"" + stage: rest =20 =20 # Check the TCG interpreter (TCI) @@ -207,22 +227,26 @@ matrix: - CONFIG=3D"--enable-debug-tcg --enable-tcg-interpreter --disable-= kvm --disable-containers --target-list=3Dalpha-softmmu,arm-softmmu,hppa-softmmu,m68k-so= ftmmu,microblaze-softmmu,moxie-softmmu,ppc-softmmu,s390x-softmmu,x86_64-sof= tmmu" - TEST_CMD=3D"make check-qtest check-tcg V=3D1" + stage: rest =20 =20 # We don't need to exercise every backend with every front-end - env: - CONFIG=3D"--enable-trace-backends=3Dlog,simple,syslog --disable-= system" - TEST_CMD=3D"" + stage: rest =20 =20 - env: - CONFIG=3D"--enable-trace-backends=3Dftrace --target-list=3Dx86_6= 4-softmmu" - TEST_CMD=3D"" + stage: rest =20 =20 - env: - CONFIG=3D"--enable-trace-backends=3Dust --target-list=3Dx86_64-s= oftmmu" - TEST_CMD=3D"" + stage: rest =20 =20 # MacOSX builds - cirrus.yml also tests some MacOS builds including la= test Xcode @@ -232,6 +256,7 @@ matrix: os: osx osx_image: xcode10.3 compiler: clang + stage: platforms addons: homebrew: packages: @@ -256,6 +281,7 @@ matrix: language: python python: - "3.5" + stage: platforms =20 =20 - env: @@ -264,6 +290,7 @@ matrix: language: python python: - "3.6" + stage: platforms =20 =20 # Acceptance (Functional) tests @@ -272,6 +299,7 @@ matrix: - TEST_CMD=3D"make check-acceptance" after_script: - python3 -c 'import json; r =3D json.load(open("tests/results/lat= est/results.json")); [print(t["logfile"]) for t in r["tests"] if t["status"= ] not in ("PASS", "SKIP")]' | xargs cat + stage: rest addons: apt: packages: @@ -321,6 +349,7 @@ matrix: - uuid-dev language: generic compiler: none + stage: platforms env: - COMPILER_NAME=3Dgcc CXX=3Dg++-9 CC=3Dgcc-9 - CONFIG=3D"--cc=3Dgcc-9 --cxx=3Dg++-9 --disable-pie --disable-lin= ux-user" @@ -343,6 +372,7 @@ matrix: - CONFIG=3D"--disable-system --enable-plugins --enable-debug-tcg -= -target-list-exclude=3Dsparc64-linux-user" - TEST_CMD=3D"make -j3 check-tcg V=3D1" - CACHE_NAME=3D"${TRAVIS_BRANCH}-linux-gcc-debug-tcg" + stage: rest =20 =20 # Run check-tcg against softmmu targets @@ -383,6 +413,7 @@ matrix: - libusb-1.0-0-dev - libvdeplug-dev - libvte-2.91-dev + stage: platforms env: - TEST_CMD=3D"make check check-tcg V=3D1" - CONFIG=3D"--disable-containers --target-list=3D${MAIN_SOFTMMU_TA= RGETS}" @@ -412,6 +443,7 @@ matrix: - libusb-1.0-0-dev - libvdeplug-dev - libvte-2.91-dev + stage: platforms env: - TEST_CMD=3D"make check check-tcg V=3D1" - CONFIG=3D"--disable-containers --target-list=3D${MAIN_SOFTMMU_TA= RGETS},ppc64le-linux-user" @@ -441,6 +473,7 @@ matrix: - libusb-1.0-0-dev - libvdeplug-dev - libvte-2.91-dev + stage: platforms env: - TEST_CMD=3D"make check check-tcg V=3D1" - CONFIG=3D"--disable-containers --target-list=3D${MAIN_SOFTMMU_TA= RGETS},s390x-linux-user" --=20 2.20.1