From nobody Tue Feb 10 06:26:02 2026 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org+importer=patchew.org@nongnu.org; dmarc=pass(p=none dis=none) header.from=linaro.org ARC-Seal: i=1; a=rsa-sha256; t=1667222647; cv=none; d=zohomail.com; s=zohoarc; b=cCSV6mlAaIkj1yB1kfPg4Cu07p3ieivNziSVDUwFQT2r1kFS7So1B/GDzrdBcyd8xLv1FQn8YV58PIjunds1FZGgYoJa7AEaxpgo4MGJRpAxzV5yGdLazcQS7Gni6nidnmqSYJwNdFMZ9nFwUr7OEx1dQ9dJais50Bc98cHDW0s= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1667222647; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=JbYpYlCRpuLNEiOsilZB4ylHATLxZmTnkB//H2Jyq78=; b=XdadXMewVdvAnssCaj05/nowlNfl4i+/dww/q/2J1sYB2tjlvnAmdVq/za/RRy3Ojb8b7etX8QSuiaH/V/K6uXTV8WiDe2zbuMxOHKsKidpxbn71J73A9Gz+MAaed1yI0cwaxm4GhwJm4isCFwU94dtrGXHRQD8qwNIMTHifyp4= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org+importer=patchew.org@nongnu.org; dmarc=pass header.from= (p=none dis=none) Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1667222647354959.4521104044435; Mon, 31 Oct 2022 06:24:07 -0700 (PDT) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1opUii-0006Hr-Ul; Mon, 31 Oct 2022 09:20:52 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1opUi1-0003Fo-AV for qemu-devel@nongnu.org; Mon, 31 Oct 2022 09:20:09 -0400 Received: from mail-wr1-x433.google.com ([2a00:1450:4864:20::433]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1opUht-0005Sk-I7 for qemu-devel@nongnu.org; Mon, 31 Oct 2022 09:20:08 -0400 Received: by mail-wr1-x433.google.com with SMTP id o4so15947805wrq.6 for ; Mon, 31 Oct 2022 06:20:00 -0700 (PDT) Received: from zen.linaroharston ([185.81.254.11]) by smtp.gmail.com with ESMTPSA id k18-20020a05600c081200b003b4935f04a4sm7772851wmp.5.2022.10.31.06.19.53 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 31 Oct 2022 06:19:55 -0700 (PDT) Received: from zen.lan (localhost [127.0.0.1]) by zen.linaroharston (Postfix) with ESMTP id E51071FFCB; Mon, 31 Oct 2022 13:10:12 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=JbYpYlCRpuLNEiOsilZB4ylHATLxZmTnkB//H2Jyq78=; b=HLim6mGNyK/xYlrVd1lnXAIe2BQg5FJnNDaIZXa1pbV6I9C0dskToFoeHb+9TbUX4b E+WvOSh1jEVVl3qxdB9sXGDgkelUyVJHBAaWfozkKTKpOK+73GfXV8BTAxObO2OXBTcw u3NCYdpSPvBozFQjMBwiE0GzRyRVGuzqjnQP9Hz6CtygiZJwsiN4gLbPOZxYlPg8zPhi pu7qWgblzAml3U+o+ju8kWWUjobcHjw866wz83sl5d+oTder+B5WAIHTIU4hbf5OZS6n ZBYcydU3hDfimK14UxY9Ly46Wvivx2pFtjfmbLsfvMtYg6uG2kxp42pjQYCkRY2Gt9fD Jhfw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=JbYpYlCRpuLNEiOsilZB4ylHATLxZmTnkB//H2Jyq78=; b=p3VVm2kfVz3DqoaqYdZod3X7CqifLabHUh2oI1FgwAsfsmGayqvnsGeF0n8/v82Gfj rip8hn6ZtzdSWnvNCfNoIrWMFJbLSJVpeSqflAx8hePfg7Voki2jiKC50HJ6Izd3ieci ziCqdTZnKA9InU8bITUVEccsckQAFUd7TREQi+4lOKJ4m1OAiQucrMfTTT8nkPhw92rD +qv5AXb0fU0U+JhSbyYzuDUtgq6ccpxdq+8LXe0SIDLzJ+nPxPQl9sAOSHVYi3dhXsCY qJzKQhhIHMXBsdgYmf/yCQWrcVJ9515EsNWwTWu4TdQCiaysqmz9F4415ZhgtmTd3D2e kZtA== X-Gm-Message-State: ACrzQf3blCo81hvJMauxL9JIGaf8FAta6toP9vWDChxK9vSCSXRox0kR u2tqCjftYSvJvbs40Ld8k5E3NQ== X-Google-Smtp-Source: AMsMyM5vUcHrEl3M/xPIo4g1crW+ABM5J7MJ913yiDdHgTZQR3iQxqe0SdPGAZDyXlkq0VmP1Uu6mg== X-Received: by 2002:a5d:49d0:0:b0:236:ba53:ec39 with SMTP id t16-20020a5d49d0000000b00236ba53ec39mr6224136wrs.412.1667222399529; Mon, 31 Oct 2022 06:19:59 -0700 (PDT) From: =?UTF-8?q?Alex=20Benn=C3=A9e?= To: qemu-devel@nongnu.org Cc: stefanha@redhat.com, =?UTF-8?q?Alex=20Benn=C3=A9e?= , =?UTF-8?q?Philippe=20Mathieu-Daud=C3=A9?= , Thomas Huth , Yoshinori Sato , Magnus Damm , Cleber Rosa , Wainer dos Santos Moschetta , Beraldo Leal Subject: [PULL 21/31] tests/avocado: disable sh4 rd2 tests on Gitlab Date: Mon, 31 Oct 2022 13:10:00 +0000 Message-Id: <20221031131010.682984-22-alex.bennee@linaro.org> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20221031131010.682984-1-alex.bennee@linaro.org> References: <20221031131010.682984-1-alex.bennee@linaro.org> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=2a00:1450:4864:20::433; envelope-from=alex.bennee@linaro.org; helo=mail-wr1-x433.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "Qemu-devel" Errors-To: qemu-devel-bounces+importer=patchew.org+importer=patchew.org@nongnu.org X-ZohoMail-DKIM: pass (identity @linaro.org) X-ZM-MESSAGEID: 1667222648827100003 Running repeated invocations on a number of test boxes show a fairly high error rate: $ retry.py -n 100 -c -- ./tests/venv/bin/avocado run tests/avocado/boot_l= inux_console.py:BootLinuxConsole.test_sh4_r2d retry.py called with ['./tests/venv/bin/avocado', 'run', 'tests/avocado/b= oot_linux_console.py:BootLinuxConsole.test_sh4_r2d'] Results: Run, Ret, Pass/Fail, Time, Total Pass, Total Run ... Results summary: 0: 94 times (94.00%), avg time 2.254 (0.00 varience/0.04 deviation) 1: 3 times (3.00%), avg time 1.837 (0.02 varience/0.14 deviation) 8: 3 times (3.00%), avg time 91.288 (0.02 varience/0.15 deviation) Examining the logs they fall into various categories of un-handled unaligned access by user space and unexpected FPU usage by the kernel which ultimately lead to the failure to reach the login prompt. This could be bugs in the translator that only get hit occasionally or just a flaky kernel - its hard to tell. To avoid these failures gating CI lets skip on GitLab. Reviewed-by: Philippe Mathieu-Daud=C3=A9 Signed-off-by: Alex Benn=C3=A9e Cc: Thomas Huth Cc: Yoshinori Sato Cc: Magnus Damm Message-Id: <20221027183637.2772968-21-alex.bennee@linaro.org> diff --git a/tests/avocado/boot_linux_console.py b/tests/avocado/boot_linux= _console.py index eed4b49e6e..4c9d551f47 100644 --- a/tests/avocado/boot_linux_console.py +++ b/tests/avocado/boot_linux_console.py @@ -15,6 +15,7 @@ =20 from avocado import skip from avocado import skipUnless +from avocado import skipIf from avocado_qemu import QemuSystemTest from avocado_qemu import exec_command from avocado_qemu import exec_command_and_wait_for_pattern @@ -1175,6 +1176,10 @@ def test_ppc_mac99(self): self.vm.add_args('-M', 'graphics=3Doff') self.do_test_advcal_2018('15', tar_hash, 'invaders.elf') =20 + # This test has a 6-10% failure rate on various hosts that look + # like issues with a buggy kernel. As a result we don't want it + # gating releases on Gitlab. + @skipIf(os.getenv('GITLAB_CI'), 'Running on GitLab') def test_sh4_r2d(self): """ :avocado: tags=3Darch:sh4 --=20 2.34.1