From nobody Sun May 19 10:57:19 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=fail; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org ARC-Seal: i=1; a=rsa-sha256; t=1595576250; cv=none; d=zohomail.com; s=zohoarc; b=n+4rD5zpkf4eAHI0LiqNiv1obSCmrlS33trwgIFAi/b1mAenXymnuX8nBMZO9z8H4/9/8FKNw+/6592Sn4ai2HRfIKmND74YDMYAacsjEbtSZ1SqsEilH+PMVV/8bubvgJVQ7wrg39hl7fnLXDpCviBBOqAI0xNaUkKqz2/vlnc= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1595576250; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=7cMvOSWjQxG4l/hFTBITd2GgwV3T+QNXvLQiMS0D5/w=; b=CjOvaTNOXrDKS/hImEOtAiRobccUEl6XlyNwoM/EuBASJoCATGPyBUA2REfYqfkQa5LIT8kussptqM4PZCOnDk6BnAaUPz44Ry1HWmbIXhTbjG28lPyFxgPjnhQkiSd9DhH6kwer26qQEzdYbR7hTUvw5fw/jNATqufCqK1bbOc= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=fail; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 15955762503101002.7650927478061; Fri, 24 Jul 2020 00:37:30 -0700 (PDT) Received: from localhost ([::1]:39502 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jysGn-0000Dh-8J for importer@patchew.org; Fri, 24 Jul 2020 03:37:29 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:50776) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jysEv-0006Up-W7 for qemu-devel@nongnu.org; Fri, 24 Jul 2020 03:35:34 -0400 Received: from mail-wr1-x442.google.com ([2a00:1450:4864:20::442]:36644) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jysEu-0007iu-Gu for qemu-devel@nongnu.org; Fri, 24 Jul 2020 03:35:33 -0400 Received: by mail-wr1-x442.google.com with SMTP id 88so7372752wrh.3 for ; Fri, 24 Jul 2020 00:35:32 -0700 (PDT) Received: from localhost.localdomain (138.red-83-57-170.dynamicip.rima-tde.net. [83.57.170.138]) by smtp.gmail.com with ESMTPSA id y189sm7319431wmd.27.2020.07.24.00.35.26 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 24 Jul 2020 00:35:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=7cMvOSWjQxG4l/hFTBITd2GgwV3T+QNXvLQiMS0D5/w=; b=Bv1KVqjdke+HgjClA6GsmwjCxFJ73Amu/nIf51e/IkET5Z4iq4dgfTOmKLUOHezaTf AVZBBMm1D70gGon5lbnRl7Qvq7MXAH8f0pj1McJo2lNbmVgYb2acJbOBPxU4weyGIOpM vKegew2ICkRaUgiIqkEE3PDM0IDl3FNIOXCOCLw5/saX6xDPpJ58P1p8FLcjf3GawD/z rL4nLErtqF1mbnxROaK5kPJNCKBDjuq7fLtN05tGGW7MwTfSvt7EXB5SHrfl0fw23V4P 6e8oE5y89+JE0LxVGaYzz9C0kfy7zLLk9UzM/FtlWUOVME5sXEK6c5RW97QHikCbuAD4 YtVg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:to:cc:subject:date:message-id :in-reply-to:references:mime-version:content-transfer-encoding; bh=7cMvOSWjQxG4l/hFTBITd2GgwV3T+QNXvLQiMS0D5/w=; b=MIjf1QwikTzk39OxmAT0Yb4fppWq/NZcK/QEBAwePNEQ7JEvipPTHvq7E0h3PbWayN SDKCw/HZftTMKDzZlHuPptKGpBvQyTkvpvZ/CxofoUjQChAjxw/mzJHONazwKp27XBwM yCE5tyAEB6rTCmwUCRg6/S+KsaHxDhZut8N/f+URslI4PE1VsXMp0Tu9A5Q/bZfV+Mf7 LnB2RaDYxEnapXsYBiXUKVoI7ozg1HVFcykiLZ6FdOAvFfgyp0S+S8nFLufZq0JFizpe o6ZQl8vd7jFtiJ5og8p9KTlryfmu8m9u2lvIfRxigLpOcCvWXAN7jq11Gd2nhhmzI99i x5cg== X-Gm-Message-State: AOAM530jL38BlWYe0OsMvHvoDBZnxhnB6EKaiVMqCRfXMS30IBkGEF6v VztkTznQFPkSpx/ZiRbH3Om+W4hNPEA= X-Google-Smtp-Source: ABdhPJzTqPEzeH6IlT1krQuZC0KOlr2bN1QoVAqU/eXfxTVM5X45C7YuLFZZSnzza9VBfnnLUA4ljQ== X-Received: by 2002:adf:a195:: with SMTP id u21mr7804146wru.296.1595576127822; Fri, 24 Jul 2020 00:35:27 -0700 (PDT) From: =?UTF-8?q?Philippe=20Mathieu-Daud=C3=A9?= To: qemu-devel@nongnu.org Subject: [PATCH 1/2] tests: Add 'fetch-acceptance' rule Date: Fri, 24 Jul 2020 09:35:23 +0200 Message-Id: <20200724073524.26589-2-f4bug@amsat.org> X-Mailer: git-send-email 2.21.3 In-Reply-To: <20200724073524.26589-1-f4bug@amsat.org> References: <20200724073524.26589-1-f4bug@amsat.org> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=2a00:1450:4864:20::442; envelope-from=philippe.mathieu.daude@gmail.com; helo=mail-wr1-x442.google.com X-detected-operating-system: by eggs.gnu.org: No matching host in p0f cache. That's all we know. X-Spam_score_int: 0 X-Spam_score: 0.0 X-Spam_bar: / X-Spam_report: (0.0 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FORGED_FROMDOMAIN=1, FREEMAIL_FROM=0.001, HEADER_FROM_DIFFERENT_DOMAINS=1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Thomas Huth , =?UTF-8?q?Philippe=20Mathieu-Daud=C3=A9?= , Wainer dos Santos Moschetta , Willian Rampazzo , Cleber Rosa , =?UTF-8?q?Alex=20Benn=C3=A9e?= Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) Add a rule to fetch acceptance test assets. This is particularly useful in a CI context, when a single job can fetch and save the cache so other jobs reuse it directly. It is also useful to measure the time spent downloading the assets versus the time spent running the tests. Signed-off-by: Philippe Mathieu-Daud=C3=A9 --- tests/Makefile.include | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/tests/Makefile.include b/tests/Makefile.include index c7e4646ded..238974d8da 100644 --- a/tests/Makefile.include +++ b/tests/Makefile.include @@ -944,6 +944,15 @@ get-vm-image-fedora-31-%: check-venv # download all vm images, according to defined targets get-vm-images: check-venv $(patsubst %,get-vm-image-fedora-31-%, $(FEDORA_= 31_DOWNLOAD)) =20 +# fetch acceptance test assets +fetch-acceptance: check-venv + $(call quiet-command, \ + $(TESTS_VENV_DIR)/bin/python -m avocado \ + $(if $(V),--show=3D$(AVOCADO_SHOW)) \ + assets fetch \ + $(wildcard tests/acceptance/*.py), \ + "AVOCADO", "tests/acceptance") + check-acceptance: check-venv $(TESTS_RESULTS_DIR) get-vm-images $(call quiet-command, \ $(TESTS_VENV_DIR)/bin/python -m avocado \ --=20 2.21.3 From nobody Sun May 19 10:57:19 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=fail; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail(p=none dis=none) header.from=amsat.org ARC-Seal: i=1; a=rsa-sha256; t=1595576189; cv=none; d=zohomail.com; s=zohoarc; b=Wd2UqCeOfwCJDB/LXIcyc10pnFbPS+8FxpLSbBloqqDgro3PELi5SfvYpnUrcD/QwqJSN6n33dP0DtFxCV9eMZ7a+ACFocIZpr6hQCnJ0Sr4q3wgprs15CR+Q/bMoYgb0xtSXZ9MIvSptaMNjvnmkyBHWqqRnYhCk4PiVPUE7TE= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1595576189; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=/nVeHrs+IFFkRgjIADjEwV9dEpLKvbbwCYJXCwf1BeI=; b=ndshjwws2bkAaNKmWjca0iUTh6sF47XmZV/rUFpssjRZZTyelJIbcw915R581UwgNExhln/fSQV5j/FbGj2d+gA7FoQFU8ZGhJ69+atAndjXNELrVY1cOEpBfB51BcqitFCtY34ToJM5Twq2gi/kqwu2MhY0AwqLVbkJoFR2Wjg= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=fail; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1595576189035249.94571676707176; Fri, 24 Jul 2020 00:36:29 -0700 (PDT) Received: from localhost ([::1]:36404 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jysFn-0007P9-QI for importer@patchew.org; Fri, 24 Jul 2020 03:36:27 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:50744) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jysEu-0006TD-QP for qemu-devel@nongnu.org; Fri, 24 Jul 2020 03:35:32 -0400 Received: from mail-wr1-x441.google.com ([2a00:1450:4864:20::441]:43099) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jysEt-0007iM-6I for qemu-devel@nongnu.org; Fri, 24 Jul 2020 03:35:32 -0400 Received: by mail-wr1-x441.google.com with SMTP id a15so7356009wrh.10 for ; Fri, 24 Jul 2020 00:35:30 -0700 (PDT) Received: from localhost.localdomain (138.red-83-57-170.dynamicip.rima-tde.net. [83.57.170.138]) by smtp.gmail.com with ESMTPSA id y189sm7319431wmd.27.2020.07.24.00.35.27 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 24 Jul 2020 00:35:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=/nVeHrs+IFFkRgjIADjEwV9dEpLKvbbwCYJXCwf1BeI=; b=I02u5wJBiLca+W3GZkg7t5P6RtnAv03uxG9xwridN7adS3XkOLjmzCU1Vb06MBo+bt ju2MI1WNCCxKx5tzVbBM2oQAVOsN/6Jnkwu1xjCRaJl2Wy+fte8WOEr+M4WsFYjIHrIg TASAJzF1C5UJfFCjGhnTPgPf3ik9JmakkS+7v4eHqdNKLnQRZ+bxFrMej3o9gLhymn1Z S6RrEA2XzW3AyYbzA6d2XWjg544qcaa6Miz35HAOm85orRSaGI3I+paHOa6pHlafdTnk OzWFU/Gzgj7ux++gAqiraqo+rPI04LPT5RX9+b0awwFKGS9T6x6zg3FKT34NEjbHhBBM +IIw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:to:cc:subject:date:message-id :in-reply-to:references:mime-version:content-transfer-encoding; bh=/nVeHrs+IFFkRgjIADjEwV9dEpLKvbbwCYJXCwf1BeI=; b=DRmprG4UjRnO+AkMS3ARG/da1e519rK0N8zTl5Yj8Eb6yt0amYjGg2svivqJ+uozXJ bbVa4ZxzEm5W8MspPjjhIVH16i3pdt6+rSFlHKVMOOQx1fyIWk6UtjzPOHxTA2mEoBBq W+/KvPftnF2MhVP9bphUpW0cGcTQvM6lARP/5ZLBCuUe+ey/JPK7DcD9AsZKrL8Vm3vh nzwioip4v3EkteExmP1VBvb5+/12DJWt2R2kRb/Yp9lcpyNRSy6y6VzrfpUaxAo/QSQw JGtBUuis9pPtBMTQelcWWTQMKQ7j2WWLdzBUvoxMIg/bn4xWL+1piDT/HK2Ha9/6JdcV HAmA== X-Gm-Message-State: AOAM533voDotrWv0Ap5tx6jR9aZ8sP8yMBewhqDaK0YHImlU33vENZRj EsqsiRpO7xyM2P5FU1bFfU9+Kx40siI= X-Google-Smtp-Source: ABdhPJwWJd5KI2p8hLX/Fga/I+vhdouHT/rMnyPZw5xLqhyqclKNXFFfaMjPCRTRjgarIoFe0NIwvQ== X-Received: by 2002:adf:f58c:: with SMTP id f12mr7300577wro.314.1595576128853; Fri, 24 Jul 2020 00:35:28 -0700 (PDT) From: =?UTF-8?q?Philippe=20Mathieu-Daud=C3=A9?= To: qemu-devel@nongnu.org Subject: [PATCH 2/2] tests: Exclude 'boot_linux.py' from fetch-acceptance rule Date: Fri, 24 Jul 2020 09:35:24 +0200 Message-Id: <20200724073524.26589-3-f4bug@amsat.org> X-Mailer: git-send-email 2.21.3 In-Reply-To: <20200724073524.26589-1-f4bug@amsat.org> References: <20200724073524.26589-1-f4bug@amsat.org> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=2a00:1450:4864:20::441; envelope-from=philippe.mathieu.daude@gmail.com; helo=mail-wr1-x441.google.com X-detected-operating-system: by eggs.gnu.org: No matching host in p0f cache. That's all we know. X-Spam_score_int: 0 X-Spam_score: 0.0 X-Spam_bar: / X-Spam_report: (0.0 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FORGED_FROMDOMAIN=1, FREEMAIL_FROM=0.001, HEADER_FROM_DIFFERENT_DOMAINS=1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Thomas Huth , =?UTF-8?q?Philippe=20Mathieu-Daud=C3=A9?= , Wainer dos Santos Moschetta , Willian Rampazzo , Cleber Rosa , =?UTF-8?q?Alex=20Benn=C3=A9e?= Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) The boot_linux.py file triggers an exception: $ make fetch-acceptance AVOCADO tests/acceptance Fetching assets from tests/acceptance/empty_cpu_model.py. Fetching assets from tests/acceptance/vnc.py. Fetching assets from tests/acceptance/boot_linux_console.py. Fetching assets from tests/acceptance/boot_linux.py. Traceback (most recent call last): File "/var/tmp/qemu-builddir/tests/venv/lib64/python3.7/site-packages/a= vocado/__main__.py", line 11, in sys.exit(main.run()) File "/var/tmp/qemu-builddir/tests/venv/lib64/python3.7/site-packages/a= vocado/core/app.py", line 91, in run return method(self.parser.config) File "/var/tmp/qemu-builddir/tests/venv/lib64/python3.7/site-packages/a= vocado/plugins/assets.py", line 291, in run success, fail =3D fetch_assets(test_file) File "/var/tmp/qemu-builddir/tests/venv/lib64/python3.7/site-packages/a= vocado/plugins/assets.py", line 200, in fetch_assets handler =3D FetchAssetHandler(test_file, klass, method) File "/var/tmp/qemu-builddir/tests/venv/lib64/python3.7/site-packages/a= vocado/plugins/assets.py", line 65, in __init__ self.visit(self.tree) File "/usr/lib64/python3.7/ast.py", line 271, in visit return visitor(node) File "/usr/lib64/python3.7/ast.py", line 279, in generic_visit self.visit(item) File "/usr/lib64/python3.7/ast.py", line 271, in visit return visitor(node) File "/var/tmp/qemu-builddir/tests/venv/lib64/python3.7/site-packages/a= vocado/plugins/assets.py", line 139, in visit_ClassDef self.generic_visit(node) File "/usr/lib64/python3.7/ast.py", line 279, in generic_visit self.visit(item) File "/usr/lib64/python3.7/ast.py", line 271, in visit return visitor(node) File "/var/tmp/qemu-builddir/tests/venv/lib64/python3.7/site-packages/a= vocado/plugins/assets.py", line 171, in visit_Assign self.asgmts[cur_klass][cur_method][name] =3D node.value.s KeyError: 'launch_and_wait' make: *** [tests/Makefile.include:949: fetch-acceptance] Error 1 Exclude it for now. We will revert this commit once the script is fixed. Signed-off-by: Philippe Mathieu-Daud=C3=A9 --- tests/Makefile.include | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/tests/Makefile.include b/tests/Makefile.include index 238974d8da..7c9cf7a818 100644 --- a/tests/Makefile.include +++ b/tests/Makefile.include @@ -950,7 +950,7 @@ fetch-acceptance: check-venv $(TESTS_VENV_DIR)/bin/python -m avocado \ $(if $(V),--show=3D$(AVOCADO_SHOW)) \ assets fetch \ - $(wildcard tests/acceptance/*.py), \ + $(filter-out tests/acceptance/boot_linux.py,$(wildcard tests/a= cceptance/*.py)), \ "AVOCADO", "tests/acceptance") =20 check-acceptance: check-venv $(TESTS_RESULTS_DIR) get-vm-images --=20 2.21.3