From nobody Tue Apr 23 22:56:09 2024 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=pass(p=none dis=none) header.from=kernel.org ARC-Seal: i=1; a=rsa-sha256; t=1605319953; cv=none; d=zohomail.com; s=zohoarc; b=LbF+d0plv6OidY/QFxXvKPQ9SX/jElhydMyq5QZ6mVAyyZoaEPXPOmQjYV33+6f1Ilg+Q7fHYGEbkZj+ZOzrHwKeHMJYRXxr/T2enK6F5+FyXSqfata5sCP8BY1y3BqlWbg75mMWKxfcsS1P3ACGWKUEE0BpE5uP4CnRHyStORM= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1605319953; h=Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:Message-ID:References:Sender:Subject:To; bh=qqwU+yNbb0dFRDeWr7unzJJUjS42txAd8xklzn9pc4M=; b=bUIAqX2KebQzresjQuvWeAL9bSS6F9ziVgr8Vf7G6EjISBVhp3iE/ecH9GUJinFDAVCXQsjJAnkQTSSBTzOfDc/gEpydalvuYBAWzrMKdHu1ePVfvg0uQkcuOAmbek6jxmZWJ3/4lxG6To/6RGkDkOCyEzap9lISw+aXf6//x/o= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=pass header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 160531995351741.73996161392688; Fri, 13 Nov 2020 18:12:33 -0800 (PST) Received: from list by lists.xenproject.org with outflank-mailman.27051.55741 (Exim 4.92) (envelope-from ) id 1kdl2t-0006I0-WE; Sat, 14 Nov 2020 02:12:08 +0000 Received: by outflank-mailman (output) from mailman id 27051.55741; Sat, 14 Nov 2020 02:12:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kdl2t-0006Ht-SF; Sat, 14 Nov 2020 02:12:07 +0000 Received: by outflank-mailman (input) for mailman id 27051; Sat, 14 Nov 2020 02:12:06 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kdl2s-0006HX-Nd for xen-devel@lists.xenproject.org; Sat, 14 Nov 2020 02:12:06 +0000 Received: from mail.kernel.org (unknown [198.145.29.99]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id f6f05e91-57df-4183-8251-99cd8b11ad7b; Sat, 14 Nov 2020 02:12:06 +0000 (UTC) Received: from sstabellini-ThinkPad-T480s.hsd1.ca.comcast.net (c-24-130-65-46.hsd1.ca.comcast.net [24.130.65.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 3284B2225D; Sat, 14 Nov 2020 02:12:05 +0000 (UTC) Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kdl2s-0006HX-Nd for xen-devel@lists.xenproject.org; Sat, 14 Nov 2020 02:12:06 +0000 Received: from mail.kernel.org (unknown [198.145.29.99]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id f6f05e91-57df-4183-8251-99cd8b11ad7b; Sat, 14 Nov 2020 02:12:06 +0000 (UTC) Received: from sstabellini-ThinkPad-T480s.hsd1.ca.comcast.net (c-24-130-65-46.hsd1.ca.comcast.net [24.130.65.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 3284B2225D; Sat, 14 Nov 2020 02:12:05 +0000 (UTC) X-Outflank-Mailman: Message body and most headers restored to incoming version X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: f6f05e91-57df-4183-8251-99cd8b11ad7b DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1605319925; bh=FBqpCBRCXyQW7zW1Z4nTkrwi13yRf09HktL4SI8wk1w=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=SU83EcLAvGA9em+JWb/7PacKdsP7KH7JIJVNQIhcOjfxMYXN1zB9KQqwGua4pf4lk TZ0SN/0QOxffxP8D+ksBjHRbmoJ/CS1mu6pISIMSJ3dsh9Km8TvziTVISHdHsU6DDE W2c0U/RMF2K3oaT5PYX5/ABafK2k8juEwpIh2bXk= From: Stefano Stabellini To: andrew.cooper3@citrix.com, cardoe@cardoe.com, wl@xen.org Cc: sstabellini@kernel.org, xen-devel@lists.xenproject.org, Stefano Stabellini Subject: [PATCH 1/2] automation: add a QEMU aarch64 smoke test Date: Fri, 13 Nov 2020 18:12:02 -0800 Message-Id: <20201114021203.24558-1-sstabellini@kernel.org> X-Mailer: git-send-email 2.17.1 In-Reply-To: References: X-ZohoMail-DKIM: pass (identity @kernel.org) Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Use QEMU to start Xen (just the hypervisor) up until it stops because there is no dom0 kernel to boot. It is based on the existing build job unstable-arm64v8. Also use make -j$(nproc) to build Xen. Signed-off-by: Stefano Stabellini --- automation/gitlab-ci/test.yaml | 22 ++++++++++++++++++ automation/scripts/build | 8 +++---- automation/scripts/qemu-smoke-arm64.sh | 32 ++++++++++++++++++++++++++ 3 files changed, 57 insertions(+), 5 deletions(-) create mode 100755 automation/scripts/qemu-smoke-arm64.sh diff --git a/automation/gitlab-ci/test.yaml b/automation/gitlab-ci/test.yaml index 793feafe8b..35346e3f6e 100644 --- a/automation/gitlab-ci/test.yaml +++ b/automation/gitlab-ci/test.yaml @@ -22,6 +22,28 @@ build-each-commit-gcc: - /^coverity-tested\/.*/ - /^stable-.*/ =20 +qemu-smoke-arm64-gcc: + stage: test + image: registry.gitlab.com/xen-project/xen/${CONTAINER} + variables: + CONTAINER: debian:unstable-arm64v8 + script: + - ./automation/scripts/qemu-smoke-arm64.sh 2>&1 | tee qemu-smoke-arm64= .log + dependencies: + - debian-unstable-gcc-arm64 + artifacts: + paths: + - smoke.serial + - '*.log' + when: always + tags: + - arm64 + except: + - master + - smoke + - /^coverity-tested\/.*/ + - /^stable-.*/ + qemu-smoke-x86-64-gcc: stage: test image: registry.gitlab.com/xen-project/xen/${CONTAINER} diff --git a/automation/scripts/build b/automation/scripts/build index 0cd0f3971d..95ad23eadb 100755 --- a/automation/scripts/build +++ b/automation/scripts/build @@ -10,9 +10,9 @@ cc-ver() =20 # random config or default config if [[ "${RANDCONFIG}" =3D=3D "y" ]]; then - make -C xen KCONFIG_ALLCONFIG=3Dtools/kconfig/allrandom.config randcon= fig + make -j$(nproc) -C xen KCONFIG_ALLCONFIG=3Dtools/kconfig/allrandom.con= fig randconfig else - make -C xen defconfig + make -j$(nproc) -C xen defconfig fi =20 # build up our configure options @@ -45,9 +45,7 @@ make -j$(nproc) dist # Extract artifacts to avoid getting rewritten by customised builds cp xen/.config xen-config mkdir binaries -if [[ "${XEN_TARGET_ARCH}" =3D=3D "x86_64" ]]; then - cp xen/xen binaries/xen -fi +cp xen/xen binaries/xen =20 # Build all the configs we care about case ${XEN_TARGET_ARCH} in diff --git a/automation/scripts/qemu-smoke-arm64.sh b/automation/scripts/qe= mu-smoke-arm64.sh new file mode 100755 index 0000000000..a7efbf8b6f --- /dev/null +++ b/automation/scripts/qemu-smoke-arm64.sh @@ -0,0 +1,32 @@ +#!/bin/bash + +set -ex + +# Install QEMU +export DEBIAN_FRONTENT=3Dnoninteractive +apt-get -qy update +apt-get -qy install --no-install-recommends qemu-system-aarch64 \ + u-boot-qemu + +# XXX Silly workaround to get the following QEMU command to work +cp /usr/share/qemu/pvh.bin /usr/share/qemu/efi-virtio.rom +qemu-system-aarch64 \ + -machine virtualization=3Dtrue \ + -cpu cortex-a57 -machine type=3Dvirt \ + -m 512 -display none \ + -machine dumpdtb=3Dbinaries/virt-gicv3.dtb + +rm -f smoke.serial +set +e +echo " booti 0x49000000 - 0x44000000" | timeout -k 1 30 qemu-system-aarch= 64 \ + -machine virtualization=3Dtrue \ + -cpu cortex-a57 -machine type=3Dvirt \ + -m 512 -monitor none -serial stdio \ + -no-reboot \ + -device loader,file=3Dbinaries/virt-gicv3.dtb,force-raw=3Don,addr=3D0x= 44000000 \ + -device loader,file=3Dbinaries/xen,force-raw=3Don,addr=3D0x49000000 \ + -bios /usr/lib/u-boot/qemu_arm64/u-boot.bin |& tee smoke.serial + +set -e +grep -q 'LOADING DOMAIN 0' smoke.serial || exit 1 +exit 0 --=20 2.17.1 From nobody Tue Apr 23 22:56:09 2024 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=pass(p=none dis=none) header.from=kernel.org ARC-Seal: i=1; a=rsa-sha256; t=1605319953; cv=none; d=zohomail.com; s=zohoarc; b=Sxx7xnmIFi1QX8KnaQ+xRoLrLUc3WwEkS3NfouePxcMdUJgsvsMFV0WJZFg51ZWSpzlyROCNgJBJbI+l72w0YR3VPv8YXRlUWxspmUrcjh1nnwBbSRlplYlSZoDKGQE4n12NLbeS1aiE70iG8vTEqY/ocT3pc8UsjQ5DudPWgKk= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1605319953; h=Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:Message-ID:References:Sender:Subject:To; bh=+4gaEDFGffK2IddX9hp/y0tdHi89bN8RWSW8zWjYea0=; b=GotQk2OFUpnQoBcd1tUr9Alr862RXNrRWBoYGtqCpiYBM6nIBIifl0IQgZq70VOyZ3g77HgekJJQTSsUq+ZMa0+87H7lU3ABvlDmfSBgwpiFGdPnIfiAU362eAtNAgUvhGSoX3Opk7aS2IH4MSCZ9nfM+xcZAUVEFtg6cc0X+SM= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=pass header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1605319953420355.3786961116515; Fri, 13 Nov 2020 18:12:33 -0800 (PST) Received: from list by lists.xenproject.org with outflank-mailman.27052.55747 (Exim 4.92) (envelope-from ) id 1kdl2u-0006IW-Bi; Sat, 14 Nov 2020 02:12:08 +0000 Received: by outflank-mailman (output) from mailman id 27052.55747; Sat, 14 Nov 2020 02:12:08 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kdl2u-0006II-4B; Sat, 14 Nov 2020 02:12:08 +0000 Received: by outflank-mailman (input) for mailman id 27052; Sat, 14 Nov 2020 02:12:07 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kdl2t-0006HX-54 for xen-devel@lists.xenproject.org; Sat, 14 Nov 2020 02:12:07 +0000 Received: from mail.kernel.org (unknown [198.145.29.99]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 35034942-9481-4946-a3c5-b9acff4eb3c7; Sat, 14 Nov 2020 02:12:06 +0000 (UTC) Received: from sstabellini-ThinkPad-T480s.hsd1.ca.comcast.net (c-24-130-65-46.hsd1.ca.comcast.net [24.130.65.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 9F8F422261; Sat, 14 Nov 2020 02:12:05 +0000 (UTC) Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kdl2t-0006HX-54 for xen-devel@lists.xenproject.org; Sat, 14 Nov 2020 02:12:07 +0000 Received: from mail.kernel.org (unknown [198.145.29.99]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 35034942-9481-4946-a3c5-b9acff4eb3c7; Sat, 14 Nov 2020 02:12:06 +0000 (UTC) Received: from sstabellini-ThinkPad-T480s.hsd1.ca.comcast.net (c-24-130-65-46.hsd1.ca.comcast.net [24.130.65.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 9F8F422261; Sat, 14 Nov 2020 02:12:05 +0000 (UTC) X-Outflank-Mailman: Message body and most headers restored to incoming version X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: 35034942-9481-4946-a3c5-b9acff4eb3c7 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1605319925; bh=91tedtBqSR/PprDuGd1wddKAk0sf1gu/9Y2miqIdwYc=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=DKs91J+WyJcDhkUMgag8WI4czY6yMYgw4ef5yTPe7+NOcRPTnj+EPEophNMkyP48b /Bhb4z2nFC2WMQrQHIYvx4lvhlbk/vYGd5HRDgTwc7nxp5Mu3lNt9D1ryl53EyhOAp cJLVAtktIUq8yyzSTeDiJsR2hLxfyvB+CuKC0y+w= From: Stefano Stabellini To: andrew.cooper3@citrix.com, cardoe@cardoe.com, wl@xen.org Cc: sstabellini@kernel.org, xen-devel@lists.xenproject.org, Stefano Stabellini Subject: [PATCH 2/2] automation: add dom0less to the QEMU aarch64 smoke test Date: Fri, 13 Nov 2020 18:12:03 -0800 Message-Id: <20201114021203.24558-2-sstabellini@kernel.org> X-Mailer: git-send-email 2.17.1 In-Reply-To: References: X-ZohoMail-DKIM: pass (identity @kernel.org) Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Add a trivial dom0less test: - build Linux defconfig arm64 to be used as dom0/U kernel - use busybox-static to create a trivial dom0/U ramdisk - use ImageBuilder to generate the uboot boot script automatically - install and use u-boot from the Debian package to start the test - binaries are loaded from uboot via tftp Disabling the pl061 device is required to get any version of Linux to boot on Xen on qemu-system-aarch64. Signed-off-by: Stefano Stabellini --- automation/gitlab-ci/test.yaml | 1 + automation/scripts/qemu-smoke-arm64.sh | 87 +++++++++++++++++++++++--- 2 files changed, 81 insertions(+), 7 deletions(-) diff --git a/automation/gitlab-ci/test.yaml b/automation/gitlab-ci/test.yaml index 35346e3f6e..76eff1004e 100644 --- a/automation/gitlab-ci/test.yaml +++ b/automation/gitlab-ci/test.yaml @@ -27,6 +27,7 @@ qemu-smoke-arm64-gcc: image: registry.gitlab.com/xen-project/xen/${CONTAINER} variables: CONTAINER: debian:unstable-arm64v8 + LINUX_VERSION: 5.9.8 script: - ./automation/scripts/qemu-smoke-arm64.sh 2>&1 | tee qemu-smoke-arm64= .log dependencies: diff --git a/automation/scripts/qemu-smoke-arm64.sh b/automation/scripts/qe= mu-smoke-arm64.sh index a7efbf8b6f..e8dc5b19cb 100755 --- a/automation/scripts/qemu-smoke-arm64.sh +++ b/automation/scripts/qemu-smoke-arm64.sh @@ -6,27 +6,100 @@ set -ex export DEBIAN_FRONTENT=3Dnoninteractive apt-get -qy update apt-get -qy install --no-install-recommends qemu-system-aarch64 \ - u-boot-qemu + u-boot-qemu \ + u-boot-tools \ + device-tree-compiler \ + busybox-static \ + curl \ + cpio \ + bc =20 # XXX Silly workaround to get the following QEMU command to work cp /usr/share/qemu/pvh.bin /usr/share/qemu/efi-virtio.rom qemu-system-aarch64 \ -machine virtualization=3Dtrue \ -cpu cortex-a57 -machine type=3Dvirt \ - -m 512 -display none \ + -m 1024 -display none \ -machine dumpdtb=3Dbinaries/virt-gicv3.dtb +# XXX disable pl061 to avoid Linux crash +dtc -I dtb -O dts binaries/virt-gicv3.dtb > binaries/virt-gicv3.dts +sed 's/compatible =3D "arm,pl061.*/status =3D "disabled";/g' binaries/virt= -gicv3.dts > binaries/virt-gicv3-edited.dts +dtc -I dts -O dtb binaries/virt-gicv3-edited.dts > binaries/virt-gicv3.dtb =20 + +# Busybox Dom0 +mkdir -p initrd +mkdir -p initrd/bin +mkdir -p initrd/sbin +mkdir -p initrd/etc +mkdir -p initrd/dev +mkdir -p initrd/proc +mkdir -p initrd/sys +mkdir -p initrd/lib +mkdir -p initrd/var +mkdir -p initrd/mnt +cp /bin/busybox initrd/bin/busybox +initrd/bin/busybox --install initrd/bin +echo "#!/bin/sh + +mount -t proc proc /proc +mount -t sysfs sysfs /sys +mount -t devtmpfs devtmpfs /dev +/bin/sh" > initrd/init +chmod +x initrd/init +cd initrd +find . | cpio --create --format=3D'newc' | gzip > ../binaries/initrd +cd .. + + +# Linux Dom0 +curl -fsSLO https://cdn.kernel.org/pub/linux/kernel/v5.x/linux-"$LINUX_VER= SION".tar.xz +tar xvJf linux-"$LINUX_VERSION".tar.xz +cd linux-"$LINUX_VERSION" +make defconfig +make -j$(nproc) Image.gz +cp arch/arm64/boot/Image ../binaries +cd .. + + +# ImageBuilder +echo 'MEMORY_START=3D"0x40000000" +MEMORY_END=3D"0x80000000" + +DEVICE_TREE=3D"virt-gicv3.dtb" +XEN=3D"xen" +DOM0_KERNEL=3D"Image" +DOM0_RAMDISK=3D"initrd" +XEN_CMD=3D"console=3Ddtuart dom0_mem=3D512M" + +NUM_DOMUS=3D1 +DOMU_KERNEL[0]=3D"Image" +DOMU_RAMDISK[0]=3D"initrd" +DOMU_MEM[0]=3D"256" + +LOAD_CMD=3D"tftpb" +UBOOT_SOURCE=3D"boot.source" +UBOOT_SCRIPT=3D"boot.scr"' > binaries/config +rm -rf imagebuilder +git clone https://gitlab.com/ViryaOS/imagebuilder +bash imagebuilder/scripts/uboot-script-gen -t tftp -d binaries/ -c binarie= s/config + + +# Run the test rm -f smoke.serial set +e -echo " booti 0x49000000 - 0x44000000" | timeout -k 1 30 qemu-system-aarch= 64 \ +echo " virtio scan; dhcp; tftpb 0x40000000 boot.scr; source 0x40000000"| \ +timeout -k 1 240 \ +qemu-system-aarch64 \ -machine virtualization=3Dtrue \ -cpu cortex-a57 -machine type=3Dvirt \ - -m 512 -monitor none -serial stdio \ + -m 1024 -monitor none -serial stdio \ + -smp 2 \ -no-reboot \ - -device loader,file=3Dbinaries/virt-gicv3.dtb,force-raw=3Don,addr=3D0x= 44000000 \ - -device loader,file=3Dbinaries/xen,force-raw=3Don,addr=3D0x49000000 \ + -device virtio-net-pci,netdev=3Dn0 \ + -netdev user,id=3Dn0,tftp=3Dbinaries \ -bios /usr/lib/u-boot/qemu_arm64/u-boot.bin |& tee smoke.serial =20 set -e -grep -q 'LOADING DOMAIN 0' smoke.serial || exit 1 +(grep -q "^BusyBox" smoke.serial && grep -q "DOM1: BusyBox" smoke.serial) = || exit 1 exit 0 --=20 2.17.1