From nobody Sun May 5 08:57:32 2024 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=pass(p=none dis=none) header.from=kernel.org ARC-Seal: i=1; a=rsa-sha256; t=1677888121; cv=none; d=zohomail.com; s=zohoarc; b=T6eEuuLxHusly3uQ0xOjmq3fIuc0KA6gtTJN18IOloJYGty9C9dEkSBvHUv/ZIOYz+Ej1o6KWwgtIejZC6mDjtXE452wmfEYk6QyEbceaTiWSGP7Jx76Cr/+8lks91mQ5qLLWbwcaLEDXMFHCUrvOKnHDCV2EA87B7rqNr/9Fmw= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1677888121; h=Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=65De0X4I0dctqgafRWFxNFryZpPM4cAL6MSjKx8oGOw=; b=Ruovkbe+YpeaYC8I87RLwaumxk5QPJ/1FyalPayVkpIgZhlnCNB2EIH5xOqt1AqOC5lnv1AJDaHua/+uPI18wVQ4zQUD8ndq13MWOgG7hQfeLkOlJmDEKoedyVG1kGF6yiqxyXRn+WbZY4cozEy0PajOSEQxU2epaKX+TbBx46M= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=pass header.from= (p=none dis=none) Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1677888121414601.184845331711; Fri, 3 Mar 2023 16:02:01 -0800 (PST) Received: from list by lists.xenproject.org with outflank-mailman.506265.779405 (Exim 4.92) (envelope-from ) id 1pYFLK-0004Vx-D6; Sat, 04 Mar 2023 00:01:42 +0000 Received: by outflank-mailman (output) from mailman id 506265.779405; Sat, 04 Mar 2023 00:01:42 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1pYFLK-0004Vq-AF; Sat, 04 Mar 2023 00:01:42 +0000 Received: by outflank-mailman (input) for mailman id 506265; Sat, 04 Mar 2023 00:01:40 +0000 Received: from se1-gles-flk1-in.inumbo.com ([94.247.172.50] helo=se1-gles-flk1.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1pYFLI-0004VH-Kg for xen-devel@lists.xenproject.org; Sat, 04 Mar 2023 00:01:40 +0000 Received: from ams.source.kernel.org (ams.source.kernel.org [145.40.68.75]) by se1-gles-flk1.inumbo.com (Halon) with ESMTPS id bc5e28cb-ba1f-11ed-a550-8520e6686977; Sat, 04 Mar 2023 01:01:38 +0100 (CET) Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ams.source.kernel.org (Postfix) with ESMTPS id E1DAAB819FA; Sat, 4 Mar 2023 00:01:37 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id CEC1EC433EF; Sat, 4 Mar 2023 00:01:35 +0000 (UTC) X-Outflank-Mailman: Message body and most headers restored to incoming version X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: bc5e28cb-ba1f-11ed-a550-8520e6686977 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1677888096; bh=l3p5CzfPCMHZRdXXtESCrWVMuXmzOEmp1Lvn+kITVB0=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=WR5h64MaHyYtsxZnlfeW2BxYWnjOSjK0TC7jUUxjr4C7O2LeBb1D1kwtmPlA6sQZc hM57rF+UcbY+gdzHKHdve7y8f9g2ivazi2K+nu2O7x/AMxEsSo842eINOVAn+TOOSZ 5H3Cd0KWjP8er+aWj0eqUD7SzFAqfWqJse6M+FLhwjBkJ2Vv+SkhNYoV1CIJsIKxKl VYEfpMcKdTq7zRaqFRo646O/JJa59C+TUYo4/4lX0h3ECN+lIsorcusSXMY60CaJg6 A9uOxsBRJjxHVd7BS2Vc28iejCKI0iP3U+sojKUEtmr9DDj3YI5Uhs7XbA5csXrOAe nOJvJoLx6IVOg== From: Stefano Stabellini To: xen-devel@lists.xenproject.org Cc: sstabellini@kernel.org, cardoe@cardoe.com, michal.orzel@amd.com, Stefano Stabellini Subject: [PATCH v2 1/2] automation: add Ubuntu container for Xilinx hardware tests Date: Fri, 3 Mar 2023 15:57:18 -0800 Message-Id: <20230303235719.1181690-1-sstabellini@kernel.org> X-Mailer: git-send-email 2.25.1 In-Reply-To: References: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-ZohoMail-DKIM: pass (identity @kernel.org) X-ZM-MESSAGEID: 1677888123679100001 Content-Type: text/plain; charset="utf-8" From: Stefano Stabellini This container is only run on the controller PC (x86) to trigger the test on a connected Xilinx ZCU102 physical board. Signed-off-by: Stefano Stabellini Reviewed-by: Michal Orzel --- .../build/ubuntu/xenial-xilinx.dockerfile | 25 +++++++++++++++++++ 1 file changed, 25 insertions(+) create mode 100644 automation/build/ubuntu/xenial-xilinx.dockerfile diff --git a/automation/build/ubuntu/xenial-xilinx.dockerfile b/automation/= build/ubuntu/xenial-xilinx.dockerfile new file mode 100644 index 0000000000..7e4f5d6605 --- /dev/null +++ b/automation/build/ubuntu/xenial-xilinx.dockerfile @@ -0,0 +1,25 @@ +FROM ubuntu:16.04 +LABEL maintainer.name=3D"The Xen Project " \ + maintainer.email=3D"xen-devel@lists.xenproject.org" + +ENV DEBIAN_FRONTEND=3Dnoninteractive +ENV USER root + +RUN mkdir /build +WORKDIR /build + +# build depends +RUN apt-get update && \ + apt-get --quiet --yes install \ + snmp \ + snmp-mibs-downloader \ + u-boot-tools \ + device-tree-compiler \ + cpio \ + git \ + gzip \ + file \ + && \ + apt-get autoremove -y && \ + apt-get clean && \ + rm -rf /var/lib/apt/lists* /tmp/* /var/tmp/* --=20 2.25.1 From nobody Sun May 5 08:57:32 2024 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=pass(p=none dis=none) header.from=kernel.org ARC-Seal: i=1; a=rsa-sha256; t=1677888123; cv=none; d=zohomail.com; s=zohoarc; b=UTGESH9HMafGXkZoeauX0+8YUMZk3hLWkP6NG2ffuyatXq7zT/T5GbOcmC450ExsoYBdkdICO3HU3heOES4frgiS6fz3y2OPi/1hTBKZuQdQbJprPYP4D9FY4C02u9hftVAMVJOMGcw/7AwatCjVA+mh18bpDFybPgq4dvkTWcQ= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1677888123; h=Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=dkhe1+DMhkwBVgLtCpmEqu5IE1z1F9mazLQLPX6gEfc=; b=Iugu8LNAM24qRc8xV+eieRhzq/ulJUcqrAJbjIP4qq6KX+U8lvTOM8TprOvuOxFY+Sk7MmdSZ6r7KoPH7jWPQKiHwl35RRr6UIxQ0KKsrMmbXIlVwMGi51QxO2oYEswlhDH0Oe3jYJiKAOnlnO6VQWV/5W3vBtePuwnIZwNPqok= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=pass header.from= (p=none dis=none) Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1677888123318930.6480778490702; Fri, 3 Mar 2023 16:02:03 -0800 (PST) Received: from list by lists.xenproject.org with outflank-mailman.506266.779411 (Exim 4.92) (envelope-from ) id 1pYFLK-0004ZE-P1; Sat, 04 Mar 2023 00:01:42 +0000 Received: by outflank-mailman (output) from mailman id 506266.779411; Sat, 04 Mar 2023 00:01:42 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1pYFLK-0004Y9-I1; Sat, 04 Mar 2023 00:01:42 +0000 Received: by outflank-mailman (input) for mailman id 506266; Sat, 04 Mar 2023 00:01:41 +0000 Received: from se1-gles-flk1-in.inumbo.com ([94.247.172.50] helo=se1-gles-flk1.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1pYFLJ-0004VH-Aq for xen-devel@lists.xenproject.org; Sat, 04 Mar 2023 00:01:41 +0000 Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by se1-gles-flk1.inumbo.com (Halon) with ESMTPS id bc57426c-ba1f-11ed-a550-8520e6686977; Sat, 04 Mar 2023 01:01:39 +0100 (CET) Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id 3340E61982; Sat, 4 Mar 2023 00:01:38 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id D776DC433D2; Sat, 4 Mar 2023 00:01:36 +0000 (UTC) X-Outflank-Mailman: Message body and most headers restored to incoming version X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: bc57426c-ba1f-11ed-a550-8520e6686977 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1677888097; bh=+phEMi9uJWD5eDQu2N3CbwqTH5dCe79zdlh6yAq9uFg=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=H/cnVwZDFDvAblgP8B5VpCQj+X8FQe04+PG4AK7HB0al2j6LcvvXz7bWVpKQEY/Kj CUZAjqDSro4NtdtXrjnGfcwfGfPOduMlZnBcTOjJ6IfY0NG3HeXG9ke+3siDGSWpmJ WMdkI6UuVp1cMYa7il4CYb4ARrpk9Ap1LH14QqGX51bFOot59ZedCdBkMRxtJrRCo1 JUvpa+MrVth/keO+OzezlATF/hsWAj+japn900H+JdTcbj1aKqv0p9WTI3eEhRS3J4 aMNfZixZc/tdWvAKTNIt+7PGyxlP+w/vAHvMul9SSVnXwmePNOUO3UCYQTafBmFJai ksXB1mUFLZfvQ== From: Stefano Stabellini To: xen-devel@lists.xenproject.org Cc: sstabellini@kernel.org, cardoe@cardoe.com, michal.orzel@amd.com, Stefano Stabellini Subject: [PATCH v2 2/2] automation: introduce a dom0less test run on Xilinx hardware Date: Fri, 3 Mar 2023 15:57:19 -0800 Message-Id: <20230303235719.1181690-2-sstabellini@kernel.org> X-Mailer: git-send-email 2.25.1 In-Reply-To: References: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-ZohoMail-DKIM: pass (identity @kernel.org) X-ZM-MESSAGEID: 1677888125424100003 Content-Type: text/plain; charset="utf-8" From: Stefano Stabellini The test prepares dom0 and domU binaries and boot artifacts, similarly to the existing QEMU test. (TBD: share preparation steps with the regular QEMU tests.) However, instead of running the test inside QEMU as usual, it copies the binaries to the tftp server root, triggers a Xilinx ZCU102 board reboot, and connects to the real serial of the board. For now and due to its novelty, allow_failure on the Xilinx hardware test, and only run the job on protected branches with XILINX_JOBS set to true (the "master" and "staging" on gitlab.com/xen-project/xen qualify). Signed-off-by: Stefano Stabellini --- Changes in v2: - only execute the xilinx job on protected branches with XILINX_JOBS set to true --- automation/gitlab-ci/test.yaml | 22 ++++ .../scripts/xilinx-smoke-dom0less-arm64.sh | 115 ++++++++++++++++++ 2 files changed, 137 insertions(+) create mode 100755 automation/scripts/xilinx-smoke-dom0less-arm64.sh diff --git a/automation/gitlab-ci/test.yaml b/automation/gitlab-ci/test.yaml index 1c5f400b68..8f94cad32c 100644 --- a/automation/gitlab-ci/test.yaml +++ b/automation/gitlab-ci/test.yaml @@ -85,6 +85,28 @@ build-each-commit-gcc: tags: - x86_64 =20 +xilinx-smoke-dom0less-arm64-gcc: + extends: .test-jobs-common + variables: + CONTAINER: ubuntu:xenial-xilinx + LOGFILE: qemu-smoke-xilinx.log + artifacts: + paths: + - smoke.serial + - '*.log' + when: always + tags: + - xilinx + script: + - ./automation/scripts/xilinx-smoke-dom0less-arm64.sh 2>&1 | tee ${LOG= FILE} + needs: + - *arm64-test-needs + - alpine-3.12-gcc-arm64 + allow_failure: true + only: + variables: + - $XILINX_JOBS =3D=3D "true" && $CI_COMMIT_REF_PROTECTED =3D=3D "tru= e" + qemu-smoke-dom0-arm64-gcc: extends: .qemu-arm64 script: diff --git a/automation/scripts/xilinx-smoke-dom0less-arm64.sh b/automation= /scripts/xilinx-smoke-dom0less-arm64.sh new file mode 100755 index 0000000000..180c8b5f1c --- /dev/null +++ b/automation/scripts/xilinx-smoke-dom0less-arm64.sh @@ -0,0 +1,115 @@ +#!/bin/bash + +set -ex + +test_variant=3D$1 + +if [ -z "${test_variant}" ]; then + passed=3D"ping test passed" + domU_check=3D" +until ifconfig eth0 192.168.0.2 &> /dev/null && ping -c 10 192.168.0.1; do + sleep 30 +done +echo \"${passed}\" +" +fi + +# DomU +mkdir -p rootfs +cd rootfs +tar xzf ../binaries/initrd.tar.gz +mkdir proc +mkdir run +mkdir srv +mkdir sys +rm var/run +echo "#!/bin/sh + +${domU_check} +/bin/sh" > etc/local.d/xen.start +chmod +x etc/local.d/xen.start +echo "rc_verbose=3Dyes" >> etc/rc.conf +find . | cpio -H newc -o | gzip > ../binaries/domU-rootfs.cpio.gz +cd .. +rm -rf rootfs + +# DOM0 rootfs +mkdir -p rootfs +cd rootfs +tar xzf ../binaries/initrd.tar.gz +mkdir proc +mkdir run +mkdir srv +mkdir sys +rm var/run +cp -ar ../binaries/dist/install/* . + +echo "#!/bin/bash + +export LD_LIBRARY_PATH=3D/usr/local/lib +bash /etc/init.d/xencommons start + +/usr/local/lib/xen/bin/init-dom0less + +brctl addbr xenbr0 +brctl addif xenbr0 eth0 +ifconfig eth0 up +ifconfig xenbr0 up +ifconfig xenbr0 192.168.0.1 + +xl network-attach 1 type=3Dvif +${dom0_check} +" > etc/local.d/xen.start +chmod +x etc/local.d/xen.start +echo "rc_verbose=3Dyes" >> etc/rc.conf +find . | cpio -H newc -o | gzip > ../binaries/dom0-rootfs.cpio.gz +cd .. + + +TFTP=3D/scratch/gitlab-runner/tftp +START=3D`pwd` + +# ImageBuilder +echo 'MEMORY_START=3D"0" +MEMORY_END=3D"0xC0000000" + +DEVICE_TREE=3D"mpsoc.dtb" +XEN=3D"xen" +DOM0_KERNEL=3D"Image" +DOM0_RAMDISK=3D"dom0-rootfs.cpio.gz" +XEN_CMD=3D"console=3Ddtuart dom0_mem=3D1024M" + +NUM_DOMUS=3D1 +DOMU_KERNEL[0]=3D"Image" +DOMU_RAMDISK[0]=3D"domU-rootfs.cpio.gz" +DOMU_MEM[0]=3D"1024" + +LOAD_CMD=3D"tftpb" +UBOOT_SOURCE=3D"boot.source" +UBOOT_SCRIPT=3D"boot.scr"' > $TFTP/config + +cp -f binaries/xen $TFTP/ +cp -f binaries/Image $TFTP/ +cp -f binaries/dom0-rootfs.cpio.gz $TFTP/ +cp -f binaries/domU-rootfs.cpio.gz $TFTP/ + +rm -rf imagebuilder +git clone https://gitlab.com/ViryaOS/imagebuilder +bash imagebuilder/scripts/uboot-script-gen -t tftp -d $TFTP/ -c $TFTP/conf= ig + +# restart the board +cd /scratch/gitlab-runner +bash zcu102.sh 2 +sleep 5 +bash zcu102.sh 1 +sleep 5 +cd $START + +# connect to serial +set +e +stty -F /dev/ttyUSB0 115200 +timeout -k 1 120 nohup sh -c "cat /dev/ttyUSB0 | tee smoke.serial" + +set -e +(grep -q "^Welcome to Alpine Linux" smoke.serial && grep -q "${passed}" sm= oke.serial) || exit 1 +exit 0 --=20 2.25.1