From nobody Sun May 19 00:42:54 2024 Delivered-To: importer@patchew.org Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Authentication-Results: mx.zohomail.com; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org ARC-Seal: i=1; a=rsa-sha256; t=1556021596; cv=none; d=zoho.com; s=zohoarc; b=hl8apcxRyYIpBdW8x3FKwRFZXKm0D60arKRU7W4SYldMt7aNiZz7KmN5pGsDxkqGtXNFN9jwMCZuPsKo1Tb6b1q5V8ljKt+i68Bo/APBW7vhYFvUlQxF4FHTk9yRgbYZwy1iEu0Do9BKDetEIu8jTpkwYRiPPG1Ou6250oLHURM= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1556021596; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To:ARC-Authentication-Results; bh=xccpHTTUYboZPKSdehmy/+e7yK74K/mrX0p5kyjOS5c=; b=afnxKTytapHntabcalrzivGcYJl35jbrjJgGMZ6dm9tpcEz/l0VxmSgEHywtf/eEGDpm140W/gSqK+ZCgV2r7rwCxpMIzXDwNARtkyCSX1TBVK7h7/MZ1dVUiF3D3Hy08KNfp3htlT+d//urAFBm8ydDeFrsZrA33w9TqYv+2aU= ARC-Authentication-Results: i=1; mx.zoho.com; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1556021595998343.5957988207516; Tue, 23 Apr 2019 05:13:15 -0700 (PDT) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1hIuHF-0006Om-IR; Tue, 23 Apr 2019 12:11:57 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1hIuHE-0006OW-H2 for xen-devel@lists.xenproject.org; Tue, 23 Apr 2019 12:11:56 +0000 Received: from SMTP03.CITRIX.COM (unknown [162.221.156.55]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id faed07e0-65c0-11e9-ac16-93d415d302d6; Tue, 23 Apr 2019 12:11:54 +0000 (UTC) X-Inumbo-ID: faed07e0-65c0-11e9-ac16-93d415d302d6 X-IronPort-AV: E=Sophos;i="5.60,385,1549929600"; d="scan'208";a="84180812" From: Ian Jackson To: Date: Tue, 23 Apr 2019 13:11:37 +0100 Message-ID: <20190423121139.25996-2-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20190423121139.25996-1-ian.jackson@eu.citrix.com> References: <20190423121139.25996-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 1/3] ts-syslog-server: --no-stdin option X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Ian Jackson Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" Useful when running on a tty interactively. Signed-off-by: Ian Jackson --- ts-syslog-server | 10 +++++++++- 1 file changed, 9 insertions(+), 1 deletion(-) diff --git a/ts-syslog-server b/ts-syslog-server index 1234bb7d..06a07adf 100755 --- a/ts-syslog-server +++ b/ts-syslog-server @@ -28,6 +28,13 @@ use Socket qw(PF_INET SOCK_DGRAM INADDR_ANY =20 tsreadconfig(); =20 +our $use_stdin =3D 1; + +if (@ARGV && $ARGV[0] eq '--no-stdin') { + $use_stdin =3D 0; + shift @ARGV; +} + die if @ARGV && $ARGV[0] =3D~ m/^-/; =20 logm("starting syslog server ..."); @@ -42,7 +49,8 @@ $myaddr =3D inet_ntoa($myaddr); =20 store_runvar('syslog_server',"$myaddr:$port"); =20 -my @fhs =3D qw(S STDIN); +my @fhs =3D qw(S); +push @fhs, qw(STDIN) if $use_stdin; =20 foreach my $fh (@fhs) { my $fl =3D fcntl($fh, F_GETFL, 0) // die $!; --=20 2.11.0 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xenproject.org https://lists.xenproject.org/mailman/listinfo/xen-devel From nobody Sun May 19 00:42:54 2024 Delivered-To: importer@patchew.org Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Authentication-Results: mx.zohomail.com; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org ARC-Seal: i=1; a=rsa-sha256; t=1556021593; cv=none; d=zoho.com; s=zohoarc; b=PoYPiNNyQg9X/P9xJFR1WOLNeIagZOh4cP1RyGbBS6qq3C+LfokIN6Bn1r8IzCylPlmZuUBjXKP3qfzmEGwweXudXpDigShuFRw3bUB5hvZ+anvJchVuPQUohD2FHA8yhxRo97R0g5A4aaEEzEX1yi9dsoBq6cqTeD8czgXlgnA= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1556021593; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To:ARC-Authentication-Results; bh=CVVlGsVm96b8Nyw87ID8vYIkyMk0EePf+Vh8LM18cJA=; b=nM76P+oHrjtLCTICMqRLHsFd72+zxuOE+/hPF3M8R9pxrOUqqhsJq0unQsPCZ/g0bWG4FQmkkoVrsERofztSEkZ2ZMRqnu4Mlca8OEHm3/m1Vs/qP/mWEMRRBp5qLcVdzyqcT9/WIbi8OVERQF6XN8tG+XNanTvn/phmJXVLeKk= ARC-Authentication-Results: i=1; mx.zoho.com; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1556021593980259.4486506671918; Tue, 23 Apr 2019 05:13:13 -0700 (PDT) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1hIuHC-0006OF-O3; Tue, 23 Apr 2019 12:11:54 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1hIuHA-0006O5-KX for xen-devel@lists.xenproject.org; Tue, 23 Apr 2019 12:11:52 +0000 Received: from SMTP03.CITRIX.COM (unknown [162.221.156.55]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id f8a0b00e-65c0-11e9-a14f-8f2a60f58afb; Tue, 23 Apr 2019 12:11:50 +0000 (UTC) X-Inumbo-ID: f8a0b00e-65c0-11e9-a14f-8f2a60f58afb X-IronPort-AV: E=Sophos;i="5.60,385,1549929600"; d="scan'208";a="84180793" From: Ian Jackson To: Date: Tue, 23 Apr 2019 13:11:38 +0100 Message-ID: <20190423121139.25996-3-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20190423121139.25996-1-ian.jackson@eu.citrix.com> References: <20190423121139.25996-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 2/3] sg-run-job, ts-host-install: New --build option X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Ian Jackson Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" Used to specify that the host will be used for building. Currently has no effect. Signed-off-by: Ian Jackson --- sg-run-job | 2 +- ts-host-install | 1 + 2 files changed, 2 insertions(+), 1 deletion(-) diff --git a/sg-run-job b/sg-run-job index 56b6384a..7c58d4ba 100755 --- a/sg-run-job +++ b/sg-run-job @@ -734,7 +734,7 @@ proc allocate-build-host {ostype} { } proc prepare-build-host-linux {} { global jobinfo - run-ts broken host-install(*) ts-host-install-twice + run-ts broken host-install(*) ts-host-install-twice + --build run-ts . host-build-prep ts-xen-build-prep } =20 diff --git a/ts-host-install b/ts-host-install index 4213c3a2..7094559f 100755 --- a/ts-host-install +++ b/ts-host-install @@ -41,6 +41,7 @@ while (@ARGV and $ARGV[0] =3D~ m/^-/) { $poweron_test_only=3D 1; } elsif (m/^--rescue$/) { $xopts{RescueMode}=3D 1; + } elsif (m/^--build$/) { } else { die "$_ $!"; } --=20 2.11.0 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xenproject.org https://lists.xenproject.org/mailman/listinfo/xen-devel From nobody Sun May 19 00:42:54 2024 Delivered-To: importer@patchew.org Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Authentication-Results: mx.zohomail.com; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org ARC-Seal: i=1; a=rsa-sha256; t=1556021592; cv=none; d=zoho.com; s=zohoarc; b=h840+WFnNST5aIs4rCc1VUtWbgDLWjFSohcnfZDNgDIZCr7hUmo/wFS9QgPI+Apu/6osUgrvCqLnrV98SP7aHBSbH8sO8TxwYR5zVUF52+7FZxGQiT5eT4e3O8HHL0gfAZmwr/rHkb1sc3i99q55n2C7RgqIjELf+yUxeL/YMjk= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1556021592; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To:ARC-Authentication-Results; bh=ewEu/owjP08DEzAO30ZkOWdIGTpMAAOjbZfwzp4SviE=; b=YfvT4n/tXUZ7fSb27OgxidvrG83DaE7jmJuhIkvoKe0WXLvL0K0ulEYCGglCN++odhhE3AjPUFJKbZ4kX1Loop/YZsYyFbX3lIHn7WjT3GapZcc4v5NmCxysu0iDfYdZBuXYcpxYxGh/ZpXcQe8XbchbkAnkaAZoTVTTcJbv/Co= ARC-Authentication-Results: i=1; mx.zoho.com; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1556021591865104.30260160123339; Tue, 23 Apr 2019 05:13:11 -0700 (PDT) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1hIuHD-0006OP-0J; Tue, 23 Apr 2019 12:11:55 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1hIuHC-0006OA-Fx for xen-devel@lists.xenproject.org; Tue, 23 Apr 2019 12:11:54 +0000 Received: from SMTP03.CITRIX.COM (unknown [162.221.156.55]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id fa3a6c70-65c0-11e9-8a7c-8b3d94c3594d; Tue, 23 Apr 2019 12:11:51 +0000 (UTC) X-Inumbo-ID: fa3a6c70-65c0-11e9-8a7c-8b3d94c3594d X-IronPort-AV: E=Sophos;i="5.60,385,1549929600"; d="scan'208";a="84180797" From: Ian Jackson To: Date: Tue, 23 Apr 2019 13:11:39 +0100 Message-ID: <20190423121139.25996-4-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20190423121139.25996-1-ian.jackson@eu.citrix.com> References: <20190423121139.25996-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 3/3] builds: Run i386 builds on amd64 kernels X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Juergen Gross , Wei Liu , Andrew Cooper , Ian Jackson , Paul Durrant , Boris Ostrovsky Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" Most hardware that supports i386 supports amd64 too. When doing builds we do need the right userland, but we don't actually care what the kernel is doing. With Linux 32-on-64 is good for that. Especially, there is a kernel regression (evident in the Debian stretch kernel, but not present in jessie's) where 32-bit Linux mismanages the memory on hosts with moderately large amounts of RAM (ie, significantly more RAM than can be addressed at once), resulting in what amounts to a near-stall of the paging system. Since the paging system is used for filesystem writes too, the effect is that commands run by builds can take totally unreasonable amounts of time. Ie, this version of Linux is broken when i386 PAE is needed. In practice this is causing significant trouble in the Xen Project CI. This kernel bug probably won't affect our test jobs because (i) we use our own kernels, so we would probably detect this regression when switching kernel branches etc. (ii) test jobs run with a dom0_mem setting which avoids the preconditions for the particular bug. CC: Juergen Gross CC: Boris Ostrovsky CC: Wei Liu CC: Andrew Cooper CC: Paul Durrant Signed-off-by: Ian Jackson --- Osstest/Debian.pm | 35 +++++++++++++++++++++++++++++++++++ ts-host-install | 8 ++++++++ 2 files changed, 43 insertions(+) diff --git a/Osstest/Debian.pm b/Osstest/Debian.pm index 600f18b1..0f10a9c3 100644 --- a/Osstest/Debian.pm +++ b/Osstest/Debian.pm @@ -1334,6 +1334,41 @@ END preseed_hook_command($ho, 'late_command', $sfx, $cmds); }); =20 + my $kern_arch =3D $xopts{LinuxKernArchMap}{$r{arch}}; + if ($kern_arch && + $ho->{Flags}{"arch-$r{arch}"} && !$ho->{Flags}{"arch-$kern_arch"}) { + # We check the flag for $r{arch} because for various reasons + # it may not be set. For example, in standalone mode it is + # currently not normally necessary to set any arch hostflags. + # In that situation we bet that the kern arch can be used; + # this is a good bet because currently this is used for + # running amd64 kernels with i386 userland and hosts that can + # do only i386 are fairly rare, especially server hosts. + # If this causes a problem, setting the i386 host flag will + # (somewhat counterintuitively) cause this check to miss + # the amd64 host flag + logm("NOT using $kern_arch kernel (flags say not supported by host)"); + $kern_arch =3D undef; + } + if ($kern_arch) { + logm("Using $kern_arch kernel for $r{arch} userland"); + preseed_hook_command($ho, 'late_command', $sfx, <{Flags}{'need-uboot-bootscr'} ) { my @bootargs =3D uboot_common_kernel_bootargs($ho); =20 diff --git a/ts-host-install b/ts-host-install index 7094559f..35601a42 100755 --- a/ts-host-install +++ b/ts-host-install @@ -31,6 +31,7 @@ my $debconf_priority; my $poweron_test_only; =20 our %xopts; +our %linux_kern_arch_map; =20 while (@ARGV and $ARGV[0] =3D~ m/^-/) { $_=3D shift @ARGV; @@ -42,6 +43,12 @@ while (@ARGV and $ARGV[0] =3D~ m/^-/) { } elsif (m/^--rescue$/) { $xopts{RescueMode}=3D 1; } elsif (m/^--build$/) { + # When installing to do builds rather than tests, we can use an + # amd64 kernel on i386 hosts, and this is generally faster. + # Also, it avoids a kernel regression in Debian stretch - + # a regression which Linux upstream do not consider a bug. Eg + # https://lkml.org/lkml/2017/8/2/394 + $linux_kern_arch_map{i386} =3D 'amd64'; } else { die "$_ $!"; } @@ -61,6 +68,7 @@ sub install () { ($ho, '', DiskDevice =3D> $ho->{DiskDevice}, Properties =3D> $ho->{Properties}, + LinuxKernArchMap =3D> \%linux_kern_arch_map, ExtraPreseed =3D> <{Name} d-i netcfg/get_ipaddress string $ho->{Ip} --=20 2.11.0 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xenproject.org https://lists.xenproject.org/mailman/listinfo/xen-devel