From nobody Fri Apr 26 09:04:09 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail(p=none dis=none) header.from=eu.citrix.com ARC-Seal: i=1; a=rsa-sha256; t=1573239083; cv=none; d=zoho.com; s=zohoarc; b=lXabUd7KvGy9P9ec8H4zwEQKOXN0C8wEU5SBl7dpNSFgLPZprYCfTWD1VPRtv9tZ1ircA55aMtIAvkfmw0MlxDGmsoTujapqWsIKtMD5DzSWiplKJqr8MJyMGGBEFBH5l52YHKUkF4eCyNj0vLAk17V87AgQfnXtqojBy6aZ8oo= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1573239083; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=SOU0xTAVbra23FTKItqZiHCy6Fz0bPM7t8h5gYoXywo=; b=RtNK/QZT3D984xUXwTXcQFzZVEDPlbsiMLm9jnIh7JfW+7dfnL7oj1xvVTdXgr9Hp91QZRhZJ41Dr3q+RxSNEmToXgZMmTj+9lu5u7mTZnQIRniX55bs/+Wd+fAYiwGoFeTTCysLyce9iuCDw6wjtPmCyzTBbJjYIQqcPZTkF18= ARC-Authentication-Results: i=1; mx.zoho.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1573239082912222.99874316361206; Fri, 8 Nov 2019 10:51:22 -0800 (PST) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9Kn-0007n9-1w; Fri, 08 Nov 2019 18:50:13 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9Kl-0007n4-GJ for xen-devel@lists.xenproject.org; Fri, 08 Nov 2019 18:50:11 +0000 Received: from esa3.hc3370-68.iphmx.com (unknown [216.71.145.155]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 970b4162-0258-11ea-b678-bc764e2007e4; Fri, 08 Nov 2019 18:50:10 +0000 (UTC) X-Inumbo-ID: 970b4162-0258-11ea-b678-bc764e2007e4 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1573239011; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=MSkFnuaj1LQRJcJZIh+SLhq5b4IuzZOdw0T7nasHnQs=; b=Yh/cKUI3iTRSHhnR5xLsJgmR889uyPcSmoVa60Y7gMcU9/t6qNIN3z5v B0JdOTbhxI+F4LNr3pT8dQhpmg2KYF7+BsHm0ub0KKglSAVx+wRfo0OMK WaFtEET5GsbsuwCmOQS+fIXn5Mh7dRGZ+S3huWAIwbD9297TpjH9z8cyV Y=; Authentication-Results: esa3.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=ian.jackson@eu.citrix.com; spf=Pass smtp.mailfrom=Ian.Jackson@citrix.com; spf=None smtp.helo=postmaster@mail.citrix.com Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Received-SPF: None (esa3.hc3370-68.iphmx.com: no sender authenticity information available from domain of ian.jackson@eu.citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa3.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="ian.jackson@eu.citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa3.hc3370-68.iphmx.com: domain of Ian.Jackson@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa3.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="Ian.Jackson@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa3.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa3.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: GWQKNE16H2UwU6HHn9kVRe4mGvxsxoewaO/efOBRNqVlXl3gO3JG1y/QV2+MGXs1k2LsBpD772 xdmvN19f9zlYGpj1qPXIlaQtTsFzKewdYL+b5fhtCyRVtLbnU3cVG3uhCkQmGpLY2z8Ro4LYt2 mgCcNnNXmSJRUx0PkmV8yoNawtIlOg0bQYz5stCNJpVAOuQMgSlB9OY1vKhGDmNU1eXToa1NHh CGcI8RJgWhql9nqOF+EGACbfBBCqADHWx0yh7LPPCUWeV8ZmRIhR2oeH0QznZTwmDW7t1396IK JHE= X-SBRS: 2.7 X-MesageID: 8076033 X-Ironport-Server: esa3.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.68,282,1569297600"; d="scan'208";a="8076033" From: Ian Jackson To: Date: Fri, 8 Nov 2019 18:49:49 +0000 Message-ID: <20191108185001.3319-2-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20191108185001.3319-1-ian.jackson@eu.citrix.com> References: <20191108185001.3319-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 01/13] sg-report-host-history: Improve debugging output X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Ian Jackson Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) Signed-off-by: Ian Jackson --- sg-report-host-history | 12 ++++++++++-- 1 file changed, 10 insertions(+), 2 deletions(-) diff --git a/sg-report-host-history b/sg-report-host-history index bd7391e0..42def6bf 100755 --- a/sg-report-host-history +++ b/sg-report-host-history @@ -101,6 +101,8 @@ END $minflight //=3D 0; =20 $flightcond =3D "(flight > $minflight)"; + + print DEBUG "MINFLIGHT $minflight\n"; } =20 sub jobquery ($$) { @@ -128,18 +130,22 @@ END =20 push @params, scalar keys %hosts; =20 + print DEBUG "MAINQUERY...\n"; $runvarq->execute(@params); =20 print DEBUG "FIRST PASS\n"; while (my $jr=3D $runvarq->fetchrow_hashref()) { - print DEBUG "JOB $jr->{flight}.$jr->{job} "; + print DEBUG " $jr->{flight}.$jr->{job} "; push @{ $hosts{$jr->{val}} }, $jr; } + print DEBUG "\n"; } =20 sub reporthost ($) { my ($hostname) =3D @_; =20 + print DEBUG "HOST $hostname...\n"; + die if $hostname =3D~ m/[^-_.+0-9a-z]/; =20 my $html_file=3D "$htmlout/$hostname.html"; @@ -204,7 +210,7 @@ END =20 my @rows; foreach my $jr (@$inrows) { - print DEBUG "JOB $jr->{flight}.$jr->{job}\n"; + print DEBUG "JOB $jr->{flight}.$jr->{job} "; =20 my $endedrow =3D jobquery($endedq, $jr); if (!$endedrow) { @@ -222,6 +228,7 @@ END =20 my $alternate =3D 0; foreach my $jr (@rows) { + print DEBUG "JR $jr->{flight}.$jr->{job}\n"; my $ir =3D jobquery($infoq, $jr); my $ar =3D jobquery($allocdq, $jr); my $ident =3D $jr->{name}; @@ -340,6 +347,7 @@ foreach my $host (@ARGV) { END $hostsinflightq->execute($flight); while (my $row =3D $hostsinflightq->fetchrow_hashref()) { + print DEBUG "HR $row->{val}\n"; $hosts{$row->{val}} =3D [ ]; } }); --=20 2.11.0 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xenproject.org https://lists.xenproject.org/mailman/listinfo/xen-devel From nobody Fri Apr 26 09:04:09 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail(p=none dis=none) header.from=eu.citrix.com ARC-Seal: i=1; a=rsa-sha256; t=1573239097; cv=none; d=zoho.com; s=zohoarc; b=O6TA7fI0K3i6p19gMYfLvfryfT8gWyyvQbbgFottd4AJIzsRpbYqiDBXIgxOFRVDlm4ViTHAajjFobasR05W3LBY0i9Ck/8ZwW/NCDetXo6ML1iSyR5ZZWkdQEHuDrxKgZxbDkUoXPfdnTdzBg1qD+/XKcfa5+rguWFSiJQdFsY= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1573239097; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=r4pBL5ynVkdVZYlcPsAnH0t7bAPL0CvKeMAFIr6dS/A=; b=it1F5X/wsWjC+91ccXfsBEKa1yVxx48QBbaomfFpdqflF996FFgzM7aSvlwPoHxnTzy3WhVoXOnDEHcz5BXkoidJ/TBjIZDehSVgKi7W4LHskUZR/OR67TZbeKU+a06BhSBRw0K/ZXzflqokW20iRS+TgW2lmQTat7+7rZ0qd34= ARC-Authentication-Results: i=1; mx.zoho.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1573239097216377.2830917918185; Fri, 8 Nov 2019 10:51:37 -0800 (PST) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9LB-0007x4-Kr; Fri, 08 Nov 2019 18:50:37 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9LA-0007w5-6A for xen-devel@lists.xenproject.org; Fri, 08 Nov 2019 18:50:36 +0000 Received: from esa6.hc3370-68.iphmx.com (unknown [216.71.155.175]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 971b90e4-0258-11ea-a1d6-12813bfff9fa; Fri, 08 Nov 2019 18:50:10 +0000 (UTC) X-Inumbo-ID: 971b90e4-0258-11ea-a1d6-12813bfff9fa DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1573239010; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=f0byd3ILKmLFVlU8lISjneRQLQo5kZV/F5twGVZKvVE=; b=ZZH+HnbXPQ++YbfXPzpcWydmWqDhpvTB8dFfrfdTOSUlxP6+uVvXAJxz QHFOYpTFPotaukA+gxrkLwMSuX5sJMO3Z3KPpZQ9oGNdubkSy2GBtItBk jdYRNJRR+CAXHFBooitXeKvOqexiXqIyVnhDCb6w5FVrTORXhN4GbY55W g=; Authentication-Results: esa6.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=ian.jackson@eu.citrix.com; spf=Pass smtp.mailfrom=Ian.Jackson@citrix.com; spf=None smtp.helo=postmaster@mail.citrix.com Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Received-SPF: None (esa6.hc3370-68.iphmx.com: no sender authenticity information available from domain of ian.jackson@eu.citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="ian.jackson@eu.citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa6.hc3370-68.iphmx.com: domain of Ian.Jackson@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="Ian.Jackson@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa6.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: chlWlMQpOsjw8GJATA+QRcHCT6tZhQP6nQcfHqMxVbNpvLn1zqIk23vPw2VcypNwj0HMi1ouBy time6eMEXwDw2kio63VGtPjO7KZGvESXUmTjAEBebsSwg1RCThRI0oByOLtLv74GtBkyYbmf8v 7R/h92MLmn2Obiff5hIXAYN5bOKDDi4tAoSSqyf6yahs5+ohq7h0gm9ppGYGI47wVULdUP+jzY N3wC4muPLENaVloVrmobyOrut2azGcsRVA5eHIMmPB04WiGKnFJjRT47fb6drmmqWA+kjYdZY3 vs0= X-SBRS: 2.7 X-MesageID: 8482901 X-Ironport-Server: esa6.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.68,282,1569297600"; d="scan'208";a="8482901" From: Ian Jackson To: Date: Fri, 8 Nov 2019 18:49:50 +0000 Message-ID: <20191108185001.3319-3-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20191108185001.3319-1-ian.jackson@eu.citrix.com> References: <20191108185001.3319-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 02/13] sg-report-host-history: New --no-install option for testing X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Ian Jackson Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) No change for existing callers. Signed-off-by: Ian Jackson --- sg-report-host-history | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/sg-report-host-history b/sg-report-host-history index 42def6bf..c9f4aaa6 100755 --- a/sg-report-host-history +++ b/sg-report-host-history @@ -31,6 +31,7 @@ use Osstest::Executive qw(:DEFAULT :colours); our $limit=3D 200; our $flightlimit; our $htmlout =3D "."; +our $doinstall=3D1; our @blessings; =20 open DEBUG, ">/dev/null"; @@ -51,6 +52,8 @@ while (@ARGV && $ARGV[0] =3D~ m/^-/) { push @blessings, split ',', $1; } elsif (m/^--html-dir=3D(.*)$/) { $htmlout=3D $1; + } elsif (m/^--no-install$/) { + $doinstall=3D 0; } elsif (m/^--debug/) { open DEBUG, ">&2" or die $!; DEBUG->autoflush(1); @@ -322,7 +325,8 @@ END print H "\n"; =20 close H or die $!; - rename "$html_file.new", "$html_file" or die "$html_file $!"; + rename "$html_file.new", "$html_file" or die "$html_file $!" + if $doinstall; } =20 db_retry($dbh_tests, [], sub { --=20 2.11.0 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xenproject.org https://lists.xenproject.org/mailman/listinfo/xen-devel From nobody Fri Apr 26 09:04:09 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail(p=none dis=none) header.from=eu.citrix.com ARC-Seal: i=1; a=rsa-sha256; t=1573239091; cv=none; d=zoho.com; s=zohoarc; b=czqP7HZFPznfK/V8xe1QWtvRpZ8zkRZjyjC5VxMb5SunfTKPLwELyyH3LWMG7VrYocA+ssnqw1M2vADf+JAOfCLojItGBMuawi67Xg4am/RKoMz4rG/QxOi7zil/6z3wr1iPlSNDOdhLxj/r03AoOXODwVdDBMh1adJMpM7bhtI= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1573239091; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=WPlr68yF7jjP0sLDwvvGf2zosLxdnf1NNgg2ybbgaZw=; b=A4IkgVCZk7P/UUorGTUPpQx/skKy0VWIqUKM/fo8QzDEgoUyyCQSooBbh2w4jKhCKtecdlZrConVRO4j2ziffUEc2x2mUaTqX8VZyUfFAq/WhgKz6J/+qA378ChZpWMiUJSiTXzSnBsvwp8JbeSVzs2jilC5TWHjdmGqO0rY7ho= ARC-Authentication-Results: i=1; mx.zoho.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1573239091747755.3706873759526; Fri, 8 Nov 2019 10:51:31 -0800 (PST) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9L7-0007tv-7W; Fri, 08 Nov 2019 18:50:33 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9L6-0007tI-05 for xen-devel@lists.xenproject.org; Fri, 08 Nov 2019 18:50:32 +0000 Received: from esa2.hc3370-68.iphmx.com (unknown [216.71.145.153]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 971b90e5-0258-11ea-a1d6-12813bfff9fa; Fri, 08 Nov 2019 18:50:11 +0000 (UTC) X-Inumbo-ID: 971b90e5-0258-11ea-a1d6-12813bfff9fa DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1573239011; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=aO0bCTPy7260kSyFsrFfUbuxe2ickWqS2zgdE01NmfE=; b=YkY+lQ8EJFiPwQ7X/T0Rl0HiXNqQA6JGN/pAyBFOguSQexIYq7LlSI/E OQJX0YJO96pXdXcqMqwzlWu17jKpRRpYrdE1Fi+22MJnv9yLG4+DWfvr9 Ekc8w73oRX+gXb65lhOnxSVTzJaEqJ6Nr4/T9h3x/yQqjNhM2sgJ4IQXt M=; Authentication-Results: esa2.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=ian.jackson@eu.citrix.com; spf=Pass smtp.mailfrom=Ian.Jackson@citrix.com; spf=None smtp.helo=postmaster@mail.citrix.com Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Received-SPF: None (esa2.hc3370-68.iphmx.com: no sender authenticity information available from domain of ian.jackson@eu.citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa2.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="ian.jackson@eu.citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa2.hc3370-68.iphmx.com: domain of Ian.Jackson@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa2.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="Ian.Jackson@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa2.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa2.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: ELIpcErRlch3McRR9I/nUi9S1PEKrKbXPz+4m/NycwmwwDM0lb+9DTUc6QxHiYgD9+SzXUx+W0 TEDFxuZnhS/e/tAvFwGBlSfkUHPa/LSByGMDthprGTf8GjWjSGqHFyQ3aFoNkyCmjHGwRssEts LMY1YP9fo6hUNWEp1l5tIXRl8oSg8Uq/7vWdaowbv5oMTyW81BWpkXR8LuiHImXj4LOGQEgILJ 2AOxkAAJO/J2dfUNA739oxBMvdzR4DcuOyXbEknjh0i0gzh8fDFZh9jflvqgXlM7BUAXvZdNjs dyk= X-SBRS: 2.7 X-MesageID: 8076644 X-Ironport-Server: esa2.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.68,282,1569297600"; d="scan'208";a="8076644" From: Ian Jackson To: Date: Fri, 8 Nov 2019 18:49:51 +0000 Message-ID: <20191108185001.3319-4-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20191108185001.3319-1-ian.jackson@eu.citrix.com> References: <20191108185001.3319-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 03/13] sg-report-host-history: Move `computeflightsrange' after hosts X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Ian Jackson Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) This will allow the flights range computation to depend on the hosts we are interested in. Signed-off-by: Ian Jackson --- sg-report-host-history | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/sg-report-host-history b/sg-report-host-history index c9f4aaa6..fc51074d 100755 --- a/sg-report-host-history +++ b/sg-report-host-history @@ -329,10 +329,6 @@ END if $doinstall; } =20 -db_retry($dbh_tests, [], sub { - computeflightsrange(); -}); - foreach my $host (@ARGV) { if ($host =3D~ m/^flight:/) { my $flight=3D$'; #'; @@ -365,6 +361,10 @@ END exit 0 unless %hosts; =20 db_retry($dbh_tests, [], sub { + computeflightsrange(); +}); + +db_retry($dbh_tests, [], sub { mainquery(); }); =20 --=20 2.11.0 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xenproject.org https://lists.xenproject.org/mailman/listinfo/xen-devel From nobody Fri Apr 26 09:04:09 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail(p=none dis=none) header.from=eu.citrix.com ARC-Seal: i=1; a=rsa-sha256; t=1573239100; cv=none; d=zoho.com; s=zohoarc; b=nGxShv+51vmDJEUzxt0vqi4OC3Y8XNCA3+cecwFQVOsD674Um/uen8tHckSBmAt8aDiRB+r2LJb45WjVC9F2ZWs1p4kVbzugUAJVPNe4Ufs3hLaX8sswNXmeBpxPQp6RJXWN9sWW1gnemRx/deosIpoNakWMRpRP80KpgkDofY0= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1573239100; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=9BHtqTQ3nftTbd+x5q6iseCPzYpHChnxQwpnk3UgLCI=; b=KMtMFE22xEUYNt4jiLCk6lMcAJQJx07z5DMqyTHgpjcnhaf2nL9GDu2o1/rWnUSVHT0EahAtHtktDo6BMuU4UfFHwIhJ7R26lynaruFhddbtKS3L+JZ/B89NoC/ISpuRgY3OM76egP16nqbLsQTn3bz+FZh5n+CcuhpSAj0NLws= ARC-Authentication-Results: i=1; mx.zoho.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1573239100036824.0189859533953; Fri, 8 Nov 2019 10:51:40 -0800 (PST) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9LG-00082D-RY; Fri, 08 Nov 2019 18:50:42 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9LF-000816-Hu for xen-devel@lists.xenproject.org; Fri, 08 Nov 2019 18:50:41 +0000 Received: from esa5.hc3370-68.iphmx.com (unknown [216.71.155.168]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 9a517026-0258-11ea-9631-bc764e2007e4; Fri, 08 Nov 2019 18:50:16 +0000 (UTC) X-Inumbo-ID: 9a517026-0258-11ea-9631-bc764e2007e4 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1573239016; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=W6m5wYP8ekZTDoQ/zPFavOw8FePgmmvJpG/O6zLNBKk=; b=VS7FaCSGG3TEVpszh08WKHn5LiQc3rQ626iqQEI0Dil4iY3CUwZBpK/Y Kd2S0I82FQfoLDz4WOWymli6jQjnZKq/A7hTs+cv7YlXtCEbxZC+exvzk g55WH9tp3vSqzrtgIA1I/QNC/8fsDXw3jpk/LvV7XCiCQLE5lo4FVMamX 8=; Authentication-Results: esa5.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=ian.jackson@eu.citrix.com; spf=Pass smtp.mailfrom=Ian.Jackson@citrix.com; spf=None smtp.helo=postmaster@mail.citrix.com Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Received-SPF: None (esa5.hc3370-68.iphmx.com: no sender authenticity information available from domain of ian.jackson@eu.citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa5.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="ian.jackson@eu.citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa5.hc3370-68.iphmx.com: domain of Ian.Jackson@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa5.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="Ian.Jackson@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa5.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa5.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: AJRExs/14f51KprXrXfsw1FSOntMkl3TlPRA+dbgx5BhzuvFg58aMi/AwlLJtMm9WaJ7K+N/dG nYi5PjDO/J+oMHZkR5UBsDg/pEe7MSHH5TURT5V4PHuwhkWcci40XUzrzjaBixoWv+zzXrszp3 VeRt1zEe8Fl4SjtMcLwYXGCyrOq3GlQat6YKDnGIRqYyzHX8eCmuGies2juVA8mTYGasiAFdpx Mdb91exej2CTsi1Uba++EScgEEtkKVZj+vq4gsiYwY9YrYRKYH0/1gSJQqNnLgtUnBOPp7tgAe 0U0= X-SBRS: 2.7 X-MesageID: 8429296 X-Ironport-Server: esa5.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.68,283,1569297600"; d="scan'208";a="8429296" From: Ian Jackson To: Date: Fri, 8 Nov 2019 18:49:52 +0000 Message-ID: <20191108185001.3319-5-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20191108185001.3319-1-ian.jackson@eu.citrix.com> References: <20191108185001.3319-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 04/13] sg-report-host-history: Actually honour $minflight X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Ian Jackson Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) This seriously speeds up some of the queries. Signed-off-by: Ian Jackson --- sg-report-host-history | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/sg-report-host-history b/sg-report-host-history index fc51074d..d47784d9 100755 --- a/sg-report-host-history +++ b/sg-report-host-history @@ -67,6 +67,7 @@ while (@ARGV && $ARGV[0] =3D~ m/^-/) { =20 our $restrictflight_cond =3D restrictflight_cond(); our $flightcond; +our $minflight; =20 sub computeflightsrange () { if (!$flightlimit) { @@ -100,7 +101,7 @@ END LIMIT 1 END $minflightsq->execute(); - my ($minflight) =3D $minflightsq->fetchrow_array(); + ($minflight,) =3D $minflightsq->fetchrow_array(); $minflight //=3D 0; =20 $flightcond =3D "(flight > $minflight)"; @@ -127,10 +128,12 @@ sub mainquery () { AND ($valcond) AND $flightcond AND $restrictflight_cond + AND flight > ? ORDER BY flight DESC LIMIT ($limit * 3 + 100) * ? END =20 + push @params, $minflight; push @params, scalar keys %hosts; =20 print DEBUG "MAINQUERY...\n"; --=20 2.11.0 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xenproject.org https://lists.xenproject.org/mailman/listinfo/xen-devel From nobody Fri Apr 26 09:04:09 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail(p=none dis=none) header.from=eu.citrix.com ARC-Seal: i=1; a=rsa-sha256; t=1573239102; cv=none; d=zoho.com; s=zohoarc; b=gagTSvnOxVnXQSK0WDC4oRL58e+2Hn+CwFRj715m3l8upzeuimzPhX7jx6GzjuMCPWqco8H87H5rhzej6fJdj9fX11wbUWutm3X/TaQEkyFjNuZwnkrjFHR9G7QcEaDY6PI3pXoRD08252oWPkB4jS+X3v2whSgLOnjsGgMlyi0= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1573239102; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=WpeVvi3+M739S+tmoBbm7G3ogyF0My2CL6GdkuFDAF4=; b=JhkE1tR6WtmCkQ0hexPDU+JJyijMr8hEwvvaFNOf5NgHeuKWbHiC5NuXgiikn3UPS+sgkYSvRUWuAnEBXB8P9nm0nrmu72S2WSfdqyGrYF5aM+dtcaAwwQ7h6OOiuoJoWgcPLumfronUwg/od6EFjQXPiUJoFsNsZ95L7lUeboU= ARC-Authentication-Results: i=1; mx.zoho.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1573239102895559.1401253560832; Fri, 8 Nov 2019 10:51:42 -0800 (PST) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9LL-00086j-5s; Fri, 08 Nov 2019 18:50:47 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9LK-00085b-6F for xen-devel@lists.xenproject.org; Fri, 08 Nov 2019 18:50:46 +0000 Received: from esa2.hc3370-68.iphmx.com (unknown [216.71.145.153]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 9e6198a8-0258-11ea-a1d6-12813bfff9fa; Fri, 08 Nov 2019 18:50:23 +0000 (UTC) X-Inumbo-ID: 9e6198a8-0258-11ea-a1d6-12813bfff9fa DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1573239023; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=nI+8Vz43Y3pq0RgBdu5EoYZFGXDykGRVZpkx0C/orc8=; b=CdJBDOQS3t4Ytmeb4CydPp8jztEu/D4Gd6XKZMb+82mbI/u7WEc63DpO D20Ez/12T6WLAEOv+abNsnErG6/pwziS4xgP8scieLoYXQq51fXbJxkSS 568EOVHPkiHKCWmffRwmufTAwcPGFubNIzCjlBW/d6x+ywnPW/a6TFf1l Y=; Authentication-Results: esa2.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=ian.jackson@eu.citrix.com; spf=Pass smtp.mailfrom=Ian.Jackson@citrix.com; spf=None smtp.helo=postmaster@mail.citrix.com Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Received-SPF: None (esa2.hc3370-68.iphmx.com: no sender authenticity information available from domain of ian.jackson@eu.citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa2.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="ian.jackson@eu.citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa2.hc3370-68.iphmx.com: domain of Ian.Jackson@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa2.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="Ian.Jackson@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa2.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa2.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: rXdRlxyQw5Gw9fS4Z91h2bGnWjpFqXqmurblOHNSIELQSeotXa6PchhOKagpMgymF1K2S15lMJ 480I5PGkX/Sfo1nqYtHS3HJdf5GqCglnqWaQMXtX6gJ+oif/qIBLTrmoQTOmijisvxK7tUa/gA bSsVZMsk8sE+EeoaJxKdXIeb9EfyBPikf9ihRS5IPYDKiK6O5aOCFltgqnur0AQcKfezy+vvBi 3UvprpQG8E/4bUDYA1pbrlhHauV+j4yJY+CyyQPQmRNNTwtO8Na80KOMqLmebY5h9W6cbPhoWY t1s= X-SBRS: 2.7 X-MesageID: 8076647 X-Ironport-Server: esa2.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.68,282,1569297600"; d="scan'208";a="8076647" From: Ian Jackson To: Date: Fri, 8 Nov 2019 18:49:53 +0000 Message-ID: <20191108185001.3319-6-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20191108185001.3319-1-ian.jackson@eu.citrix.com> References: <20191108185001.3319-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 05/13] sg-report-host-history: Get job status from mainquery X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Ian Jackson Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) We are going to need this as part of our data reuse cache key, so we need it this early. This change hardly slows the query down. Signed-off-by: Ian Jackson --- sg-report-host-history | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/sg-report-host-history b/sg-report-host-history index d47784d9..81a7a8d8 100755 --- a/sg-report-host-history +++ b/sg-report-host-history @@ -122,8 +122,9 @@ sub mainquery () { our @params =3D keys %hosts; =20 our $runvarq //=3D db_prepare(< (p=none dis=none) header.from= Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1573239095300498.9076080715947; Fri, 8 Nov 2019 10:51:35 -0800 (PST) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9LC-0007xj-4t; Fri, 08 Nov 2019 18:50:38 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9LA-0007wY-I1 for xen-devel@lists.xenproject.org; Fri, 08 Nov 2019 18:50:36 +0000 Received: from esa4.hc3370-68.iphmx.com (unknown [216.71.155.144]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 9a8d599c-0258-11ea-adbe-bc764e2007e4; Fri, 08 Nov 2019 18:50:16 +0000 (UTC) X-Inumbo-ID: 9a8d599c-0258-11ea-adbe-bc764e2007e4 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1573239016; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=UoZj1twCsqz4RD+oQF3WE6ZiGLkrhL4NtaEKo19J694=; b=CZlImhQGzjRyhhCiO6qksnl/Iv0/gbIWL5lYCo1sLTYq4t5+K8ehWY2h XUPvsd/fhtaKSqNG50PslidwOlINlPA+fXp96k0PvZ6ptszQ6gi/2BRJe Xg0o/4xkXN46OwU1bE66U7RA1SCNK6Y3o0IKfCCSXfd5LT36seCYvQBZA I=; Authentication-Results: esa4.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=ian.jackson@eu.citrix.com; spf=Pass smtp.mailfrom=Ian.Jackson@citrix.com; spf=None smtp.helo=postmaster@mail.citrix.com Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Received-SPF: None (esa4.hc3370-68.iphmx.com: no sender authenticity information available from domain of ian.jackson@eu.citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="ian.jackson@eu.citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa4.hc3370-68.iphmx.com: domain of Ian.Jackson@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="Ian.Jackson@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa4.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: ruZtTklUsHsQJ8XEXXu5sytWtU6aYXdiMy35nK/i/u1+k7GD+X3mqwBtvWvB/R7gLvbsPEJLwA oNSaU6jfby5+eWMz6lD75F/InIZPWaQUXK0ERDx9OcVOT/jb8AbkwoxDhjk+0WCsO8WFXTdht6 waOHFhLCq+fIH79y9unTEA+s5I/KxBbCaPXb9L97M8Z4e6TMA2/qz7hwc0f1ds0SRvRJZM2aSQ K4TL6Ou2FUp/AkiLDWBtB9yvAEfxX4MTOJ9o9kvVRci0Y26OFicDG3hIm29d1v6OMptisA02hY wAw= X-SBRS: 2.7 X-MesageID: 8592083 X-Ironport-Server: esa4.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.68,283,1569297600"; d="scan'208";a="8592083" From: Ian Jackson To: Date: Fri, 8 Nov 2019 18:49:54 +0000 Message-ID: <20191108185001.3319-7-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20191108185001.3319-1-ian.jackson@eu.citrix.com> References: <20191108185001.3319-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 06/13] sg-report-host-history: Add $cachekey argument to jobquery X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Ian Jackson Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) This key will distinguish the results of different queries we do per job. Right now it is not used, so no functional change. Signed-off-by: Ian Jackson --- sg-report-host-history | 9 +++++---- 1 file changed, 5 insertions(+), 4 deletions(-) diff --git a/sg-report-host-history b/sg-report-host-history index 81a7a8d8..4c40cbec 100755 --- a/sg-report-host-history +++ b/sg-report-host-history @@ -109,7 +109,8 @@ END print DEBUG "MINFLIGHT $minflight\n"; } =20 -sub jobquery ($$) { +sub jobquery ($$$) { + my ($q, $jr, $cachekey) =3D @_; my ($q, $jr) =3D @_; $q->execute($jr->{flight}, $jr->{job}); return $q->fetchrow_hashref(); @@ -218,7 +219,7 @@ END foreach my $jr (@$inrows) { print DEBUG "JOB $jr->{flight}.$jr->{job} "; =20 - my $endedrow =3D jobquery($endedq, $jr); + my $endedrow =3D jobquery($endedq, $jr, 'e'); if (!$endedrow) { print DEBUG "no-finished\n"; next; @@ -235,8 +236,8 @@ END my $alternate =3D 0; foreach my $jr (@rows) { print DEBUG "JR $jr->{flight}.$jr->{job}\n"; - my $ir =3D jobquery($infoq, $jr); - my $ar =3D jobquery($allocdq, $jr); + my $ir =3D jobquery($infoq, $jr, 'i'); + my $ar =3D jobquery($allocdq, $jr, 'a'); my $ident =3D $jr->{name}; $jrunvarq->execute($jr->{flight}, $jr->{job}, $ident); my %runvars; --=20 2.11.0 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xenproject.org https://lists.xenproject.org/mailman/listinfo/xen-devel From nobody Fri Apr 26 09:04:09 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail(p=none dis=none) header.from=eu.citrix.com ARC-Seal: i=1; a=rsa-sha256; t=1573239100; cv=none; d=zoho.com; s=zohoarc; b=azUJ4dl8bmm5K2fU6HYWBfCD57H/6kZiokhucgzYip0Kx8M5OxoNgeq70i/HTXJTP4o2SMqBJeGiv2H4wmHn0tjBpCYGYx2cNdSXPkXu8gxY3txCbzSyg1yiundMmTtLKwvKlvc7oX/TyaOQSBN7XvFOG13fg1xVN59EgbIJusI= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1573239100; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=nv6DQ95Lgo6iLeLF7NdDPjCMeMrD+zEIJDNDAbSgTMs=; b=TOvY2ihgW9uE9h+OSLhbjkjTTcjdHqFE45PFpy1wJmUP5lCVgCX3Ty/EWXlchWPJ70uh9QYyDNItY4VOa/a0/iKJlpJ+1x4RcRRb7Ot3U6G3RdvMm4D2A57/C7dIOVGt81tS3Bn+sDjU9Z2Fo7TSEO6/tHWt9LXdE0V1U5gLhbY= ARC-Authentication-Results: i=1; mx.zoho.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1573239100392225.4071363250149; Fri, 8 Nov 2019 10:51:40 -0800 (PST) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9LG-00081o-FG; Fri, 08 Nov 2019 18:50:42 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9LF-00080l-6I for xen-devel@lists.xenproject.org; Fri, 08 Nov 2019 18:50:41 +0000 Received: from esa6.hc3370-68.iphmx.com (unknown [216.71.155.175]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 97d92b90-0258-11ea-a1d6-12813bfff9fa; Fri, 08 Nov 2019 18:50:12 +0000 (UTC) X-Inumbo-ID: 97d92b90-0258-11ea-a1d6-12813bfff9fa DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1573239012; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=P3Z8VMI+icST3yAdSjUhdxH7tSRxS6c72r762JBG3Tk=; b=J/CXcPNmmYkXGipgHDFgRFowou8Va7rYJUhcwHSU6dZMHVoRukgWDcij P0JNA1kGgG1hdWvJKPnLRzPEVtnaVE2XcS8MJloHN4/igogeUbTKHqsld ENgCPcUKxqEKeXD864HtZV0QSY2sUWRYVvsK7db68k2x8CBgA1ck57Gsh c=; Authentication-Results: esa6.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=ian.jackson@eu.citrix.com; spf=Pass smtp.mailfrom=Ian.Jackson@citrix.com; spf=None smtp.helo=postmaster@mail.citrix.com Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Received-SPF: None (esa6.hc3370-68.iphmx.com: no sender authenticity information available from domain of ian.jackson@eu.citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="ian.jackson@eu.citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa6.hc3370-68.iphmx.com: domain of Ian.Jackson@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="Ian.Jackson@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa6.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: 6jzBjl6l+FJO/3D7FV/XvqJUdnOGvfUJRNRCwxoSEXHqzRbh0T86uz7J+WzMj9VLirU7Pm/Cq7 tj2NVZ5UKGIjojWxclJK8tnl+cIOiJ3/wpidSJXDVA/fj1bRA6htrToOxQg1dCkUOBwHROy9rZ VjluPZdx9kics4x39L6qItReexPc5i6G7z2khnnNXaL13utqWC95zv1yrSK0FQn0KjTvE2E1BV fGDelmpun35kr4AoYzjUaBMmyI8ysSJUELlFxZUg6hTcbcV1tiOvQ0z5b3mCGBaSXGrkZaf1zP ALs= X-SBRS: 2.7 X-MesageID: 8482904 X-Ironport-Server: esa6.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.68,282,1569297600"; d="scan'208";a="8482904" From: Ian Jackson To: Date: Fri, 8 Nov 2019 18:49:55 +0000 Message-ID: <20191108185001.3319-8-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20191108185001.3319-1-ian.jackson@eu.citrix.com> References: <20191108185001.3319-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 07/13] sg-report-host-history: Store per-job query results in %$jr X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Ian Jackson Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) jobquery now looks for the subquery results in %$jr, under the cachekey, and only runs the query if it's not found. It then stores the value. We are going to persist the contents of %$jr across runs, and then this will avoid rerunning queries needlessly. No functional change yet. Signed-off-by: Ian Jackson --- sg-report-host-history | 24 +++++++++++++++++++++--- 1 file changed, 21 insertions(+), 3 deletions(-) diff --git a/sg-report-host-history b/sg-report-host-history index 4c40cbec..8767b25d 100755 --- a/sg-report-host-history +++ b/sg-report-host-history @@ -109,11 +109,21 @@ END print DEBUG "MINFLIGHT $minflight\n"; } =20 +our $jqcachemisses =3D 0; +our $jqtotal =3D 0; + sub jobquery ($$$) { my ($q, $jr, $cachekey) =3D @_; - my ($q, $jr) =3D @_; - $q->execute($jr->{flight}, $jr->{job}); - return $q->fetchrow_hashref(); + $jqtotal++; + $cachekey =3D '%'.$cachekey; + my $cached =3D $jr->{$cachekey}; + if (!$cached) { + $jqcachemisses++; + $q->execute($jr->{flight}, $jr->{job}); + $cached =3D $q->fetchrow_hashref(); + $jr->{$cachekey} =3D $cached; + } + return $cached; } =20 our %hosts; @@ -215,6 +225,12 @@ END my $inrows =3D $hosts{$hostname}; print DEBUG "FOUND ", (scalar @$inrows), " ROWS for $hostname\n"; =20 + # Each entry in @$inrows is a $jr, which is a hash + # It has keys for the result columns in mainquery + # It also has keys '%' (yes, with a literal '%') + # which are the results of per-job queries. + # The contents of $jr for each job is cached across runs. (TODO) + my @rows; foreach my $jr (@$inrows) { print DEBUG "JOB $jr->{flight}.$jr->{job} "; @@ -377,3 +393,5 @@ foreach my $host (sort keys %hosts) { reporthost $host; }); } + +print DEBUG "JQ CACHE ".($jqtotal-$jqcachemisses)." / $jqtotal\n"; --=20 2.11.0 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xenproject.org https://lists.xenproject.org/mailman/listinfo/xen-devel From nobody Fri Apr 26 09:04:09 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail(p=none dis=none) header.from=eu.citrix.com ARC-Seal: i=1; a=rsa-sha256; t=1573239114; cv=none; d=zoho.com; s=zohoarc; b=eajlsBgGj+tuV/nkvBgf+JPjmZY3HG1hCMdYyNRt3SwljoyJCQ8Adem57yZbsKc9+hzbw0nZ4Wvv3MU61A0QLDMf8T+UCxMVrwsFWrKhYNd6OcUDsydnjWhxCSumAO78+KMXwcEjztxugbhI2z+XBMbEPP7GxD9ICMgnXRF7/NU= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1573239114; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=CadQ9+SS6GP3X0efnPYJ1g1k1naUylwsDG4XFMRD6x4=; b=GSLCAXMby/IorXrHmae/7jFQqgYs9kMwwojOhcwwixz96QXBPLhrDF9EzSZEr1r3+un9yGIeGOCj5KEjcBE6pSwmc0SblRi+32E1bUYPDVyQ8GS7NDCQ2otioYHaWYC2tXHiJ8HiRvnh7hjGLhR5joqeDPPMW+BVmcbNIS+wld0= ARC-Authentication-Results: i=1; mx.zoho.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1573239114563292.7663503489848; Fri, 8 Nov 2019 10:51:54 -0800 (PST) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9LV-0008IO-Tu; Fri, 08 Nov 2019 18:50:57 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9LU-0008GY-6n for xen-devel@lists.xenproject.org; Fri, 08 Nov 2019 18:50:56 +0000 Received: from esa6.hc3370-68.iphmx.com (unknown [216.71.155.175]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id a3fd4a46-0258-11ea-a1d6-12813bfff9fa; Fri, 08 Nov 2019 18:50:32 +0000 (UTC) X-Inumbo-ID: a3fd4a46-0258-11ea-a1d6-12813bfff9fa DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1573239032; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=qrzJQmhahvfTPp0hZEvrj2AQz58PZWeWCNZzq89a/eE=; b=U19+1uD48oixmUo54iumRcLBE+z4c1oRdjYWG6OaTvjPkWfGdgbeBJF3 AS+kjuuZqUIx4WHUfh4mcWckg+7EGZipzaI+VP+dzTH2IpJaUvpzwVGvR 0gVlhE41FnHyDrw6UT0DlYkwQaTaHrAb3k0zhNnUGe+VoTsoFT9h7YmGK c=; Authentication-Results: esa6.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=ian.jackson@eu.citrix.com; spf=Pass smtp.mailfrom=Ian.Jackson@citrix.com; spf=None smtp.helo=postmaster@mail.citrix.com Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Received-SPF: None (esa6.hc3370-68.iphmx.com: no sender authenticity information available from domain of ian.jackson@eu.citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="ian.jackson@eu.citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa6.hc3370-68.iphmx.com: domain of Ian.Jackson@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="Ian.Jackson@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa6.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa6.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: V6SjVUiFAjnPPeuqeZoOhSWB15rHrzTKWgEy9zJv0aWlkzL4lkreCnGPpI0RfsLF5hDFmIv5BH N9X6WE8hYigpWHP0fI9NnESA2ciL6YIBpveP7ZpeOp8DUepwRlAmQ1rwLA4Wgl86WguS7DORik Qub4SP3RZS7yTOiKYSHShno3ENJ+ir2U9K7djibtcyJKAf2bCZMIFlfonb9piPqtQ1W3qoR7U4 NahEhY6cw30cxFAZDZBzFVV1MnWB0CWcHlO8m4ZIbcaPRTh6iiRa7j51UI1EbKezhk0to3Gbpa rG4= X-SBRS: 2.7 X-MesageID: 8482905 X-Ironport-Server: esa6.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.68,282,1569297600"; d="scan'208";a="8482905" From: Ian Jackson To: Date: Fri, 8 Nov 2019 18:49:56 +0000 Message-ID: <20191108185001.3319-9-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20191108185001.3319-1-ian.jackson@eu.citrix.com> References: <20191108185001.3319-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 08/13] sg-report-host-history: Write cache entries X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Ian Jackson Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) Write the %$jr contents out in a fairly terse format. We stuff it into a parseable SGML/XML comment in the output HTML. Nothing makes use of this yet - parsing it back in will come later. Signed-off-by: Ian Jackson --- sg-report-host-history | 23 +++++++++++++++++++++++ 1 file changed, 23 insertions(+) diff --git a/sg-report-host-history b/sg-report-host-history index 8767b25d..335efa1c 100755 --- a/sg-report-host-history +++ b/sg-report-host-history @@ -246,6 +246,27 @@ END push @rows, { %$jr, %$endedrow }; } =20 + my $write_cache_entry =3D sub { + my ($jr) =3D @_; + print H "\n"; + }; + @rows =3D sort { $b->{finished} <=3D> $a->{finished} } @rows; $#rows =3D $limit-1 if @rows > $limit; =20 @@ -338,6 +359,8 @@ END print H "" if !$any_power; print H "\n"; =20 + $write_cache_entry->($jr); + print H "\n\n"; $alternate ^=3D 1; } --=20 2.11.0 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xenproject.org https://lists.xenproject.org/mailman/listinfo/xen-devel From nobody Fri Apr 26 09:04:09 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail(p=none dis=none) header.from=eu.citrix.com ARC-Seal: i=1; a=rsa-sha256; t=1573239083; cv=none; d=zoho.com; s=zohoarc; b=j0E0JchxPZG/oQoxdkSYXAFQD1JO/Y2f+gmV61hQ82alEGWsumjWckwS/dVZ+RYKvg3QX3GjL6Ae8BD1pcaN2h+WQWkPivpMuFNg4svZ1k0SQVJD/v+FvqYk4jivlsinIfdqY5HxzfDPanlKR9IwZ3axN1yjuJlwfPVjHbyObz8= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1573239083; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=lyY7p/W6lkX9rzAldxSQeKhYfiZwK1vTB6gVCjS+ZNM=; b=XBhnPGIwR7ff1xXKd5bAkQXq+5/mJ2RuQdIyAE1KVVq+kmFm6GeHLwKTe93+J3g1EBwIjYBc60SO3NMPm2gL98jJ0W/Gxor8A+S/aKGKi2Tt8lc4KwKx9S49KJjf3GtNP1znneE4TMHoLtZSMNeaNvmLMYJ4+tfapQn9Zm72TPY= ARC-Authentication-Results: i=1; mx.zoho.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1573239083262631.1556726370678; Fri, 8 Nov 2019 10:51:23 -0800 (PST) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9Kx-0007p5-45; Fri, 08 Nov 2019 18:50:23 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9Kv-0007oS-Gs for xen-devel@lists.xenproject.org; Fri, 08 Nov 2019 18:50:21 +0000 Received: from esa4.hc3370-68.iphmx.com (unknown [216.71.155.144]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 982c7408-0258-11ea-adbe-bc764e2007e4; Fri, 08 Nov 2019 18:50:12 +0000 (UTC) X-Inumbo-ID: 982c7408-0258-11ea-adbe-bc764e2007e4 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1573239012; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=szQKg/Wf6Aq2GBX0kGjx+pa/nGjECUIuHHCeK+Q2KxE=; b=U2QFTiGZ4fXvocu9bCJZBhzTXtsv+9wceWksn+M+IVQQQaVoaxeiIgBF 5yNmofmdfHIzEmUOcrpjUDJV+VFzrvInUZ7IaIuDTmeWwO6lHpN9nrPRQ GKb2MycI1TGuASM2eAXc/ehyn63m+Q/E0s24PHqe5MfelLRO4BNXrlM09 Y=; Authentication-Results: esa4.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=ian.jackson@eu.citrix.com; spf=Pass smtp.mailfrom=Ian.Jackson@citrix.com; spf=None smtp.helo=postmaster@mail.citrix.com Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Received-SPF: None (esa4.hc3370-68.iphmx.com: no sender authenticity information available from domain of ian.jackson@eu.citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="ian.jackson@eu.citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa4.hc3370-68.iphmx.com: domain of Ian.Jackson@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="Ian.Jackson@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa4.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa4.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: iuDOH+M18GYSD6pFx8G5usJ9uewfTLH8XRHI1iODnaEID7335XwoEowsI6b9ewBJbZsQ7OZkv0 EOZYJNAWhg3jSwnCWWCmW2dFM3JjjZz5YuOI7CmZI8bC2LEQt7aYvN9+uPeqR8vg6sW98k2eQ4 6N4rA4P9drKwSBqJZ09yxp/yF3LK30unKOgUlIeOn+aVmHHD08cLIqxbGBzdddueb7bEoGiwBE 2hRuIJ94yp0D3WkOcSu85+AS7QSryJ6m3ng0dWi7+uwMP6s3Zfs3N7nD/7M4VYLww7vWMCudmi Du8= X-SBRS: 2.7 X-MesageID: 8592080 X-Ironport-Server: esa4.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.68,283,1569297600"; d="scan'208";a="8592080" From: Ian Jackson To: Date: Fri, 8 Nov 2019 18:49:57 +0000 Message-ID: <20191108185001.3319-10-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20191108185001.3319-1-ian.jackson@eu.citrix.com> References: <20191108185001.3319-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 09/13] sg-report-host-history: Write cache entries for tail, too X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Ian Jackson Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) mainquery fetches a number of rows supposed to be larger than needed for the output limit $limit. And then for each host we sort them by time of the last step - which means we must have the last step, which is a separate query for each job. We want to cache this information even for jobs we do not actually report in the html output. (There is still nothing which actually reads this cache data.) Signed-off-by: Ian Jackson --- sg-report-host-history | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/sg-report-host-history b/sg-report-host-history index 335efa1c..7dcfac9a 100755 --- a/sg-report-host-history +++ b/sg-report-host-history @@ -268,10 +268,15 @@ END }; =20 @rows =3D sort { $b->{finished} <=3D> $a->{finished} } @rows; - $#rows =3D $limit-1 if @rows > $limit; =20 my $alternate =3D 0; + my $wrote =3D 0; foreach my $jr (@rows) { + if ($wrote++ >=3D $limit) { + $write_cache_entry->($jr); + next; + } + print DEBUG "JR $jr->{flight}.$jr->{job}\n"; my $ir =3D jobquery($infoq, $jr, 'i'); my $ar =3D jobquery($allocdq, $jr, 'a'); --=20 2.11.0 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xenproject.org https://lists.xenproject.org/mailman/listinfo/xen-devel From nobody Fri Apr 26 09:04:09 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail(p=none dis=none) header.from=eu.citrix.com ARC-Seal: i=1; a=rsa-sha256; t=1573239089; cv=none; d=zoho.com; s=zohoarc; b=EmJCyEAsNcM2eNxoffq/y7jcW5yVEuiL3m7BrMocuH9RgPFdG8SsT+hdPuMWpaKhIKxEvnat44V4yHsBYCIS7bOaNciNtPVjBJITRFd72pQ/ayRSAjgs0Uua0TRPrcvSUUl2ZRkIrR0k/jErUJ/e26fwHTtEdKjhgr9FEDBgn0k= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1573239089; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=pOdAIx4BOXoPp8MbiKfYF61Bn4TB9z0qhOXVmNkbrt8=; b=bmzgAPZ7IuQqrObOcTS/Hrl0uza1TwRh6E/PY6SxfBjvIByJgA7ZiELxSbGTf0qZLe/4RouETHFPaCz/z2uAInIqM6R3puTAqzOB+3FSJgFfel75uoQ8Q0l5d4AGBSq6IelOsval6Jy4okH/MWFVhqf4EBPCTUTt9iXEDV1KdPM= ARC-Authentication-Results: i=1; mx.zoho.com; dkim=fail; spf=none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1573239089867327.9032543920697; Fri, 8 Nov 2019 10:51:29 -0800 (PST) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9L2-0007rV-GJ; Fri, 08 Nov 2019 18:50:28 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iT9L0-0007qi-H5 for xen-devel@lists.xenproject.org; Fri, 08 Nov 2019 18:50:26 +0000 Received: from esa1.hc3370-68.iphmx.com (unknown [216.71.145.142]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 985fefc2-0258-11ea-adbe-bc764e2007e4; Fri, 08 Nov 2019 18:50:13 +0000 (UTC) X-Inumbo-ID: 985fefc2-0258-11ea-adbe-bc764e2007e4 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1573239013; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=/1BUrxLf7Hu33d8hmx2S8NiK/Eg5xK2ZvgQwMUqqH3c=; b=Z2vCB02RM9TMbydqTBpYjP8tyZB9jL28oF9ZLvZJXSBGPJFLKi0LisiG Glaxp97u8E0Dxbor0WLC64VMSx0Xni1U2ml0M12H8Scx+byMCo9dKI92I BOmbZFm2nUqKOgAOZe2DJ0fFs/iT4knn+UdQKrhBuiA/gqLFuHEl1kq2u Y=; Authentication-Results: esa1.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=ian.jackson@eu.citrix.com; spf=Pass smtp.mailfrom=Ian.Jackson@citrix.com; spf=None smtp.helo=postmaster@mail.citrix.com Received-SPF: none (zoho.com: 192.237.175.120 is neither permitted nor denied by domain of lists.xenproject.org) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Received-SPF: None (esa1.hc3370-68.iphmx.com: no sender authenticity information available from domain of ian.jackson@eu.citrix.com) identity=pra; client-ip=162.221.158.21; receiver=esa1.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="ian.jackson@eu.citrix.com"; x-conformance=sidf_compatible Received-SPF: Pass (esa1.hc3370-68.iphmx.com: domain of Ian.Jackson@citrix.com designates 162.221.158.21 as permitted sender) identity=mailfrom; client-ip=162.221.158.21; receiver=esa1.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="Ian.Jackson@citrix.com"; x-conformance=sidf_compatible; x-record-type="v=spf1"; x-record-text="v=spf1 ip4:209.167.231.154 ip4:178.63.86.133 ip4:195.66.111.40/30 ip4:85.115.9.32/28 ip4:199.102.83.4 ip4:192.28.146.160 ip4:192.28.146.107 ip4:216.52.6.88 ip4:216.52.6.188 ip4:162.221.158.21 ip4:162.221.156.83 ip4:168.245.78.127 ~all" Received-SPF: None (esa1.hc3370-68.iphmx.com: no sender authenticity information available from domain of postmaster@mail.citrix.com) identity=helo; client-ip=162.221.158.21; receiver=esa1.hc3370-68.iphmx.com; envelope-from="Ian.Jackson@citrix.com"; x-sender="postmaster@mail.citrix.com"; x-conformance=sidf_compatible IronPort-SDR: VJ/yjvYsLCAWisoLUxuc5rNBOyWwMd7I4cDzFHpGGwV4L9kOnZIFAaFGd6pWFxVDiZVOOKpWCK wdHLuBXSUFodI6bFvqDOuKvam6VDsgNM3+Q2QwMhx8UJkvV/o/7K5OPR3l53DJ5HX/Zn3iZGxa RILbzu0VLKsOJyuMurduSv5mnH4hF2jDlYDNncKYPG9/jXfp74K6X7kbvgUp6Fwg5lgjNIyG5U oe2iThxnAMkEx27SMBUROOMnIW4C05bVWP47/XHmv6IpuL6gwLT41oDU1EUvqlc0Iq6aywjbyJ C+E= X-SBRS: 2.7 X-MesageID: 8185732 X-Ironport-Server: esa1.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED X-IronPort-AV: E=Sophos;i="5.68,282,1569297600"; d="scan'208";a="8185732" From: Ian Jackson To: Date: Fri, 8 Nov 2019 18:49:58 +0000 Message-ID: <20191108185001.3319-11-ian.jackson@eu.citrix.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20191108185001.3319-1-ian.jackson@eu.citrix.com> References: <20191108185001.3319-1-ian.jackson@eu.citrix.com> MIME-Version: 1.0 Subject: [Xen-devel] [OSSTEST PATCH 10/13] sg-report-host-history: Read cache entries X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Ian Jackson Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) Signed-off-by: Ian Jackson --- sg-report-host-history | 57 ++++++++++++++++++++++++++++++++++++++++++++++= +++- 1 file changed, 56 insertions(+), 1 deletion(-) diff --git a/sg-report-host-history b/sg-report-host-history index 7dcfac9a..e67c7346 100755 --- a/sg-report-host-history +++ b/sg-report-host-history @@ -31,6 +31,7 @@ use Osstest::Executive qw(:DEFAULT :colours); our $limit=3D 200; our $flightlimit; our $htmlout =3D "."; +our $read_existing=3D1; our $doinstall=3D1; our @blessings; =20 @@ -52,6 +53,8 @@ while (@ARGV && $ARGV[0] =3D~ m/^-/) { push @blessings, split ',', $1; } elsif (m/^--html-dir=3D(.*)$/) { $htmlout=3D $1; + } elsif (m/^--regenerate$/) { + $read_existing=3D 0; } elsif (m/^--no-install$/) { $doinstall=3D 0; } elsif (m/^--debug/) { @@ -69,6 +72,41 @@ our $restrictflight_cond =3D restrictflight_cond(); our $flightcond; our $minflight; =20 +our %hcaches; + +sub read_existing_logs ($) { + my ($hostname) =3D @_; + return unless $read_existing; + my $html_file =3D "$htmlout/$hostname.html"; + if (!open H, $html_file) { + return if $!=3D=3DENOENT; + die "failed to open $html_file: $!"; + } + my $tcache =3D { }; + $hcaches{$hostname} =3D $tcache; + for (;;) { + $_ =3D // last; + next unless m{^\<\!-- osstest-report-reuseable (.*)--\>$}; + my $jr =3D {}; + my $ch =3D $jr; + foreach (split / /, $1) { + if (m{^\w+$}) { + $ch =3D { }; + $jr->{'%'.$&} =3D $ch; + next; + } + s{^(\w+)=3D}{} or die; + my $k =3D $1; + s{\%([0-9a-f]{2})}{ chr hex $1 }ge; + $ch->{$k} =3D $_; + print DEBUG "GOTCACHE $hostname $k\n"; + } + print DEBUG "GOTCACHE $hostname \@ $jr->{flight} $jr->{job} $jr->{status}= ,$jr->{name}\n"; + $tcache->{$jr->{flight},$jr->{job},$jr->{status},$jr->{name}} =3D $jr; + } + close H; +} + sub computeflightsrange () { if (!$flightlimit) { my $flagscond =3D @@ -225,16 +263,26 @@ END my $inrows =3D $hosts{$hostname}; print DEBUG "FOUND ", (scalar @$inrows), " ROWS for $hostname\n"; =20 + my $tcache =3D $hcaches{$hostname}; + # Each entry in @$inrows is a $jr, which is a hash # It has keys for the result columns in mainquery # It also has keys '%' (yes, with a literal '%') # which are the results of per-job queries. - # The contents of $jr for each job is cached across runs. (TODO) + # The contents of $jr for each job is cached across runs. =20 my @rows; + my $cachehits =3D 0; foreach my $jr (@$inrows) { print DEBUG "JOB $jr->{flight}.$jr->{job} "; =20 + my $cacherow =3D + $tcache->{$jr->{flight},$jr->{job},$jr->{status},$jr->{name}}; + if ($cacherow) { + $jr =3D $cacherow; + $cachehits++; + } + my $endedrow =3D jobquery($endedq, $jr, 'e'); if (!$endedrow) { print DEBUG "no-finished\n"; @@ -246,6 +294,9 @@ END push @rows, { %$jr, %$endedrow }; } =20 + print DEBUG "CACHE $hostname $cachehits / ".(scalar @rows) + ." of ".(scalar %$tcache)."\n"; + my $write_cache_entry =3D sub { my ($jr) =3D @_; print H "