From nobody Thu Feb 12 17:33:30 2026 Received: from mgamail.intel.com (mgamail.intel.com [192.198.163.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id D7275150997 for ; Mon, 10 Jun 2024 18:35:45 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=192.198.163.16 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1718044547; cv=none; b=G1ppL5oRtsv7HSKfPONymNmtwSCvtE8WvKRdmNDqkhaVjc9Izu07aATQh+aig1a24p2ddJZT4woQ7ArCdCqxLb1+QHwhr6e69gMx3OvbDb8pbWralqYJpez4T0mTcWQzXSjpAUaAQXj8P88P8AeAW9BT4jK3qzbslgJGwPntan4= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1718044547; c=relaxed/simple; bh=t/+wi5aXo0hchSIFg9tTIykIO8cSw/PBndDjGzr5vMI=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=QcOQnZWAno96sZkAvDs4LYbXam3i1OLpAAVKly69qaUIindl2uBnEZ4477FmziU+ejTvJL3AeV9gL1w+/KNwneybuIrE6xhiiUuRPnCdiSKLjTOAxy0AyCDXYmD0EfiVbAKgY9T7p11b1giAGTO+sqRS3LNVGXKcw5n+0toyuzk= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=intel.com; spf=pass smtp.mailfrom=intel.com; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b=Diq24BdG; arc=none smtp.client-ip=192.198.163.16 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=intel.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=intel.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b="Diq24BdG" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1718044546; x=1749580546; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=t/+wi5aXo0hchSIFg9tTIykIO8cSw/PBndDjGzr5vMI=; b=Diq24BdGzNM0TD+7b6rRudPx1gK5stmKiSUAZYc4P/jvswrV7rruT+Uk 5C1aPGqs3AWfg5znXPwGarQb3OZvZGisMY7MYRf+ekhnA5NyaQA9Oo+A9 fEjRCA33i8EVjzFC4SNUU0S6Wf4lbqbvUXuF61n5wKBnC8OtnEuk9BPjM kvyANYAPxc8aYm33vkjdGUjpO0YJ+xZ0Tf9H3wI6KB099xS1LSiK0/MlW LjSmJryCe7AjVrmQnOuM/QR5sh8DePdOW/+8opSBRFoqiQaK5wtLPlAyX pqTZMv8GOOb77UbYfFzuuKAH9YdWlZ9sdGG2QIntjoqPcbJ2xIkwLkx1f g==; X-CSE-ConnectionGUID: Qjz1DyWkTVWXuQ08qeEfBQ== X-CSE-MsgGUID: V97FL51RQ5KZA/NKXuMU/Q== X-IronPort-AV: E=McAfee;i="6600,9927,11099"; a="12004829" X-IronPort-AV: E=Sophos;i="6.08,227,1712646000"; d="scan'208";a="12004829" Received: from fmviesa005.fm.intel.com ([10.60.135.145]) by fmvoesa110.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 10 Jun 2024 11:35:38 -0700 X-CSE-ConnectionGUID: oZ1Ye8/wTPyFeapy71YcgQ== X-CSE-MsgGUID: UvckYQpDRcKtIJLyOBuXBA== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.08,227,1712646000"; d="scan'208";a="43576572" Received: from agluck-desk3.sc.intel.com ([172.25.222.70]) by fmviesa005-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 10 Jun 2024 11:35:38 -0700 From: Tony Luck To: Fenghua Yu , Reinette Chatre , Maciej Wieczor-Retman , Peter Newman , James Morse , Babu Moger , Drew Fustini , Dave Martin Cc: x86@kernel.org, linux-kernel@vger.kernel.org, patches@lists.linux.dev, Tony Luck Subject: [PATCH v20 08/18] x86/resctrl: Prepare for new Sub-NUMA Cluster (SNC) monitor files Date: Mon, 10 Jun 2024 11:35:18 -0700 Message-ID: <20240610183528.349198-9-tony.luck@intel.com> X-Mailer: git-send-email 2.45.0 In-Reply-To: <20240610183528.349198-1-tony.luck@intel.com> References: <20240610183528.349198-1-tony.luck@intel.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable When SNC is enabled monitoring data is collected at the SNC node granularity, but must be reported at L3-cache granularity for backwards compatibility in addition to reporting at the node level. Add a "ci" field to the rdt_mon_domain structure to save the cache information about the enclosing L3 cache for the domain. This provides: 1) The cache id which is needed to compose the name of the legacy monitoring directory, and to determine which domains should be summed to provide L3-scoped data. 2) The shared_cpu_map which is needed to determine which CPUs can be used to read the RMID counters with the MSR interface. This is the first step to an eventual goal of monitor reporting files like this (for a system with two SNC nodes per L3): $ cd /sys/fs/resctrl/mon_data $ tree mon_L3_00 mon_L3_00 <- 00 here is L3 cache id =E2=94=9C=E2=94=80=E2=94=80 llc_occupancy \ These files provide legacy su= pport =E2=94=9C=E2=94=80=E2=94=80 mbm_local_bytes > for non-SNC aware monitor a= pps =E2=94=9C=E2=94=80=E2=94=80 mbm_total_bytes / that expect data at L3 cach= e level =E2=94=9C=E2=94=80=E2=94=80 mon_sub_L3_00 <- 00 here is SNC node id =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 llc_occupancy \ These f= iles are finer grained =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 mbm_local_bytes > data = from each SNC node =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 mbm_total_bytes / =E2=94=94=E2=94=80=E2=94=80 mon_sub_L3_01 =E2=94=9C=E2=94=80=E2=94=80 llc_occupancy \ =E2=94=9C=E2=94=80=E2=94=80 mbm_local_bytes > As above, but for node = 1. =E2=94=94=E2=94=80=E2=94=80 mbm_total_bytes / Signed-off-by: Tony Luck --- include/linux/resctrl.h | 2 ++ arch/x86/kernel/cpu/resctrl/internal.h | 1 + arch/x86/kernel/cpu/resctrl/core.c | 7 ++++++- arch/x86/kernel/cpu/resctrl/pseudo_lock.c | 1 - arch/x86/kernel/cpu/resctrl/rdtgroup.c | 1 - 5 files changed, 9 insertions(+), 3 deletions(-) diff --git a/include/linux/resctrl.h b/include/linux/resctrl.h index 64b6ad1b22a1..d733e1f6485d 100644 --- a/include/linux/resctrl.h +++ b/include/linux/resctrl.h @@ -96,6 +96,7 @@ struct rdt_ctrl_domain { /** * struct rdt_mon_domain - group of CPUs sharing a resctrl monitor resource * @hdr: common header for different domain types + * @ci: cache info for this domain * @rmid_busy_llc: bitmap of which limbo RMIDs are above threshold * @mbm_total: saved state for MBM total bandwidth * @mbm_local: saved state for MBM local bandwidth @@ -106,6 +107,7 @@ struct rdt_ctrl_domain { */ struct rdt_mon_domain { struct rdt_domain_hdr hdr; + struct cacheinfo *ci; unsigned long *rmid_busy_llc; struct mbm_state *mbm_total; struct mbm_state *mbm_local; diff --git a/arch/x86/kernel/cpu/resctrl/internal.h b/arch/x86/kernel/cpu/r= esctrl/internal.h index 135190e0711c..99f601d05f3b 100644 --- a/arch/x86/kernel/cpu/resctrl/internal.h +++ b/arch/x86/kernel/cpu/resctrl/internal.h @@ -2,6 +2,7 @@ #ifndef _ASM_X86_RESCTRL_INTERNAL_H #define _ASM_X86_RESCTRL_INTERNAL_H =20 +#include #include #include #include diff --git a/arch/x86/kernel/cpu/resctrl/core.c b/arch/x86/kernel/cpu/resct= rl/core.c index b86c525d0620..95ef8fe3cb50 100644 --- a/arch/x86/kernel/cpu/resctrl/core.c +++ b/arch/x86/kernel/cpu/resctrl/core.c @@ -19,7 +19,6 @@ #include #include #include -#include #include =20 #include @@ -608,6 +607,12 @@ static void domain_add_cpu_mon(int cpu, struct rdt_res= ource *r) d =3D &hw_dom->d_resctrl; d->hdr.id =3D id; d->hdr.type =3D RESCTRL_MON_DOMAIN; + d->ci =3D get_cpu_cacheinfo_level(cpu, RESCTRL_L3_CACHE); + if (!d->ci) { + pr_warn_once("Can't find L3 cache for CPU:%d resource %s\n", cpu, r->nam= e); + mon_domain_free(hw_dom); + return; + } cpumask_set_cpu(cpu, &d->hdr.cpu_mask); =20 if (arch_domain_mbm_alloc(r->num_rmid, hw_dom)) { diff --git a/arch/x86/kernel/cpu/resctrl/pseudo_lock.c b/arch/x86/kernel/cp= u/resctrl/pseudo_lock.c index 70f0069b87d8..e69489d48625 100644 --- a/arch/x86/kernel/cpu/resctrl/pseudo_lock.c +++ b/arch/x86/kernel/cpu/resctrl/pseudo_lock.c @@ -11,7 +11,6 @@ =20 #define pr_fmt(fmt) KBUILD_MODNAME ": " fmt =20 -#include #include #include #include diff --git a/arch/x86/kernel/cpu/resctrl/rdtgroup.c b/arch/x86/kernel/cpu/r= esctrl/rdtgroup.c index a0a43dbe011b..869dd1973b5d 100644 --- a/arch/x86/kernel/cpu/resctrl/rdtgroup.c +++ b/arch/x86/kernel/cpu/resctrl/rdtgroup.c @@ -12,7 +12,6 @@ =20 #define pr_fmt(fmt) KBUILD_MODNAME ": " fmt =20 -#include #include #include #include --=20 2.45.0