From nobody Mon Oct 6 13:20:34 2025 Received: from mx0b-00069f02.pphosted.com (mx0b-00069f02.pphosted.com [205.220.177.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 331E822DFB6; Sun, 20 Jul 2025 23:43:27 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=205.220.177.32 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753055009; cv=fail; b=unOOef+FIA0aUiaaMg9nDJ7fw6UNGkcL0uS1N3gQnwwzsy2k4rCsGuaE54BYzB8zMMvBBx+OCEHHd75xTOwQAMfl7p6/7FbsPB1KfxUf2G8fayBWrLraE1HV2N7AdFmFvX3r2r22JL+VrNMZSmhXAGRvyC1g8+M0PMIrdyjDR8Q= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753055009; c=relaxed/simple; bh=kLtviFDupo7ThMzwbIrvMyuC55ah2uTMRbA8ovBjLKA=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: Content-Type:MIME-Version; b=mU1rz5tlnzoOEQ2dni9WIr9CWvWRaZ1NCwRr7tivnm7R0zB/FTVk5UXyahEcxuxU7IVkxzNISWun/Ty/vDHdBXSiSY6oLqDh1/eTsr3UiHUb7nGaK9j5i/vr1TF/YFD108h+YcBgZZ5JUZZ4imZE2sd/eO6BUIwDxBzLTHqzGAU= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oracle.com; spf=pass smtp.mailfrom=oracle.com; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b=DYyPQNvj; dkim=pass (1024-bit key) header.d=oracle.onmicrosoft.com header.i=@oracle.onmicrosoft.com header.b=KSmEtvcM; arc=fail smtp.client-ip=205.220.177.32 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oracle.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=oracle.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b="DYyPQNvj"; dkim=pass (1024-bit key) header.d=oracle.onmicrosoft.com header.i=@oracle.onmicrosoft.com header.b="KSmEtvcM" Received: from pps.filterd (m0246631.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 56KM4UC8027455; Sun, 20 Jul 2025 23:42:34 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=cc :content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s= corp-2025-04-25; bh=yR5FAjmmrW3yfH58A5amOIOSkfS52EoZqrfy4nCU52U=; b= DYyPQNvjE6JwxFAYMsSRbnsuNUfxdbPURvRaCWpan4Qmk0QZAszRV8kD1C/QB+An 6smUSsah5KTd28XKi/hKunlQB3G/NEBGGM/oj9FB7OSvRrGsFBVVulVbWDubEZhp MBAhSZKnlmsehpT7GNw802vmlYJqVJSnGKsvOtGzjhO+XGwZGoCy28mVlP5Me4fc icalvBSnovuP1U1iL839XFQ1OkCpDlmSvSD6/y3qO8M1ubSoQXtq/2dri2YWP2Kp W/DoX3Wgm/phcMzrN0bx3jO2Yz02IOQL2frCgahwxVe8vrzFe7g8PCXjAVMS4+sF QR/NfQdVyAzFdqcGpY7aXA== Received: from phxpaimrmta02.imrmtpd1.prodappphxaev1.oraclevcn.com (phxpaimrmta02.appoci.oracle.com [147.154.114.232]) by mx0b-00069f02.pphosted.com (PPS) with ESMTPS id 4805hp9hy3-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 20 Jul 2025 23:42:33 +0000 (GMT) Received: from pps.filterd (phxpaimrmta02.imrmtpd1.prodappphxaev1.oraclevcn.com [127.0.0.1]) by phxpaimrmta02.imrmtpd1.prodappphxaev1.oraclevcn.com (8.18.1.2/8.18.1.2) with ESMTP id 56KJSZro010475; Sun, 20 Jul 2025 23:42:32 GMT Received: from nam02-bn1-obe.outbound.protection.outlook.com (mail-bn1nam02on2050.outbound.protection.outlook.com [40.107.212.50]) by phxpaimrmta02.imrmtpd1.prodappphxaev1.oraclevcn.com (PPS) with ESMTPS id 4801t7etnp-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 20 Jul 2025 23:42:32 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=yGCK6U308qtRa03ee04lRv58BXViPC4IVDYdADvAaV5UmWAZfy9tcFDBUaObBseAl3w/ZAM+S7fMaFSG41/ejIGRBhC64ialMm1CRhFtcSBKEg8NKnaF7TcS6Su6Y3YgfXhypKVRVeDP76hFXgAEeT3qWAYSmUUP+CPXRc/vySsd8VFEM8oOy3S/sirwg5XcopdIxmnbBf5xbqfv1sUvnnp2b7J3V8j7Uq0irVXfTOaSUea53P2PGr8DPD31yFFha9JyTKw1b7cJ6T9UolgcGJzgF9bEpXfWeR21rBYxK9YmTubv01tUIqJxsvdVCYH0YWiO2dCBySoHaIPQuuCqOw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=yR5FAjmmrW3yfH58A5amOIOSkfS52EoZqrfy4nCU52U=; b=tuQU9Gxqbo5fZpPtlwSC5OQhk6wUhLDb/cDSLf/4eMlsjuJd/fdQXDo+3U7jCmANNGZh/cReQiDEHBONpOkIR074HVPXRPJoRcvjniOb5k5a2u54XUrIlUJ/vSia1oI7fv7fd/xK+Lub9H+YwkxrO/PsnoAe5THCDyurmE7gTf8zrJnlfr6vswM/7m69JHkPzx5ilpIsNab1RpDOfMjg/faOetxnHwZpivRan/ArjZh6CV49KqlbFlIFAIagk7wbKGTM6HVg3JEdcFqyCn2Pf81O/Vxssb3SRs8uJ+IsLBcoyPhO6EMgdyxdkiWp2Y9LAAaMDmdZpxsP1+aOsEaLlg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=yR5FAjmmrW3yfH58A5amOIOSkfS52EoZqrfy4nCU52U=; b=KSmEtvcMPF4QVujP/LPs9dJWaMyO5yOyrZUAysjmYNtBA9eELE++L64xiQuCsPLCcJ2ndkIU3N8tvqPeL+JvB4rF3iKnigmGULnSnXdguIAx4seGGZ1QuvbGiSCHGvE7w5O1mRT619xh8Kg3jrblkkXUdYG1i/lSdf1bjJIzQqg= Received: from CH3PR10MB7329.namprd10.prod.outlook.com (2603:10b6:610:12c::16) by MW4PR10MB6395.namprd10.prod.outlook.com (2603:10b6:303:1ea::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8943.29; Sun, 20 Jul 2025 23:42:29 +0000 Received: from CH3PR10MB7329.namprd10.prod.outlook.com ([fe80::c2a4:fdda:f0c2:6f71]) by CH3PR10MB7329.namprd10.prod.outlook.com ([fe80::c2a4:fdda:f0c2:6f71%4]) with mapi id 15.20.8943.028; Sun, 20 Jul 2025 23:42:28 +0000 From: Harry Yoo To: Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , Andy Lutomirski , Peter Zijlstra , Andrey Ryabinin , Arnd Bergmann , Andrew Morton , Dennis Zhou , Tejun Heo , Christoph Lameter Cc: "H . Peter Anvin" , Alexander Potapenko , Andrey Konovalov , Dmitry Vyukov , Vincenzo Frascino , Juergen Gross , Kevin Brodsky , Muchun Song , Oscar Salvador , Joao Martins , Lorenzo Stoakes , Jane Chu , Alistair Popple , Mike Rapoport , David Hildenbrand , Gwan-gyeong Mun , "Aneesh Kumar K . V" , x86@kernel.org, linux-kernel@vger.kernel.org, linux-arch@vger.kernel.org, linux-mm@kvack.org, Harry Yoo , stable@vger.kernel.org Subject: [PATCH v2 mm-hotfixes 1/5] mm: move page table sync declarations to asm/pgalloc.h Date: Mon, 21 Jul 2025 08:41:59 +0900 Message-ID: <20250720234203.9126-2-harry.yoo@oracle.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20250720234203.9126-1-harry.yoo@oracle.com> References: <20250720234203.9126-1-harry.yoo@oracle.com> Content-Transfer-Encoding: quoted-printable X-ClientProxiedBy: SL2PR01CA0003.apcprd01.prod.exchangelabs.com (2603:1096:100:41::15) To CH3PR10MB7329.namprd10.prod.outlook.com (2603:10b6:610:12c::16) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH3PR10MB7329:EE_|MW4PR10MB6395:EE_ X-MS-Office365-Filtering-Correlation-Id: b0e98954-bc55-47d7-7967-08ddc7e71684 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|376014|7416014|366016|921020; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?86otFwUSwX4teont63L5HnlMlLgz0iaJ6mgzHjVpPrUGojNUboIYNCX9pOSE?= =?us-ascii?Q?AA3hcLL+uyPa7C2j0wkIYC/bmr/ebv2AS22S2DdJ+aLn+Y75lvljj1U2Aw8N?= =?us-ascii?Q?5BQ0e2d02EKpkAAX56Ck3TO4dn/aasA4lk74Yb0JO7hqiXktpGSXQw7+RH8U?= =?us-ascii?Q?K9P61ZGM46ZXPqUhWqvsaRLe8gGiN5HvrqNU4dM/V8QV0UVJdQYPlie8Oid2?= =?us-ascii?Q?p/lD0aXEBuIDpkHu9+67UW3njEhCGdfKMDgeOnIQjGJEdoUOgWzrGuMINjUj?= =?us-ascii?Q?ZEbtcRfLpYiYyeseF06fJAZt9adya4Ypz6F5PYQ3Ths3+9d9/rYnZw+/CIQ/?= =?us-ascii?Q?ce7ZgvpKIEs0fnshVN2gThthQ7ihCj+kfeTXpUr7iu25t5Dex5FGZGOFD0sz?= =?us-ascii?Q?O1uLnlQ5sMbTAteY5sdM58zkiDC8URblrJCwLdftu29TosvrdFZLjGVC1yfS?= =?us-ascii?Q?1De0XRZ2svwZ6sj2/qVTyzZ0kqcoySCLr/QuqHg9b3ZmAIgiX4dBzsQMUDHT?= =?us-ascii?Q?k0eacgKOLQfjCsGlVfZIAOlhFbo4IysT1S7qA+I/7q6lPkk7jQtsO4HPgR5M?= =?us-ascii?Q?NAUwTS9w1dolLtLyVhUWynM/8XjnE2xTzb6zADKsJ4U+/i+0q/ojauE6yqKp?= =?us-ascii?Q?fVN9H1CQglri9N6F63Z7XFK5Mpu9DRGVhwgSFGS2gFES9UajZUYr23A5CqxA?= =?us-ascii?Q?LnLk8SOvHWYZAjh3Xfcp7H2iKz+/e0mKYcZDksdaZ5N4xjxwa05j0gSCYM3/?= =?us-ascii?Q?CI/IFmrF/7aKQ0Zvv8WQG00f3nTz+Vt1XMVK0IS8bysNsxjQYP4PryhqRDLL?= =?us-ascii?Q?hOqdY9bO2d+m+iHrwFV2bHzQidXoLMrhQga1aW7ZV5w5bkCz/dIQ/Y56jR5l?= =?us-ascii?Q?H50Ox5zMjGr2lBVot3buXICCqJwq8VPDLQF/4gDlBb8kNKEFnBNH7SF0zp5s?= =?us-ascii?Q?lFdcUGAJuDMcMRNgPt2RL4WoW4MNya9zyU0qj23JZoyzfc7LJNKVHGaW7cwz?= =?us-ascii?Q?dk2U12JsMfzRkJ32rb3zfH4q8bByzEOncEv4Om2o+VUjngc7yBHQS6BjzRwi?= =?us-ascii?Q?kqQFe40dAcRnou6t69Gb3tlLj1u2YDAat0LbzbeX9VDaiFtw7NORe1DOteQw?= =?us-ascii?Q?T/X1FrA6BNgErUKlMd9XSl96NAaWnYR/x3vyBTinfTTlKUxmPECzNcYEKDvv?= =?us-ascii?Q?addMbCR7AYoBwinT+LiwO7pXen7IRX1AIE9kvZ+C/GDc1Ut3n6GgxGdOEvKj?= =?us-ascii?Q?ZQ1P7TnNt35Jisqm42F2r74VYb35Nl3jJaXRA9QZC1MElhtQA+wokOisMFis?= =?us-ascii?Q?Lsq5dkCwNyPz9QD+zzXsYNQxqjJ4K+NBmZLXIznoAjoFWPL0Iq/8V6+iygQX?= =?us-ascii?Q?AG5HBEs/a8fwHnsw9ZCad72re5W1yNjvGyLADXHYuAJjBNb30o56XFf8ZEbO?= =?us-ascii?Q?40TpvS7e6Nkb/8plRgscMDMkVO91Kbi6bzPSUYk1nN8QMNmE0D/hLA=3D=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CH3PR10MB7329.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(376014)(7416014)(366016)(921020);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?E9v4ml4A05znrfi+X6M8i+LhyoRR0T1RHhjCiikxHOOZIWwUuSDC0mpKnFt3?= =?us-ascii?Q?Y9XhNQpp57rsmZEGQbZK0gdk5efuSPOf0QrT+ixqQX4TatHLvh0l21FPOVhX?= =?us-ascii?Q?MabFqh/shn6+R4/9LbN21BEBb5xUtOeoOlbYj6Mp16lucxmpyjHLSimE1R+X?= =?us-ascii?Q?d6IdY2RTajHLN3c4bwLxonS/Jmveqanv/13Z0uIKcjUSpYDOSBPmn5KuaVhK?= =?us-ascii?Q?hFu/OfaUuh4YWT/8qAGX1M9hmkBJZpjw87u9JMpjZdjwNeMd/Mv+jIonimVS?= =?us-ascii?Q?DTB3TTU4OAABGyqQNAEFbwvg9J8IyQKCISRx72hzZHNVMhK2Ng5QAOz+f9Uo?= =?us-ascii?Q?6q2BK1wARI/VpDtGbXVSjbKl7EEBXy1uv9YqodbajC7HY4fxr9iTqBalVDLm?= =?us-ascii?Q?4Wg7omFa4Pt7s9szcN6jDg6wP13OCoM5DkMqMY3hJZ0rASVB3pOO9Od4PcLZ?= =?us-ascii?Q?lk7xZRv0Pq5EwuQZkOqgLkG3faOoqU/MnrLjAI+vVV4DUlLJWONZg4jYpXhD?= =?us-ascii?Q?cx7AmqAKBbqalPdxCtWPnLcJ0S8DAx/8yTbaLTZAj9PrDjJgP+XyIUZtqAZ9?= =?us-ascii?Q?QL5Ci6lPVNXCJaDysoVhrAFpF4uRduZt9SVu5sK5fEOKuyj81JLnq8qdyz4s?= =?us-ascii?Q?4MRG5hdFaM048IGqcSVsMLbTntx3ZYyAPUH8u43yoqf6YK2t0fxACVAvY8Tm?= =?us-ascii?Q?Nc9zlEIghlII7wdtVqNXQZk4udUmm+sPY+n3TqQJxllhrtO9QMxiZs1T7FHW?= =?us-ascii?Q?MvkbQufaPmosYA/lfsovlOqABg6hQ1gKQEZiH0lE0uL6N69ev1lTzfnUJiJO?= =?us-ascii?Q?V59bmvKyya43YUpVGdXtDuOqX+9Ra/rqmEKDnr/3Y5sB/jKBHEAP3IHHnKtG?= =?us-ascii?Q?KPYow901cw+xti/ChOM7agx12KaPJkyhd2yJ5wd7oyo4yFMFWr5qt4H/6PaL?= =?us-ascii?Q?3pSOFOmuvH+y6NUTmX+9iuDCtKwLeXWkF+pAXwuYqpLMfHCFssHeTZLOW5JT?= =?us-ascii?Q?an0QJ+mWxtwf0idEpg4701XPigGLUorWMMcTSDRSUpwQKVuKK3n8bFaGxlQ7?= =?us-ascii?Q?SLiukvj84zRHZ+LryluTmqUPpA3sZHFyZ6c1Sxw/p32T2j760fBIz12hHliH?= =?us-ascii?Q?EXW/D/Em/CkBpMLc92vnudgD04hVAtscotBqkxyuKo03Fe4+/rArLiEN62rU?= =?us-ascii?Q?cefHqv19MZzeaA6ysPbGAXT1gtykooyd4MBNg1VHjUgwKhIQpI3u9MEL19wb?= =?us-ascii?Q?G0v/co2rQyR24X2kwN2ZsdSBMiL/A7NaYaUoZK/gts09Jf3x6nk6/GySSZdY?= =?us-ascii?Q?8zYu6hkRfh7HN8o6d96UQAOUg+JSnmA8aZDD1T3wbg0TRZWw+3Ik49Icz5JC?= =?us-ascii?Q?td20Fir7bCnRQBKWf3pagWh0OL3/eQqWCW/AI1R9QBZjrcpbIBI3UfICPYJy?= =?us-ascii?Q?odM+hmxbJN8/ZRAEiQHDTLSDbi0yRqhBXSvwBLSP3qbwLYGDBjH9bs6JcM9D?= =?us-ascii?Q?ATJFEGq0RS7khST1Lem1PgHtTU1IgIEsKQ8SLGOS2kqEgfIlROcq5sS2/Mur?= =?us-ascii?Q?kF2XgBMN6xjIhtafxePRdFIMNMj9JlXPV+tRihix?= X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 5mnNdbVI4ThWnT4aCEd+5r6Po7NGtPt4pmXFLYHqTC7pVY4ByJcuCxEyPBBNwwW4yNOZd7kukNS3s3A56+0J+xLD0wToKM7OaYYyqs20kvYwVwbY8Artcb1WtUj82a5zdWFHk/IGslupQrzdpHFsqQCC3ujJHqgrhXrhmYrzkPrFT04ycKJ+/ISUa9TupHJMLrcZ6Whyyhz4sAQvD2p7rtycGJ6q+MyKoxuYZQIlA6WRd6XcztTVa5aV9PhEheIUntEfBsxTiOzGuU4P6+N1RVvoNVp03q5ckGItkMc1TK7fTTRwrZmqrNZnRdXsHsU3b4DRMpZZw7RyWF3DINHQvve1Ue2Z0gt9TwREc+MSd2aFZVMI6HRW8ozYCQK2o4IbEv5rSXbzRRWotUNvQks6P1v5LVQ06e6skM1Wgt+sZTd7jGgd3jBX3MQ/x6rgEwkRDzL2qVb1C0QUEctZlovue9zYUBU+oNbVBnHN31UCbT2zI8iOhwiPrIYY36Tm3RgbX2uSC52WhCw+SmjQmr2HSKQLalfqPalXRcShtlhid2iqPIfRm9sPbBiVDo/FGR6I1SxrafLFGyGQh6w+ieI6RJaivA+aprAX7WWpDotu9NY= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: b0e98954-bc55-47d7-7967-08ddc7e71684 X-MS-Exchange-CrossTenant-AuthSource: CH3PR10MB7329.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Jul 2025 23:42:28.8175 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 14sXHDurKgYcnIWB2YVfjUaEc0cADzocUqUhcU55IKWZwdOpbgkefrtXoqxu//eMc+4C6gznnzm0YFrxCF24vA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR10MB6395 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1099,Hydra:6.1.9,FMLib:17.12.80.40 definitions=2025-07-20_02,2025-07-17_02,2025-03-28_01 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 adultscore=0 spamscore=0 phishscore=0 mlxscore=0 bulkscore=0 mlxlogscore=999 suspectscore=0 malwarescore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2505160000 definitions=main-2507200228 X-Proofpoint-ORIG-GUID: NIyt4rs4EQvP8GYYq0yT1xcRpLf0l3pa X-Authority-Analysis: v=2.4 cv=YY+95xRf c=1 sm=1 tr=0 ts=687d7ee9 cx=c_pps a=OOZaFjgC48PWsiFpTAqLcw==:117 a=OOZaFjgC48PWsiFpTAqLcw==:17 a=6eWqkTHjU83fiwn7nKZWdM+Sl24=:19 a=lCpzRmAYbLLaTzLvsPZ7Mbvzbb8=:19 a=wKuvFiaSGQ0qltdbU6+NXLB8nM8=:19 a=Ol13hO9ccFRV9qXi2t6ftBPywas=:19 a=xqWC_Br6kY4A:10 a=Wb1JkmetP80A:10 a=GoEa3M9JfhUA:10 a=VwQbUJbxAAAA:8 a=yPCof4ZbAAAA:8 a=GhCPV-VjlYWqgBCm5TUA:9 X-Proofpoint-GUID: NIyt4rs4EQvP8GYYq0yT1xcRpLf0l3pa X-Proofpoint-Spam-Details-Enc: AW1haW4tMjUwNzIwMDIyOCBTYWx0ZWRfX3LgFqrux1OP4 w5DLVc51ADHmbMGufAbk9xutgOKvYC6oZViVZp9ma7gb7IrnpRx7x2fs2xu6zZDQkdsbATrvQsB B0j3DkEcyngidDjbQ7CPHBOLptXLtn+qrAxR6OR1U7BQ9TubGdy439Rvcs9ed+BCY2V7oCdXWKm MkKhAHgZ7FJ4jkdOFGclw32N51SdqB75axcmcSyO2v891x3sEwXLNuLHZ6x4ik5Jx4B9dKFToWn odzwL4nULrXJfkMeetloS10BTTwU5qzJxxfks0zOV0Eq2XonXp34oLHJ2d+4g8lrUNU1UnAe2Ik 6GhN6N/+4S2N2QjvZbHM58rHfAAN31bBes2r/iFHMnCvtbySEzcImAlJL5xcNo1cvwGS5/wLUQ9 pLiidtf+keku9uaH4EBkxQbhDOnePa+HwHJ4zZvWhFNCkg0H+aeZq6h664hjm8jzuwah/YB5 Content-Type: text/plain; charset="utf-8" Move ARCH_PAGE_TABLE_SYNC_MASK and arch_sync_kernel_mappings() to asm/pgalloc.h so that they can be used outside of vmalloc and ioremap. Cc: stable@vger.kernel.org Signed-off-by: Harry Yoo --- include/asm-generic/pgalloc.h | 16 ++++++++++++++++ include/linux/vmalloc.h | 16 ---------------- mm/vmalloc.c | 1 + 3 files changed, 17 insertions(+), 16 deletions(-) diff --git a/include/asm-generic/pgalloc.h b/include/asm-generic/pgalloc.h index 3c8ec3bfea44..7ff5d7ca4cd6 100644 --- a/include/asm-generic/pgalloc.h +++ b/include/asm-generic/pgalloc.h @@ -296,6 +296,22 @@ static inline void pgd_free(struct mm_struct *mm, pgd_= t *pgd) } #endif =20 +/* + * Architectures can set this mask to a combination of PGTBL_P?D_MODIFIED = values + * and let generic vmalloc and ioremap code know when arch_sync_kernel_map= pings() + * needs to be called. + */ +#ifndef ARCH_PAGE_TABLE_SYNC_MASK +#define ARCH_PAGE_TABLE_SYNC_MASK 0 +#endif + +/* + * There is no default implementation for arch_sync_kernel_mappings(). It = is + * relied upon the compiler to optimize calls out if ARCH_PAGE_TABLE_SYNC_= MASK + * is 0. + */ +void arch_sync_kernel_mappings(unsigned long start, unsigned long end); + #endif /* CONFIG_MMU */ =20 #endif /* __ASM_GENERIC_PGALLOC_H */ diff --git a/include/linux/vmalloc.h b/include/linux/vmalloc.h index fdc9aeb74a44..2759dac6be44 100644 --- a/include/linux/vmalloc.h +++ b/include/linux/vmalloc.h @@ -219,22 +219,6 @@ extern int remap_vmalloc_range(struct vm_area_struct *= vma, void *addr, int vmap_pages_range(unsigned long addr, unsigned long end, pgprot_t prot, struct page **pages, unsigned int page_shift); =20 -/* - * Architectures can set this mask to a combination of PGTBL_P?D_MODIFIED = values - * and let generic vmalloc and ioremap code know when arch_sync_kernel_map= pings() - * needs to be called. - */ -#ifndef ARCH_PAGE_TABLE_SYNC_MASK -#define ARCH_PAGE_TABLE_SYNC_MASK 0 -#endif - -/* - * There is no default implementation for arch_sync_kernel_mappings(). It = is - * relied upon the compiler to optimize calls out if ARCH_PAGE_TABLE_SYNC_= MASK - * is 0. - */ -void arch_sync_kernel_mappings(unsigned long start, unsigned long end); - /* * Lowlevel-APIs (not for driver use!) */ diff --git a/mm/vmalloc.c b/mm/vmalloc.c index 6dbcdceecae1..37d4a2783246 100644 --- a/mm/vmalloc.c +++ b/mm/vmalloc.c @@ -42,6 +42,7 @@ #include #include #include +#include #include =20 #define CREATE_TRACE_POINTS --=20 2.43.0 From nobody Mon Oct 6 13:20:34 2025 Received: from mx0b-00069f02.pphosted.com (mx0b-00069f02.pphosted.com [205.220.177.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 5588D22B5A5; Sun, 20 Jul 2025 23:43:26 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=205.220.177.32 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753055008; cv=fail; b=Z+PLMy7G/xxDbebXkuWNGvaZ+ON9fVO0+KZjyAClxQcHE/8MtphMLRFk5ebgSvz+/Qd6wSX9jOz1cx37mkeTHYUMDO9vz7YZZnlN1Tj9YFi9S1ZP8taoF8XxVpRv1JL6yMSzdeFACgiQpAxw0QapR5P1rHfwRzDfjpiZHHRd/EA= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753055008; c=relaxed/simple; bh=KSna9STvoWitvY+wSSY4zPu25Cs7geWioy0PI6zdigs=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: Content-Type:MIME-Version; b=dEsaO9cZNH4seBcEm1aeLImgfqmS02SnEsiBT1ndzMnnJAepg9i6k4N484K/Gx4vXofYYendv19c1YDsEIVycSLX69drwOxNlEe+69UorsFbrIXfInt9wa4RYhyOSOZO2CSBfjnsoEFWzmyzOv/duNzjX/sZYTqIxQA3ygtDkn4= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oracle.com; spf=pass smtp.mailfrom=oracle.com; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b=aoFWMhIr; dkim=pass (1024-bit key) header.d=oracle.onmicrosoft.com header.i=@oracle.onmicrosoft.com header.b=DT+M0TvP; arc=fail smtp.client-ip=205.220.177.32 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oracle.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=oracle.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b="aoFWMhIr"; dkim=pass (1024-bit key) header.d=oracle.onmicrosoft.com header.i=@oracle.onmicrosoft.com header.b="DT+M0TvP" Received: from pps.filterd (m0246630.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 56KNcjwm000756; Sun, 20 Jul 2025 23:42:36 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=cc :content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s= corp-2025-04-25; bh=6OLCAaSp5iQ0AhGcMbXgkquD35l6QkEqnc9iLyhc060=; b= aoFWMhIryfHj9GIjBQJTOfW8eShthIgQpZnuvcvabQhA4qqMo0vDYu3gYNrAlHjE uP1ue8Q36/jfjijJDEke4ROHCBOFLuFZEaTKctIqKJpbIbW7wbAa73jZwlGZoahG cJgGhkMGZCneiapldfJ0UTMq+XYrwQNSthPhEHSGWBwj1P+k6XjlWBzSlCtx4Kvk G5hfULO9oHjqjnD35WSd/PP00C33xfHbFefGzx2JpkYkaqgZd3VSmelOpIDmcYDm keSxK0roGFaLdBjQ7gnULuhn/WlPGzvnrGLAx+4YyJlvY1lFR3BJPC1CuvITRUbD cOwXJr1aOT3yKUKzgVmfGA== Received: from iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (iadpaimrmta02.appoci.oracle.com [147.154.18.20]) by mx0b-00069f02.pphosted.com (PPS) with ESMTPS id 480576hhru-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 20 Jul 2025 23:42:36 +0000 (GMT) Received: from pps.filterd (iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com [127.0.0.1]) by iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (8.18.1.2/8.18.1.2) with ESMTP id 56KN59O3031545; Sun, 20 Jul 2025 23:42:35 GMT Received: from nam11-dm6-obe.outbound.protection.outlook.com (mail-dm6nam11on2040.outbound.protection.outlook.com [40.107.223.40]) by iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (PPS) with ESMTPS id 4801tdpj9k-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 20 Jul 2025 23:42:35 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=SpH1zs2qXHS+t22nULQcfQrFo4Szo+TwSrknJJbWvcvXHUExISp8Av9WCLVA1qrPBraA3pcLuWNEyB6zCQjWlcyXBseKK9/T8NA1p3pSfJxYsHYkDwSkJhkcomJm9OjXU/9smgryQaGLAfRAuNt0ZYkFA5pKjLZ5DIx/07W8pvIc2qaqRGgvLZgojwMQwP+kx8RdHKOm24REesUAmX8WbirqlvyS59AnfIzuIXXt5IdIhHkHFAduQFvpCZ9e+1qPMtS8xA9D5PV11BONm6O5U9fVYsdWvlPMlM7tKcqCZYvDWpWuE0TfJNeBsD8PidJH3j0VRZId4I1U4uL/6Wy+xA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=6OLCAaSp5iQ0AhGcMbXgkquD35l6QkEqnc9iLyhc060=; b=rIZ1XkyHFH9IEX/a9ZuqY+rR/j8ssy9BvGbrf7anGppWx8In1XV6QstH5O6icZ//mLPWhvO9ND1CAYPPmcj7CvE3JWvKOngAJrH/7tlkf5iz9HxD+6gSXUqT0YLPEdQ4xm9HOn+EvUpcIg56WXtJwxc6wGLuoqHr8oENqnhxD8TIrI+JkAV1/h0Wl+c2Cy7w7P44PARjer4iYgGv2f1nPruq8nSzoFebBqky3gaBASEvAMxMukH632UVliGn4vrBTTa2YpiWPhtAz1ZlAA5vvwj7RBEn2ovny237JudLZjChAzK2uwnFujkPsWetQ1oZDdwgrdSl0Su8EZ46REx8hw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=6OLCAaSp5iQ0AhGcMbXgkquD35l6QkEqnc9iLyhc060=; b=DT+M0TvP0y0EhpP+mOjcmT9kBIG7qqdq4N+jkQbieHLxQx9BYv/+JsH40UJ7qfonzw9HM5SBTlzS56Vkj09PfBVno0+epTi/IHZpr2K8ixDPv/CtuQMqJseCKCRDJWL1Xbk+042UjrpXL7DHp2lQRD9W1toucVtE3cCmzf72VC0= Received: from CH3PR10MB7329.namprd10.prod.outlook.com (2603:10b6:610:12c::16) by MW4PR10MB6395.namprd10.prod.outlook.com (2603:10b6:303:1ea::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8943.29; Sun, 20 Jul 2025 23:42:32 +0000 Received: from CH3PR10MB7329.namprd10.prod.outlook.com ([fe80::c2a4:fdda:f0c2:6f71]) by CH3PR10MB7329.namprd10.prod.outlook.com ([fe80::c2a4:fdda:f0c2:6f71%4]) with mapi id 15.20.8943.028; Sun, 20 Jul 2025 23:42:32 +0000 From: Harry Yoo To: Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , Andy Lutomirski , Peter Zijlstra , Andrey Ryabinin , Arnd Bergmann , Andrew Morton , Dennis Zhou , Tejun Heo , Christoph Lameter Cc: "H . Peter Anvin" , Alexander Potapenko , Andrey Konovalov , Dmitry Vyukov , Vincenzo Frascino , Juergen Gross , Kevin Brodsky , Muchun Song , Oscar Salvador , Joao Martins , Lorenzo Stoakes , Jane Chu , Alistair Popple , Mike Rapoport , David Hildenbrand , Gwan-gyeong Mun , "Aneesh Kumar K . V" , x86@kernel.org, linux-kernel@vger.kernel.org, linux-arch@vger.kernel.org, linux-mm@kvack.org, Harry Yoo , stable@vger.kernel.org Subject: [PATCH v2 mm-hotfixes 2/5] mm: introduce and use {pgd,p4d}_populate_kernel() Date: Mon, 21 Jul 2025 08:42:00 +0900 Message-ID: <20250720234203.9126-3-harry.yoo@oracle.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20250720234203.9126-1-harry.yoo@oracle.com> References: <20250720234203.9126-1-harry.yoo@oracle.com> Content-Transfer-Encoding: quoted-printable X-ClientProxiedBy: SE2P216CA0196.KORP216.PROD.OUTLOOK.COM (2603:1096:101:2c3::6) To CH3PR10MB7329.namprd10.prod.outlook.com (2603:10b6:610:12c::16) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH3PR10MB7329:EE_|MW4PR10MB6395:EE_ X-MS-Office365-Filtering-Correlation-Id: ce56369d-6b5a-40c6-d61f-08ddc7e71894 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|376014|7416014|366016|921020; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?nneGnqr/NLzJbxdH6FS56qRkW/y8RmZE2V8pq+DmF4r1xBFqMZl2KZZvk+aZ?= =?us-ascii?Q?zqFB4y+35xN40o6qSlWlASb8eOU51/iXJLWJoWr0NSMeSGNw5QKuKhWFmwv9?= =?us-ascii?Q?JNJ6zYem6DUlqHERQlTECqrKSK40hsqqWuP/b/hG8iPabC01ijsl0bQYFllF?= =?us-ascii?Q?yE488TJclDN/7qEkASd/Q4xVXDgexam3nNi4BDfwK2slEE3hCnND0mU/xsjm?= =?us-ascii?Q?jFj799Oo4nFIHaFsciZ3vEU/frn50SVqDxH+3z8mQeOE4UGGlqY0CSo8ClLH?= =?us-ascii?Q?gw/wIlEyUM5A0JcYz2n9eoJ7zu8Aujh8+dqSMrPPXcRCP29xXSCt/eE8gHFk?= =?us-ascii?Q?+PyD1Qv1krVKRuUmweMZpOPcuz0cyjxqbnQgsnRzuiZPI61Y1wlHKF0yVs7r?= =?us-ascii?Q?Zbr+B4OvkWY3slgjpOEqA8NfbSkLjtL3jbvH/NFdrsUHHQLc8rnRP3FV5XW2?= =?us-ascii?Q?X0v4Bz+A3XItJrzZeyVsLAc/7snUVt7yyMe4oww04nq1r61J69QdVPdLg4q2?= =?us-ascii?Q?c9nkgFjK2s9jJAcqfmru/hMBxzOkjwiKW7V0sJPkdUXEGcKEmQQuxhkqoYph?= =?us-ascii?Q?Rf9DFNlmZXtal0FYS0RUr4fW3FiD8kIQyZjNQI3UZdHDsyZyWOfqu6yj+84W?= =?us-ascii?Q?Wxd0IOpGBCiDQv6NdO06RHuj74YAfwtbf62PnH3pCN55OEEtHG0FLZ9X3dJ7?= =?us-ascii?Q?tqZ4JslWlesmLH1fVj+YUKX9Y4lzHYFOWlTi3vv81qmOtjKxfrAAHm1MDw9m?= =?us-ascii?Q?Hj0qDWUtip7MAmLSnsE9QtwehilT1V+ThjM53iEViCF9etARkAdb/Me6smG8?= =?us-ascii?Q?9lxs79w9GWIvzHhkcTwQZR2dKDSZVbH6o7yEgHHZUvxcQEQe8CRAEgJuoosn?= =?us-ascii?Q?TMJnzgIu6GXs587VlnR6UlwGRtJnpDDAXw97FnXZoF+JVhMvQrSLTkmdD9SH?= =?us-ascii?Q?DcbJ2AvJl6IIZg+cp51v7bqLAxqrHVdFbuHizEsaxvLLWeGwOv0rvF8bIYrn?= =?us-ascii?Q?eKue0ZjogtPkSE9VOBI1h67GH+N7nTcFCwmDFssE2f2WjeREPT31o+5j7TqT?= =?us-ascii?Q?P2njvbLLa8dlS5RLKIKYU1QiCqLOgFn0oKUI1mGGwF7o3tTmD+p9VF0sLQDN?= =?us-ascii?Q?VROkXxCxevDveQhBPELfkQdirnb8fC/zqOkviEiMQ/q2hgwfVEF/qe6i+nWG?= =?us-ascii?Q?90ojjnB4wAukubpoUa/D9R7iVJQWVKSVMHdjx6ZwMDHfXVByEgqwcwmUP4gB?= =?us-ascii?Q?02nT0zpFrqS19LKnirUeT+iRJlLdXsglCK20ieUEKC/5eMJ+JevX2M4uIxy7?= =?us-ascii?Q?wrXwWpChitU2Ed7v91Tn2qUJL722Mah4gIaayWCei0ZgajQyzkgf1Ws/9Gf6?= =?us-ascii?Q?whjuv3Pw1tcci81Ra6UwtJa8Aj1p3LxacbmIyz1KiLHLVdgRv8JBCeU2VC13?= =?us-ascii?Q?kl6Q6HIIXUBZ/LkdC8ZW3wYvOSfeY0FIwvDpaKbPIdgM2KtBPxvo4Q=3D=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CH3PR10MB7329.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(376014)(7416014)(366016)(921020);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?//qGYSmFfFDShPSEp0NlCAymNqpk9xUunCAefatrBDHC8S8ALakN/QF/1jZU?= =?us-ascii?Q?fJ2mW4atCjQDzZbplb8vAhiXuxbRb3naKxxH5JzyHlOb4lCN1lcdca2f2JWj?= =?us-ascii?Q?tz+0Z0BDgxi0z7NmLTOxfqfYyL3+QlFYoIUUmkF9ScFR0yGFSgnQOHLCB/Jv?= =?us-ascii?Q?0E68Y4yLJQu2c0zzMAB4S1BwdlvhOiV0wErlciPjZHdGhMhKMGz2na7rGm8k?= =?us-ascii?Q?X2cIn/4i0iCZOoXFBLqoa917nQue+kxVqjgVJoDSZ0pm/ZTfZ9Oq+uB4fVkY?= =?us-ascii?Q?+Xd5HF5UQgDf+i4TiyDs+HKZQClqanYhwFy7QX1YQhwe6zMXR4QBnEEBrzoP?= =?us-ascii?Q?Jp2GcYq6mBjSbhQkC+9kf0+XEE1kG4LszO8IGVJF5kgi2nJDtulAyPZF+WOP?= =?us-ascii?Q?IVhirkAYGaevMMlwIBRr/hPYf/Q0maLuxWbWShwBkKX/ptVeYCwM7Fox3RB3?= =?us-ascii?Q?7viCziAEIedk9cqECbwFwoZdkj/yci4oOe7kPtJyo/3S1sHBpXH84nfjgoEu?= =?us-ascii?Q?g0Is+bmk3frh9l4PA3r8dV8jJBMGu7jkVd58PczCs8gRENeKhXwzUNzpJ7So?= =?us-ascii?Q?Bf45cEhQnvFoPLsPM0qu0HveYdIogCVzL6rXTBLgkZh4BpJHSucCXtm2fd3z?= =?us-ascii?Q?3pMFIjvCiKgSMUuifXTLFCpE1ONEfl8VvqxG2cZL4kisS+xkoFF0LmJ6tsbY?= =?us-ascii?Q?DiHYwFwDKTnr85DlMgPH6+PuAXBRFq+haiH1wMGCiBFKOYt82No+eYoueG3p?= =?us-ascii?Q?VpTPXtzkjLw/DRNSAlmTbCo+Vy+llyq4rjwkomDFEWF2iyyo6JjE6CXmls2n?= =?us-ascii?Q?O/+B+5fkzEES5AcKfuBHZQoIVUQgAisngqy/KqxCm2/RbQ9FJM1NZKXNPEz0?= =?us-ascii?Q?S4t2fcwCcDAoWDYkqHD6sQJUfySdKkIzhsr0YLbH/mXnwlAoM63fozqITD/t?= =?us-ascii?Q?ifzwNN2wBJwWzPmfHMiDxTpwNt4B0KaVvY4vlg2tdX0PsTcEG79aD7EfnQz+?= =?us-ascii?Q?YeYIf+n+FFGCzNMWvjCX8QuVKBehd85RXEd09OYqoT8sWOzAJtEK/rOXNnTy?= =?us-ascii?Q?wAGhq1LoDiVab0M4K3FgOg2lfby6ZB68iGrOoHe6UxQAfEPXeBtyBh6auAbb?= =?us-ascii?Q?BrdEBLiUQF6TqveghZBZbJ6/N7c5pO/7YfhmIo+4uGzeVqk5j+2+saL143vl?= =?us-ascii?Q?zct63TLzCDmGVyFRvGeCYHwLPlG8r8QzfP6tl1G/l24l0IJvSV69gfJ8Iet8?= =?us-ascii?Q?IoOa/MTlD6bzyYx+ae9AfNnbrIW77K0/LJwAg+S+JNx5mWH5IaRbE+AkgUwy?= =?us-ascii?Q?KCT8eppaMgVRXbbRFFOEsF7j1J0W24ch4QNSn4ufouTI5UtTURB+NnWTqyXj?= =?us-ascii?Q?cVcW6a5FqQsJxYsfoIg4p1oglJ69b3I6pUpePkh/iNmZzR5NGkb9zawXsOG0?= =?us-ascii?Q?p1Flcco9waXTSWCLPXQbYqa5Ah0OcFaRyVUqHf2CFYzsmp0wN5PNYyrK/wN7?= =?us-ascii?Q?Ze8bg6LcYjIR0f/1P7JjPKubm8mlKpgwBc9AnJ8g2TovmZk3BpQk+YM/BCqX?= =?us-ascii?Q?mzmDvSwoFcGjBQRt8d6+UlQmtqSfNYn/7BxTRyLn?= X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: qUM5mT/RzsXmIoNChnlKHrt8qkhsMGHTW88fGgbPkNvso9jQpYb73cNJbSRgdt/bWcVMGVQqrKfAwj7tHI9xGgSUiZenEAJ5d8E454jzJwjafR0qY+MBnyLDcf6zOkGm+tBZkMKFOWmofItrC53HzGII5PRcZZidF7apFs5GJqDHFA6CoW3VVKzxnTAHEDkpnVGD0la8ZRb9faX9YjdQk3MIHvucfaIgq36sRPaPLWsmOfSN3g3jg7aQw3ZalnTdUqdApuXvrZdKxM5KitUmRc4urHcasZB8orkNt0HyKQ7xdSpfWUtu7nNwfbDBlli+4Qw8GCrglgn9D8U1Gt9VDahJkVfEBbZu6o3mgn4paEOTRKehO5nzixKobjsPQI0LVD1a0AfmXixiQKRjrHtdvQ2Y4fGMl9kjnN7gyL9x9P/nx8pg4urmSg7+fMkdL/jb3WfNFh2QqcUQoi7f6kSUQDEfzNCCGC9LAVVCbGNfkGwQh7WOej/SjhqetZiX+j8VvAX0a98MIambwsyQsV9YWNK5u/gBOqExQAkOlaDc/ErrvtEKd7d2DOsoEFNX4oEb7Cda3gfKrGC4PXYstKs1aQuUMrICp3Gzp8DfJogkB64= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: ce56369d-6b5a-40c6-d61f-08ddc7e71894 X-MS-Exchange-CrossTenant-AuthSource: CH3PR10MB7329.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Jul 2025 23:42:32.3540 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: YzVrOTVpOIEQIulMxXXGzL9a1FFM/mJjBzO/6+NOoVmMM6S4t+pKOpMF6xn61nGWEH/vF67P6qI4y872gWIQUA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR10MB6395 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1099,Hydra:6.1.9,FMLib:17.12.80.40 definitions=2025-07-20_02,2025-07-17_02,2025-03-28_01 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 phishscore=0 bulkscore=0 mlxscore=0 suspectscore=0 malwarescore=0 spamscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2505160000 definitions=main-2507200228 X-Proofpoint-Spam-Details-Enc: AW1haW4tMjUwNzIwMDIyOCBTYWx0ZWRfXxpvbnvGGZDiY z6iniss32SfgVZYdSb17I7oSzlklBgBcRcg725vmbkHOXp/iMat06Rnq0A3JLL6wjGwkfi0akd3 EH/3h/DKTEYZZH0x/Q+e80whM1fgFbDANZ7s5ZyQQuZShHI9LMMe3qoVIsN5hX2Yqwr4nxqVCYA xoCUw23TznzIBv8+JRJR6j3hNemSaK9V0DU8osGannoU+xkIAkq02C81+4ba3+ZXpIiX28s7xNA SAmqQr1hm8pO986LsH2KZUDH5p/3Jg7H9i2GT2Udh3K/sUXHN8WXnQby9qmQhE1xJ05dQk/tDUa d4x36Bx/xHwZRVKrR6n3rLu7mMBola9GCCYGVJs7TS2mepnYeowydqrYyQUT4nQ9FPvh+t7UQgk lK0Z5G3784wtpHF3jn+kLMHJ4Y95hz7PwSOuLnitSnGa4jHmZeb0C3nN6qdnediJ1Zvm3phn X-Authority-Analysis: v=2.4 cv=doDbC0g4 c=1 sm=1 tr=0 ts=687d7eec b=1 cx=c_pps a=e1sVV491RgrpLwSTMOnk8w==:117 a=e1sVV491RgrpLwSTMOnk8w==:17 a=6eWqkTHjU83fiwn7nKZWdM+Sl24=:19 a=lCpzRmAYbLLaTzLvsPZ7Mbvzbb8=:19 a=wKuvFiaSGQ0qltdbU6+NXLB8nM8=:19 a=Ol13hO9ccFRV9qXi2t6ftBPywas=:19 a=xqWC_Br6kY4A:10 a=Wb1JkmetP80A:10 a=GoEa3M9JfhUA:10 a=VwQbUJbxAAAA:8 a=QyXUC8HyAAAA:8 a=yPCof4ZbAAAA:8 a=X7OBBLe7zzONDxeIk40A:9 cc=ntf awl=host:13600 X-Proofpoint-GUID: C1gHAjwVn_PArpfg3A1FBSWnZnvq3IIJ X-Proofpoint-ORIG-GUID: C1gHAjwVn_PArpfg3A1FBSWnZnvq3IIJ Content-Type: text/plain; charset="utf-8" Introduce and use {pgd,p4d}_populate_kernel() in core MM code when populating PGD and P4D entries for the kernel address space. These helpers ensure proper synchronization of page tables when updating the kernel portion of top-level page tables. Until now, the kernel has relied on each architecture to handle synchronization of top-level page tables in an ad-hoc manner. For example, see commit 9b861528a801 ("x86-64, mem: Update all PGDs for direct mapping and vmemmap mapping changes"). However, this approach has proven fragile for following reasons: 1) It is easy to forget to perform the necessary page table synchronization when introducing new changes. For instance, commit 4917f55b4ef9 ("mm/sparse-vmemmap: improve memory savings for compound devmaps") overlooked the need to synchronize page tables for the vmemmap area. 2) It is also easy to overlook that the vmemmap and direct mapping areas must not be accessed before explicit page table synchronization. For example, commit 8d400913c231 ("x86/vmemmap: handle unpopulated sub-pmd ranges")) caused crashes by accessing the vmemmap area before calling sync_global_pgds(). To address this, as suggested by Dave Hansen, introduce _kernel() variants of the page table population helpers, which invoke architecture-specific hooks to properly synchronize page tables. They reuse existing infrastructure for vmalloc and ioremap. Synchronization requirements are determined by ARCH_PAGE_TABLE_SYNC_MASK, and the actual synchronization is performed by arch_sync_kernel_mappings(). This change currently targets only x86_64, so only PGD and P4D level helpers are introduced. In theory, PUD and PMD level helpers can be added later if needed by other architectures. Currently this is a no-op, since no architecture sets PGTBL_{PGD,P4D}_MODIFIED in ARCH_PAGE_TABLE_SYNC_MASK. Cc: stable@vger.kernel.org Suggested-by: Dave Hansen Signed-off-by: Harry Yoo --- include/asm-generic/pgalloc.h | 18 ++++++++++++++++-- mm/kasan/init.c | 10 +++++----- mm/percpu.c | 4 ++-- mm/sparse-vmemmap.c | 4 ++-- 4 files changed, 25 insertions(+), 11 deletions(-) diff --git a/include/asm-generic/pgalloc.h b/include/asm-generic/pgalloc.h index 7ff5d7ca4cd6..c05fea06b3fd 100644 --- a/include/asm-generic/pgalloc.h +++ b/include/asm-generic/pgalloc.h @@ -298,8 +298,8 @@ static inline void pgd_free(struct mm_struct *mm, pgd_t= *pgd) =20 /* * Architectures can set this mask to a combination of PGTBL_P?D_MODIFIED = values - * and let generic vmalloc and ioremap code know when arch_sync_kernel_map= pings() - * needs to be called. + * and let generic vmalloc, ioremap and page table update code know when + * arch_sync_kernel_mappings() needs to be called. */ #ifndef ARCH_PAGE_TABLE_SYNC_MASK #define ARCH_PAGE_TABLE_SYNC_MASK 0 @@ -312,6 +312,20 @@ static inline void pgd_free(struct mm_struct *mm, pgd_= t *pgd) */ void arch_sync_kernel_mappings(unsigned long start, unsigned long end); =20 +#define pgd_populate_kernel(addr, pgd, p4d) \ +do { \ + pgd_populate(&init_mm, pgd, p4d); \ + if (ARCH_PAGE_TABLE_SYNC_MASK & PGTBL_PGD_MODIFIED) \ + arch_sync_kernel_mappings(addr, addr); \ +} while (0) + +#define p4d_populate_kernel(addr, p4d, pud) \ +do { \ + p4d_populate(&init_mm, p4d, pud); \ + if (ARCH_PAGE_TABLE_SYNC_MASK & PGTBL_P4D_MODIFIED) \ + arch_sync_kernel_mappings(addr, addr); \ +} while (0) + #endif /* CONFIG_MMU */ =20 #endif /* __ASM_GENERIC_PGALLOC_H */ diff --git a/mm/kasan/init.c b/mm/kasan/init.c index ced6b29fcf76..43de820ee282 100644 --- a/mm/kasan/init.c +++ b/mm/kasan/init.c @@ -191,7 +191,7 @@ static int __ref zero_p4d_populate(pgd_t *pgd, unsigned= long addr, pud_t *pud; pmd_t *pmd; =20 - p4d_populate(&init_mm, p4d, + p4d_populate_kernel(addr, p4d, lm_alias(kasan_early_shadow_pud)); pud =3D pud_offset(p4d, addr); pud_populate(&init_mm, pud, @@ -212,7 +212,7 @@ static int __ref zero_p4d_populate(pgd_t *pgd, unsigned= long addr, } else { p =3D early_alloc(PAGE_SIZE, NUMA_NO_NODE); pud_init(p); - p4d_populate(&init_mm, p4d, p); + p4d_populate_kernel(addr, p4d, p); } } zero_pud_populate(p4d, addr, next); @@ -251,10 +251,10 @@ int __ref kasan_populate_early_shadow(const void *sha= dow_start, * puds,pmds, so pgd_populate(), pud_populate() * is noops. */ - pgd_populate(&init_mm, pgd, + pgd_populate_kernel(addr, pgd, lm_alias(kasan_early_shadow_p4d)); p4d =3D p4d_offset(pgd, addr); - p4d_populate(&init_mm, p4d, + p4d_populate_kernel(addr, p4d, lm_alias(kasan_early_shadow_pud)); pud =3D pud_offset(p4d, addr); pud_populate(&init_mm, pud, @@ -273,7 +273,7 @@ int __ref kasan_populate_early_shadow(const void *shado= w_start, if (!p) return -ENOMEM; } else { - pgd_populate(&init_mm, pgd, + pgd_populate_kernel(addr, pgd, early_alloc(PAGE_SIZE, NUMA_NO_NODE)); } } diff --git a/mm/percpu.c b/mm/percpu.c index 782cc148b39c..57450a03c432 100644 --- a/mm/percpu.c +++ b/mm/percpu.c @@ -3134,13 +3134,13 @@ void __init __weak pcpu_populate_pte(unsigned long = addr) =20 if (pgd_none(*pgd)) { p4d =3D memblock_alloc_or_panic(P4D_TABLE_SIZE, P4D_TABLE_SIZE); - pgd_populate(&init_mm, pgd, p4d); + pgd_populate_kernel(addr, pgd, p4d); } =20 p4d =3D p4d_offset(pgd, addr); if (p4d_none(*p4d)) { pud =3D memblock_alloc_or_panic(PUD_TABLE_SIZE, PUD_TABLE_SIZE); - p4d_populate(&init_mm, p4d, pud); + p4d_populate_kernel(addr, p4d, pud); } =20 pud =3D pud_offset(p4d, addr); diff --git a/mm/sparse-vmemmap.c b/mm/sparse-vmemmap.c index fd2ab5118e13..e275310ac708 100644 --- a/mm/sparse-vmemmap.c +++ b/mm/sparse-vmemmap.c @@ -229,7 +229,7 @@ p4d_t * __meminit vmemmap_p4d_populate(pgd_t *pgd, unsi= gned long addr, int node) if (!p) return NULL; pud_init(p); - p4d_populate(&init_mm, p4d, p); + p4d_populate_kernel(addr, p4d, p); } return p4d; } @@ -241,7 +241,7 @@ pgd_t * __meminit vmemmap_pgd_populate(unsigned long ad= dr, int node) void *p =3D vmemmap_alloc_block_zero(PAGE_SIZE, node); if (!p) return NULL; - pgd_populate(&init_mm, pgd, p); + pgd_populate_kernel(addr, pgd, p); } return pgd; } --=20 2.43.0 From nobody Mon Oct 6 13:20:34 2025 Received: from mx0b-00069f02.pphosted.com (mx0b-00069f02.pphosted.com [205.220.177.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id DE4E6238C3C; Sun, 20 Jul 2025 23:43:33 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=205.220.177.32 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753055015; cv=fail; b=DpFK4aTjBZrnexjgc4LwWG8NvVWNTv+Ge1VjPe5vy1ZtUP1IRfe4Pdr60TfwZv2Lv7nFzVtEyUG7PbnWTBxNli/ajFg44VNbFLj6S0d6b+XZLHJce/e2DG4FENo6AmRpl84PYI14BttLdZOlZtxgH8aXB+6ZwDx067pNFk8xNW0= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753055015; c=relaxed/simple; bh=lz0txypQt/YLDGgSOG+falVvqkhqb/wyF3l3xLNCfIs=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: Content-Type:MIME-Version; b=AtZ8V/KeNlFX+vbLfW3diSSUJgQ0XcRsszxv8qYrY9EWiF+kq0oA7XxTScof1WCUNLGYEgHk60GvcCO68JasfJVzNulmJ+ENHi+bsWJb7Bl8TZ1zPrk34Bwy5Oqx6gT5nOznnW9+ANqfn+mOmhJxuMqdzAtta74KiYuG6QFUYQQ= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oracle.com; spf=pass smtp.mailfrom=oracle.com; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b=ZIt5QI5h; dkim=pass (1024-bit key) header.d=oracle.onmicrosoft.com header.i=@oracle.onmicrosoft.com header.b=k4r5wVxf; arc=fail smtp.client-ip=205.220.177.32 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oracle.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=oracle.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b="ZIt5QI5h"; dkim=pass (1024-bit key) header.d=oracle.onmicrosoft.com header.i=@oracle.onmicrosoft.com header.b="k4r5wVxf" Received: from pps.filterd (m0246632.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 56KLj1qe008439; Sun, 20 Jul 2025 23:42:39 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=cc :content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s= corp-2025-04-25; bh=B++X+Q87NBbosVzBiUi/YmCdtCaUsRbGAI3TSckmfAg=; b= ZIt5QI5hDbsgCRGczgzWTox5NDV/2wQhqLkE9Cn6ZkPeyS2b4o+f7svtnJJUP6za WR288SiBmaL3uwPJ2w9VhvRrwx0DQkcQVgx3g2FOT2fHAMB7cbsO0z7mKUOFwE/S IWEI8uqys66lq4b9uSBUu86kgt3ew23pGu3LPKo88/JaMJ1VteFTl+SIpiKW7qZm cxg1dKNgYdKL4UdXAOKVf4tKjiCUpP1RTyM6TKrGcx1gCXZPn8B0jyIKs8Kp2iMu AmPTNOD72ubKBTkT4fVoVte5Kd26uLBNTLt/Zg7/r9iNto0M0PAmhgCJEL5SV9kK Yu6PHfiA+5ooOwkWg2lT6w== Received: from iadpaimrmta03.imrmtpd1.prodappiadaev1.oraclevcn.com (iadpaimrmta03.appoci.oracle.com [130.35.103.27]) by mx0b-00069f02.pphosted.com (PPS) with ESMTPS id 4805e29hnw-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 20 Jul 2025 23:42:39 +0000 (GMT) Received: from pps.filterd (iadpaimrmta03.imrmtpd1.prodappiadaev1.oraclevcn.com [127.0.0.1]) by iadpaimrmta03.imrmtpd1.prodappiadaev1.oraclevcn.com (8.18.1.2/8.18.1.2) with ESMTP id 56KNUGWu038352; Sun, 20 Jul 2025 23:42:38 GMT Received: from nam02-sn1-obe.outbound.protection.outlook.com (mail-sn1nam02on2040.outbound.protection.outlook.com [40.107.96.40]) by iadpaimrmta03.imrmtpd1.prodappiadaev1.oraclevcn.com (PPS) with ESMTPS id 4801t7e8h5-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 20 Jul 2025 23:42:38 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=DHcpgArihNiOTG2m44XZ9fBM77uK+p9yirlx7yVNAf2i2muJ3Ovov63UuoWCHXEmUIbV718yucJQpkFqLI+cfOMbJ8OWgJ3fFc5e2iCYXUc18Si02yL5/qpEQgHgezdME/0wO6mWybgopnddpzA7rwrRwthsZoUXT1/XtdQoUMJi0TTzrlCyggT/nF2gVInbqmnVAz5MGFWe/Q2tuaqB1JnRLlSechF4LoyXZ5ve7SOQXfhRXiNdpVFkMJp6fxCHwBHtiJTLPnktDfpaK3ycumcvIJ1UIOM+TPR//RlZBmd5zuwlgojImWtIwoLbqBWU52dwIlK9wQirbGbV/3ApGQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=B++X+Q87NBbosVzBiUi/YmCdtCaUsRbGAI3TSckmfAg=; b=iFH5pGog/zdeGQunE6IxSRzkfiXz1Fz1b7/A/xif7nyvSC/v5Jlr+s/26omIncdDlzCLWU/ZAjc8xst20qNzyo6jT5zm2dFJ/0uzfINaa+yxQrmJ5V+yR8QdiHZ0+B3BcqS1imRcyTDGeXHBPaqAoQtzZ26gYDQGiqa6Bjz7P8bY4cp5HvRFLz2On93JrmF/ixoeJ4NNjm4eTHAZa4hXy+Rerdk/2t/xtzIOOyVgbPryaYyAbx5a2IU5/AJyW9+5O5VVy9BE3CRBz16RLDETBq7nTKiO30x6pomlMgY88L6NKfZKBJ3woRtMw37CjTL0w7M+WWGdB3NVRrxJPauzPQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=B++X+Q87NBbosVzBiUi/YmCdtCaUsRbGAI3TSckmfAg=; b=k4r5wVxfHpeh3gOVOHthl1qpJOWCbW7y0bhCj78CKdz3gnE8r/rjIazK/0UMPgHWRS1ID5yCFv+7AAO7QHixXTXHCOiWpFHZLCdBuirBRgFcVDyLEdLRmhVBMdnP4Who7ppgaDfsgOSVpJlnIPiwds6Vsesoz2qhibmOjxFn1DM= Received: from CH3PR10MB7329.namprd10.prod.outlook.com (2603:10b6:610:12c::16) by MW4PR10MB6395.namprd10.prod.outlook.com (2603:10b6:303:1ea::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8943.29; Sun, 20 Jul 2025 23:42:35 +0000 Received: from CH3PR10MB7329.namprd10.prod.outlook.com ([fe80::c2a4:fdda:f0c2:6f71]) by CH3PR10MB7329.namprd10.prod.outlook.com ([fe80::c2a4:fdda:f0c2:6f71%4]) with mapi id 15.20.8943.028; Sun, 20 Jul 2025 23:42:35 +0000 From: Harry Yoo To: Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , Andy Lutomirski , Peter Zijlstra , Andrey Ryabinin , Arnd Bergmann , Andrew Morton , Dennis Zhou , Tejun Heo , Christoph Lameter Cc: "H . Peter Anvin" , Alexander Potapenko , Andrey Konovalov , Dmitry Vyukov , Vincenzo Frascino , Juergen Gross , Kevin Brodsky , Muchun Song , Oscar Salvador , Joao Martins , Lorenzo Stoakes , Jane Chu , Alistair Popple , Mike Rapoport , David Hildenbrand , Gwan-gyeong Mun , "Aneesh Kumar K . V" , x86@kernel.org, linux-kernel@vger.kernel.org, linux-arch@vger.kernel.org, linux-mm@kvack.org, Harry Yoo , stable@vger.kernel.org Subject: [PATCH v2 mm-hotfixes 3/5] x86/mm: define ARCH_PAGE_TABLE_SYNC_MASK and arch_sync_kernel_mappings() Date: Mon, 21 Jul 2025 08:42:01 +0900 Message-ID: <20250720234203.9126-4-harry.yoo@oracle.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20250720234203.9126-1-harry.yoo@oracle.com> References: <20250720234203.9126-1-harry.yoo@oracle.com> Content-Transfer-Encoding: quoted-printable X-ClientProxiedBy: SE2P216CA0125.KORP216.PROD.OUTLOOK.COM (2603:1096:101:2c7::17) To CH3PR10MB7329.namprd10.prod.outlook.com (2603:10b6:610:12c::16) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH3PR10MB7329:EE_|MW4PR10MB6395:EE_ X-MS-Office365-Filtering-Correlation-Id: e5aee08b-05b5-45c9-027f-08ddc7e71a6f X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|376014|7416014|366016|921020; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?AAWv/1ChBhH65ddXFCUlf5fCrv3WCBeR/6B6bLBo85ztzOwMk6gUE7cbDZoS?= =?us-ascii?Q?mRSJbs6UdHI86ii4yfguhuqLOu9O6QBHBP+2y8a0AQwi9TBlJKnqez55C/Ma?= =?us-ascii?Q?6t97/zhMtLcr8dpZGj3vKE2vczY2YI7kTl6jJHb5uJe4jj2i6kcl++MkqbHs?= =?us-ascii?Q?orseWz5gs/hnlv2j2N9aAghf6hVJgpOFGTJm6ebvpvnMmIFCZrtX4AtFwS4e?= =?us-ascii?Q?SpMcFvwML73nGSJHqarnAeZDkzFfCtIWOGfPPXpcWWIIZ/fkgBrnayaSztgt?= =?us-ascii?Q?fcbzewTsb1vxgzVA3PQLxYaYhlE47KNpeBZZDsa5A1kMaP9ydYdc+SKpTOzC?= =?us-ascii?Q?+uSBbIOusM6QlPrRmNT4Np+sTsWKJY8ulekJF3XjHHUzqehLtaRpGQ/wIWhx?= =?us-ascii?Q?WnigluLbEyvsVwTtNLYO0FIYxeLkztxXAXIbpMiNtmuzpmieeU4xyMtB+5Jk?= =?us-ascii?Q?ZpYHOxjZ3djnby35gd1kei6cTi/D42XmilCHUNem9Ar7ypWBxHmchZtXvyix?= =?us-ascii?Q?9MswjW32ChnmVmSDAXjQWVJOe+760coHHvRFq9GPrX6zKLRo/085b/TTBu4r?= =?us-ascii?Q?tAO3TmrpkUC27cgBkUYAcXOM40utEo7ZqTNI6pCJr4S66DZZaT6CxP0YVAyD?= =?us-ascii?Q?C0eDdw77tdFRPzwnmup8576pb0llUJhvgzqFHlLxPO6TfrzvuNb2bdthvMqY?= =?us-ascii?Q?GqZzFhGfe9fcEL1JiYh2+msbeH4sMNKwYrahpdzsQmzfxrhNKifu+bRzbfSr?= =?us-ascii?Q?s7CvCIgmeCfAFS25OqwpIaeILXVYyYw8R6mV5hJhizfaS3/XhNPChfuldaSM?= =?us-ascii?Q?wx4BJhZpws+Gxr5jU7MVlU7w8fY5ie9L0SqjD8UALvapP+FyPHDgEDB8uE6f?= =?us-ascii?Q?0uTgINpLAf5jWTypTBgsoLVEu8PfTM+TI+AGPDoKscYhHWOuN3UsqH2lEYF9?= =?us-ascii?Q?E43OKAb+IdYvCc2xlvMPlcTGzfuxaS09Gt1vGBkWtmJIsqnRyNA9qiRVntWB?= =?us-ascii?Q?rXSbC45Eo0fmCOby0oJ1x01YW5Fc/pVB1K7Q3RN5VfDNswcHslWqr3Zlhwqr?= =?us-ascii?Q?FVHZ/Rso0PnDfCl9/KE9HUC+Vl30u/Erwz0Mq8FMBTNIbnG9uKbryKYuEnaP?= =?us-ascii?Q?ec02nF0OAowbpgMCeXY2c55liYk4AXR+pWb7XdbTSOR0HP910F86NHHMUvQ/?= =?us-ascii?Q?z22qpjPvN/4ToqJtEAyt7KcZ1Kg1uDmaWWYEwFDQh34Fki3NlRgCDMbam7D5?= =?us-ascii?Q?hc+RfLoOasIhiNZ7LRloqlKM0brPrj/T7L8UyfMg9VTleHQGK/GP0Y8za/cj?= =?us-ascii?Q?4+UPIcOV10mpPALTaxsOLQvqmFs1sXUOWPgpMrM1J9ct8Uf/J+TaGUlLPa3E?= =?us-ascii?Q?nfQYIS96q5XMZswdzwvZt7cFjdVDn5UhSOEWzVLMqdVCJg7cj2s4wyTeAZCK?= =?us-ascii?Q?1yRHoZPMA4Mnw+m2A1ExFl24NbD9Ws55mt5XJH9HcVR+nqxRl1aMEQ=3D=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CH3PR10MB7329.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(376014)(7416014)(366016)(921020);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?LKx2HP6df/TP+Hu2YFGOkSK7awb2yEk18dPQYCupl1M2bJ0CRRiVxMyZC2TA?= =?us-ascii?Q?zXAUThFSu363F4ktKYDlozj4hGLQXmXySol0dx9QB+9k4PAUBYUpNSFCicAL?= =?us-ascii?Q?ti6SBYGBAnGUuaXqhj1lQNtB2A+u0x/97Nr42mrxhO5OUPPcA/v+DxxUomhf?= =?us-ascii?Q?oIIq3IgZCpdeKusDhR/QXyeshXEgnc+bPjzs1sv+SuCVVjA8ZbHj5Gi+jExi?= =?us-ascii?Q?dnrws6sCCsr2RvOsWTAAiv8ixeIGKaFVPTARVcQx4Z6w5tpVany4jY2y21KN?= =?us-ascii?Q?+0D4tfTurqKHnU/WiUweC/ansaXSFMSXqq28pxmzp1QX28887zlpsExR7wEw?= =?us-ascii?Q?9qHXHYc5tMxTKlE7dgNbolttMdbObGRnHhhAHSzxx+KxFTUDNu1GcSdfixLO?= =?us-ascii?Q?hamjFrfvREFj8C6GX4jmWUufLUtXaz8fn4yDN4BmUQ9oy4DOigHcU+wXhAUC?= =?us-ascii?Q?dl/UJy2GjJwU9bCLHkumi4weXwfXnRUgs51WckNiP9fe91kc8BjHaeFKbM/F?= =?us-ascii?Q?K/8cPpPCdxAZTbJDEkx42DveddOHwrjCI4cWkyv9ww/SzV4fdjw3QToEHK8g?= =?us-ascii?Q?RvTmFE6eDHRhB2SwAZkrjzJ6eTj/Fc4tmjB7JGSItoOuTLvvIm/GItjB/dD2?= =?us-ascii?Q?RA6E0puONv0NZf0d+Sx+VxZpTL6LCiCeE8QRkF4ni6mg9naxaDy5dI8skKnC?= =?us-ascii?Q?QSzGaAHpq8SLZgBgjIgIjMyWiCd3mxMo/hvJU5O7HRjszWdVtvAzzFO8RndU?= =?us-ascii?Q?DbdpzaFJayRCHyZKf8H/AqKbX0p37SicT8IMnHqYDzVY1LQdF82RvAqOG5Vr?= =?us-ascii?Q?VB/Igxf73DQQE5iGDsjRfYp4949vxKpkvQHX+98siXRy+eT4Gpce9CKafytY?= =?us-ascii?Q?ydX7uTq+h3P1ldkalxZ+KNql6Glnq+uWMDJQffUZoCz52ul3DNXOvkluRaYz?= =?us-ascii?Q?9mzurpYnVS65Z2h6f4Kop8EPodwh2Zj5k+C7lyaGbS9+2dOvQh4TPEwBaZxR?= =?us-ascii?Q?FNuVF6Ny4712WgsfCsKpUOXCYi3rEKppt6+aN7KZ9mxmVuFar0fF1vvEim7Q?= =?us-ascii?Q?ePANNpNhZaJllTXKQ0uAMvmJqgHQvskhwTZTnrj0EIFSaCKdKAEegnfpnw0q?= =?us-ascii?Q?5fyV9LkPCXab9Ve513DanE9IyIlohrYaeOhjbXIyhcFYBYIQbNBLAbn4UjEO?= =?us-ascii?Q?l0fqvAQWT9vT+2OICEfiwEOerpl0kre7sUsDhDbblW5oQT6CxEGeKHlRBAGW?= =?us-ascii?Q?Dn5uRP0SM0PSvKuZ8HNHGqnBV8Uzaor0zs5WdYl5ouJNd7PTuhvgXCkTNq4F?= =?us-ascii?Q?RiqL6PmQobqqVjP+KnmhDY6nCrVunh7luvV0s62DkyhIHKCd8mfJ25zUoRIl?= =?us-ascii?Q?GGpFCdxo+yO+hGATzsD+Pz0CN/OQqZg6jN5yTZ4xtBfYUzZFUWC0xL5W5o33?= =?us-ascii?Q?HK3+otd4fFd/9LrAD17fhgtXsk2YqMp1wl6I1nqb9QB21gebbvJw5mXQpOlY?= =?us-ascii?Q?e7TjllqgSywheWGjC95vuc2dOrYncdJCIVKViqDYPOY/cDDcdxWWovEg3QN+?= =?us-ascii?Q?lzj69+ok5kAjd5r7Prg/YuulV61DWfbMw6e8TvYa?= X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: aCAAhHbwOHOiSGD7Bnk5E7dYtLhUhLEzKOW0lCl7mPRqc2A/zsWCLeK+YhD2Xla7X3uNICBkbZM6LlM60Yebo5wz05PsmjOEU8ZIMv+I84lHNxvmQfsvC91yR4Rx7IyirsKJeT6/mQ4yTux3WcQajx3uiWulRiYCn2slj57RdWGRh1WEznlaYYV/pmUnxKo7MGnhsC9Ul31UX0fdqxcpjyG6+Hcj9Z9Oihpfrp7i0PvS6FCcjcPFNdeYgUIkDwOiLQIfREYzU2HcA3R57x11IuOILdSlcH9ZA1y1JtZipsI3EFCM2buF65WDExQ9LIKpEHRtYnIZvE0fSYUEvRcwsl2jXl+tBkbyMW/anZh/qWGi52EWhRB8GXrJPW/JHDRI5fivNk0qhw/thG2+zIkXM/aTO1HHoanqdZmni/THIFN1L+qBO30GWZiCRFXibFUEXLtBUDNtsh7ZG/OXavTVLfXvqdOVgp0vRaHWiuKfAOoiCMv5qKVhKrXfcdC+G154lJP3qzy/EkwbnHAVV5zzWe7x0ADge8xtGBdLbjh2FeBAXWe25FF7vWTuMQoIALTucyTJRnRos0bMitnUxvIAJegkdqEy/tO5FMp8+XQqlOE= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: e5aee08b-05b5-45c9-027f-08ddc7e71a6f X-MS-Exchange-CrossTenant-AuthSource: CH3PR10MB7329.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Jul 2025 23:42:35.3140 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 9Pd0XHYzqKg2XM/m8mz+rRGaKMQpSWDWXHpizOwMUgURjUrboRAq1dQRGzxBps69iy223RQjaxQLKvWlJd7e8Q== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR10MB6395 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1099,Hydra:6.1.9,FMLib:17.12.80.40 definitions=2025-07-20_02,2025-07-17_02,2025-03-28_01 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 phishscore=0 mlxscore=0 suspectscore=0 bulkscore=0 malwarescore=0 adultscore=0 spamscore=0 mlxlogscore=999 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2505160000 definitions=main-2507200228 X-Authority-Analysis: v=2.4 cv=WaYMa1hX c=1 sm=1 tr=0 ts=687d7eef b=1 cx=c_pps a=qoll8+KPOyaMroiJ2sR5sw==:117 a=qoll8+KPOyaMroiJ2sR5sw==:17 a=6eWqkTHjU83fiwn7nKZWdM+Sl24=:19 a=lCpzRmAYbLLaTzLvsPZ7Mbvzbb8=:19 a=wKuvFiaSGQ0qltdbU6+NXLB8nM8=:19 a=Ol13hO9ccFRV9qXi2t6ftBPywas=:19 a=xqWC_Br6kY4A:10 a=Wb1JkmetP80A:10 a=GoEa3M9JfhUA:10 a=VwQbUJbxAAAA:8 a=QyXUC8HyAAAA:8 a=yPCof4ZbAAAA:8 a=andX2sbcIq9QJGdYwqsA:9 cc=ntf awl=host:12062 X-Proofpoint-GUID: Z26ixhOI4rVKv99SdenxZ5rL3hpvYRwr X-Proofpoint-Spam-Details-Enc: AW1haW4tMjUwNzIwMDIyOCBTYWx0ZWRfXzi2Z2ZSUzCem OjRiYlT/7IRpYFVoB9B1K6ZeLUwei215++8P+dKCVbkvxJkELqNwBzQUxgKv3HMj85X+xj7DHKZ 6QMr9AGIsZY8uyfy3nVm6uyX5vxZYo4CEAaR4zLKICLtMBNCgG2jeMhTiBLnXFlpsb++PNVBGIX IE6RkiDuW122onO2rakN/XxRVNGexrsrHPBZEyRurBgpgdNGLBv9EJLuyLQTzOUovr3srkUVvvW L9/PixFx8BI9yDxlJBSmnHyvMxn/2CMnlWai7r5cRSzlDz7wS0RR6ctdinW+g/HMZJHhuR0G1ex W+lbcpAPLjnOiT15qxKL/X3YV8lZzHHB88fntxbXqpuEAX7ncQoCwR6avYxlmcbsk1yZiJbEyCo OJ5FQoyB0+dhBEMvg7NKBLN9MbWVYcQFw+8mLFUbeVUgtRe0g69QHqZEZnB4vDFSM1CSyJNY X-Proofpoint-ORIG-GUID: Z26ixhOI4rVKv99SdenxZ5rL3hpvYRwr Content-Type: text/plain; charset="utf-8" Define ARCH_PAGE_TABLE_SYNC_MASK and arch_sync_kernel_mappings() to ensure page tables are properly synchronized when calling p*d_populate_kernel(). It is inteneded to synchronize page tables via pgd_pouplate_kernel() when 5-level paging is in use and via p4d_pouplate_kernel() when 4-level paging is used. This fixes intermittent boot failures on systems using 4-level paging and a large amount of persistent memory: BUG: unable to handle page fault for address: ffffe70000000034 #PF: supervisor write access in kernel mode #PF: error_code(0x0002) - not-present page PGD 0 P4D 0 Oops: 0002 [#1] SMP NOPTI RIP: 0010:__init_single_page+0x9/0x6d Call Trace: __init_zone_device_page+0x17/0x5d memmap_init_zone_device+0x154/0x1bb pagemap_range+0x2e0/0x40f memremap_pages+0x10b/0x2f0 devm_memremap_pages+0x1e/0x60 dev_dax_probe+0xce/0x2ec [device_dax] dax_bus_probe+0x6d/0xc9 [... snip ...] It also fixes a crash in vmemmap_set_pmd() caused by accessing vmemmap before sync_global_pgds() [1]: BUG: unable to handle page fault for address: ffffeb3ff1200000 #PF: supervisor write access in kernel mode #PF: error_code(0x0002) - not-present page PGD 0 P4D 0 Oops: Oops: 0002 [#1] PREEMPT SMP NOPTI Tainted: [W]=3DWARN RIP: 0010:vmemmap_set_pmd+0xff/0x230 vmemmap_populate_hugepages+0x176/0x180 vmemmap_populate+0x34/0x80 __populate_section_memmap+0x41/0x90 sparse_add_section+0x121/0x3e0 __add_pages+0xba/0x150 add_pages+0x1d/0x70 memremap_pages+0x3dc/0x810 devm_memremap_pages+0x1c/0x60 xe_devm_add+0x8b/0x100 [xe] xe_tile_init_noalloc+0x6a/0x70 [xe] xe_device_probe+0x48c/0x740 [xe] [... snip ...] Cc: stable@vger.kernel.org Fixes: 8d400913c231 ("x86/vmemmap: handle unpopulated sub-pmd ranges") Closes: https://lore.kernel.org/linux-mm/20250311114420.240341-1-gwan-gyeon= g.mun@intel.com [1] Suggested-by: Dave Hansen Signed-off-by: Harry Yoo --- arch/x86/include/asm/pgalloc.h | 2 ++ arch/x86/mm/init_64.c | 5 +++++ 2 files changed, 7 insertions(+) diff --git a/arch/x86/include/asm/pgalloc.h b/arch/x86/include/asm/pgalloc.h index c88691b15f3c..ead834e8141a 100644 --- a/arch/x86/include/asm/pgalloc.h +++ b/arch/x86/include/asm/pgalloc.h @@ -10,6 +10,8 @@ =20 #define __HAVE_ARCH_PTE_ALLOC_ONE #define __HAVE_ARCH_PGD_FREE +#define ARCH_PAGE_TABLE_SYNC_MASK \ + (pgtable_l5_enabled() ? PGTBL_PGD_MODIFIED : PGTBL_P4D_MODIFIED) #include =20 static inline int __paravirt_pgd_alloc(struct mm_struct *mm) { return 0; } diff --git a/arch/x86/mm/init_64.c b/arch/x86/mm/init_64.c index fdb6cab524f0..3800479022e4 100644 --- a/arch/x86/mm/init_64.c +++ b/arch/x86/mm/init_64.c @@ -223,6 +223,11 @@ static void sync_global_pgds(unsigned long start, unsi= gned long end) sync_global_pgds_l4(start, end); } =20 +void arch_sync_kernel_mappings(unsigned long start, unsigned long end) +{ + sync_global_pgds(start, end); +} + /* * NOTE: This function is marked __ref because it calls __init function * (alloc_bootmem_pages). It's safe to do it ONLY when after_bootmem =3D= =3D 0. --=20 2.43.0 From nobody Mon Oct 6 13:20:34 2025 Received: from mx0b-00069f02.pphosted.com (mx0b-00069f02.pphosted.com [205.220.177.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id BADE3230BEB; Sun, 20 Jul 2025 23:43:28 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=205.220.177.32 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753055010; cv=fail; b=JSYxPomfKRYuStDiU5QFyy5nTcbtGpUgKHjf+Yk//5lPhKgJu41iXEdwBmpVY9bKWG3/fzeTb/iMY3u+5uogb6rD/Q8czx3oWauCaeAA2xQHTziPqU3O96ykl38EZKPFg7ejBZ2VDlPKIjjhPdv9VSGHZz2YjDAF2zZWvXNYRl0= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753055010; c=relaxed/simple; bh=v9FT/DCEOxqxIpQQxAy+Pnycoe4l/AwIzmUzL8tiPSQ=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: Content-Type:MIME-Version; b=PNAfmHMbwFGLZ8Rc6us1Q1MSyN1C4FDMSH73fp1fLyWq1vFpy9cSJO6uF9RbUQqv0h38myptkTPfwjxm4XITwCDL7Qj/V5g2zd95crHaH2J1IM8/lQt+D1N4k3SlmcbsrVPuZ31dXj81tDt/jdFfefliBseS/LvjH3qz6JicFC0= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oracle.com; spf=pass smtp.mailfrom=oracle.com; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b=fR0gEovs; dkim=pass (1024-bit key) header.d=oracle.onmicrosoft.com header.i=@oracle.onmicrosoft.com header.b=OCHEvO9y; arc=fail smtp.client-ip=205.220.177.32 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oracle.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=oracle.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b="fR0gEovs"; dkim=pass (1024-bit key) header.d=oracle.onmicrosoft.com header.i=@oracle.onmicrosoft.com header.b="OCHEvO9y" Received: from pps.filterd (m0246631.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 56KMmaFr024590; Sun, 20 Jul 2025 23:42:42 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=cc :content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s= corp-2025-04-25; bh=7CTx4us1BWCLH9+FojT/ImHRWf3T6xJTWvDU/xCzg74=; b= fR0gEovsA4RFFtpJqTG4TRrtNCH4wUHZ6xdLgE5cnIL9EKF0fDb7ZKLvQeHcysRg k4vvEKiCWYMqR5vCiYnNKml6MCbE9GAsSp5sRmG13YxaH7HCqR4HonzzxnSa7ut3 qyVRWcsotovN4OrY0yCda9sKw1VaL6XuEPokk8YYLzmFmWlYV6o0o2srOUXXIWnb Q+39W6P52a18mi1HQf08zjv66DXWTg3x6cKxnV/g1kNeFEiL7zwRVnU26LaZxzi+ c8VK55xJpXF2xHGMgB+HVNa/11872sFuZKXFsrt6oV2BFxqkmA9jbWKwk2r2K3pE tsE4Gboww5v3lzsRyfGsJQ== Received: from iadpaimrmta01.imrmtpd1.prodappiadaev1.oraclevcn.com (iadpaimrmta01.appoci.oracle.com [130.35.100.223]) by mx0b-00069f02.pphosted.com (PPS) with ESMTPS id 4805hp9hy6-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 20 Jul 2025 23:42:42 +0000 (GMT) Received: from pps.filterd (iadpaimrmta01.imrmtpd1.prodappiadaev1.oraclevcn.com [127.0.0.1]) by iadpaimrmta01.imrmtpd1.prodappiadaev1.oraclevcn.com (8.18.1.2/8.18.1.2) with ESMTP id 56KM08Ij014405; Sun, 20 Jul 2025 23:42:41 GMT Received: from nam11-dm6-obe.outbound.protection.outlook.com (mail-dm6nam11on2046.outbound.protection.outlook.com [40.107.223.46]) by iadpaimrmta01.imrmtpd1.prodappiadaev1.oraclevcn.com (PPS) with ESMTPS id 4801tdpt0s-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 20 Jul 2025 23:42:41 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=OnU+UUOvpgXDE1d2qGXU9lYbonGpQ7AEJTeUiH90SHYnk8PCQU5A6SGcEs2SQCLUCuxlRHiF0VulQ1d5kQ/O9zoDcL3e85SPKFg9H9UlqXQHhEeF/zQ5q43AjnB11XQfMu2z8xfypaZfhW/05t83hAz0+/Fib02Qsp6UkqNbcaKnbPRkufcAzoNA0L8pbFnCPyREvo+LaRgmXEjw6njyTR7/n+iuIXr5R8Rxe0WJaHx3/TWr/unJEFEPXwVUfkSq814Z8/MPhrVeJ8iFi8IYgUme9wUOnlb0/ZFwqYk4PGRUdx8/b6h6kxGLYnxgqlZKUOXxIjt5pnOGpO9pI4j9uQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=7CTx4us1BWCLH9+FojT/ImHRWf3T6xJTWvDU/xCzg74=; b=BstkJdiVxNN7a80fZM7G0Qnq2QrXk93y2SiKfTOtveoiQs1RyakjMVvebf2tJIoc3AmHilwef4830t+e4oo+9EZI0DvIMdYwnuRpmQlKXQkZlLXtr8ucfWvYb09Gxf9isZKzhSnp5xHU1ogD+QzRpUXWIJTspCoRIGKaqHsPG46KoByH37Zn7QATTh2uNg65GOz8uatSYKjqd5LlGhHfOLtgqA6hlkIyuKaDaas4g5Yb0axTS4wrNQR3Ztz5/YjXbDB7DHkY9Dt/nwfV5mdQpLE0+HkJg8Rb3T74xqtBu7yFEc27bOjGigLO8+P48IdCUMqNh9LL3zBOllClhXtN1g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=7CTx4us1BWCLH9+FojT/ImHRWf3T6xJTWvDU/xCzg74=; b=OCHEvO9yQPy1ap8qokSLhc3UmSHQpquFk/HMNTEmVsc5f/JbpBAmxdf7v9YXFABKTvz872feXv4GEDI/nJZ7FVKUv/UAeZv6WWyXAArcsB1q6sjWC1fyqz/Vo4aVgPmE9hvsAKTKB6ox7NY8USnHzWUP4xvSoRsdTU+l5E8OziU= Received: from CH3PR10MB7329.namprd10.prod.outlook.com (2603:10b6:610:12c::16) by MW4PR10MB6395.namprd10.prod.outlook.com (2603:10b6:303:1ea::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8943.29; Sun, 20 Jul 2025 23:42:39 +0000 Received: from CH3PR10MB7329.namprd10.prod.outlook.com ([fe80::c2a4:fdda:f0c2:6f71]) by CH3PR10MB7329.namprd10.prod.outlook.com ([fe80::c2a4:fdda:f0c2:6f71%4]) with mapi id 15.20.8943.028; Sun, 20 Jul 2025 23:42:38 +0000 From: Harry Yoo To: Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , Andy Lutomirski , Peter Zijlstra , Andrey Ryabinin , Arnd Bergmann , Andrew Morton , Dennis Zhou , Tejun Heo , Christoph Lameter Cc: "H . Peter Anvin" , Alexander Potapenko , Andrey Konovalov , Dmitry Vyukov , Vincenzo Frascino , Juergen Gross , Kevin Brodsky , Muchun Song , Oscar Salvador , Joao Martins , Lorenzo Stoakes , Jane Chu , Alistair Popple , Mike Rapoport , David Hildenbrand , Gwan-gyeong Mun , "Aneesh Kumar K . V" , x86@kernel.org, linux-kernel@vger.kernel.org, linux-arch@vger.kernel.org, linux-mm@kvack.org, Harry Yoo , stable@vger.kernel.org Subject: [PATCH v2 mm-hotfixes 4/5] x86/mm: convert p*d_populate{,_init} to _kernel variants Date: Mon, 21 Jul 2025 08:42:02 +0900 Message-ID: <20250720234203.9126-5-harry.yoo@oracle.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20250720234203.9126-1-harry.yoo@oracle.com> References: <20250720234203.9126-1-harry.yoo@oracle.com> Content-Transfer-Encoding: quoted-printable X-ClientProxiedBy: SL2P216CA0095.KORP216.PROD.OUTLOOK.COM (2603:1096:101:3::10) To CH3PR10MB7329.namprd10.prod.outlook.com (2603:10b6:610:12c::16) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH3PR10MB7329:EE_|MW4PR10MB6395:EE_ X-MS-Office365-Filtering-Correlation-Id: 59c927f4-f155-4304-9100-08ddc7e71c83 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|376014|7416014|366016|921020; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?GC3TsqctGzAG8+2uwE4mJ6fIRaUvuCFv6CSNYhqdh/igJsiz5lSwxKQV1Azu?= =?us-ascii?Q?3+fNrmMx3NekGHe+FWzszbhCcfKEf46HAGh+lFGSq9iiEVQ1wa+6OJk/Eki2?= =?us-ascii?Q?X6Iz3MqwO5ougCDjR73F0utzxfm6pYNVkzbaWiUzVkS9wAenQlKmdlNAS1MF?= =?us-ascii?Q?2LP3A2k7hxBFsE4NcxiwVW/tbFVcWzN6wxMlRCg97N9dGo6MEy6LVe2Obuad?= =?us-ascii?Q?ej77NLqY33dAjXeXqYjTUUjC5lxZ6fxfd+ksSkWLp9ml4RAnS1lHT3CRkGW5?= =?us-ascii?Q?FxTnQw/z2dynP8d9g5I0zhnxOGli7BgPqKVM/CcPM2E0MOSDn7iPRjhsQwWE?= =?us-ascii?Q?UEXDGyk2nUqYf9+r1WNQ6QQ34Z5ImRDe6LULHON+tAl5U95Qr7ItnPnySBP5?= =?us-ascii?Q?prxo4Zu/KyDcMo9L7DB1PtDtfan88SBxZ1Zpwa53PaAoYyNE/FGFhwPtSP6x?= =?us-ascii?Q?/eRsdvWOGYNH+kPFuNSxR/6UrxRfaRdnDEhyHFLNa5Xtt6orqbCyS55wETJO?= =?us-ascii?Q?+CwRmWRnbN2yVGXjsdtq2o5WymYGtcRHu5i4l1gjZ5Khxvz3ifBgMBYKO09u?= =?us-ascii?Q?Fn5lrQUBbLiYQKGoeAeN77lFxc+jmPmao/SEXS/BZUOtFseD2TGC+oy7psj6?= =?us-ascii?Q?2vXLqagOrIvpAP+RFAMplGvxj3MHv2gThcdbCZ796OhO/V+XW3Ad7CUEX//I?= =?us-ascii?Q?Dwhxxv9emYiOqRGitmqRKSsY/HUqxjR6ORSq1PZMCcIvEtmHk0sdT4kUxhz9?= =?us-ascii?Q?T9AJMXJMdtd5C70otxltT7ZXhk5QVb4xiVkjRLUalyH016gX6yrxZiIoPB4+?= =?us-ascii?Q?+LGpN6I9Y2ol7zT9pouFTUHEFkL+BzhafQ3eYzR8C7fYAt4c/f0Jfst2SSTe?= =?us-ascii?Q?6CZX5PqpxusYaDWVShwNsszUeN1sQANfEN/bsH9U5odHlzgq8wcieTKG6zrY?= =?us-ascii?Q?LWo7B3Dq3C/nfDoXH8VxFOQnPM4JzGMJh+UeJn78j7o1+e4yIVRl+ahrUyu5?= =?us-ascii?Q?YUmPo1lRq6Sy5Zy1SIsiCT3elwDHR4a4OQ9b7OcTE+6FuLWMtCeoSJaqmRs3?= =?us-ascii?Q?UAMI9u3EYdkubLzC2P136k3FKgflyFVZLJOlvnNqyuQziHvQg0NPG4yclxxF?= =?us-ascii?Q?z/UYWaga1h8KCmxytmgTKvhXGuUsZcFcl9Jupth5YHPJaJZ9oXZxVNomCQpE?= =?us-ascii?Q?mG3MjB2bNiX0/3g03CJxzGrATs/dTzSmh4e15vFASGPhi3MizndGdeL2Svd2?= =?us-ascii?Q?78t4E0UMFPrDAERWdCSwuGr5P39cZv2MH2i5d+PQPPyMlbyl5lpAsrZbZNT+?= =?us-ascii?Q?3C59fnVsJwYX1T4rl938pMy87+8yatg248gFDNEnrVYW3zIM8wdSS22b3720?= =?us-ascii?Q?DuE+H0qalksCPkqchox9+6sCMRpeKAYl50DYvKj6279RSr/A5wfwE3MKliXO?= =?us-ascii?Q?BujLgm1ZPkkyvRSvTxQui47gZ7QO5HLK+YhP+9yepm0WPOoJ+xdtjA=3D=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CH3PR10MB7329.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(376014)(7416014)(366016)(921020);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?2UBz+otm5fmP/BCh/OkVfY4xBTgMe9wueh0YWzs47UbFSHwAZJk9At4Q1JNG?= =?us-ascii?Q?KwFyLybrJ+3dE5Lo8I1JWAGgYDrweyNyCMD+9zlK5lPLgCynREIPG56PiLsc?= =?us-ascii?Q?s24gv9AxUKhhCHHb2pcnx6886kMfVIppMUGF7DdL32aPs3PUqQVlnOlfPdO+?= =?us-ascii?Q?icY5w8hvVuokHGR1EH/ASSg4K4VP4nOUXeXs1nKKLDF1UrcGvOmm1UkCPJXY?= =?us-ascii?Q?ei7Q/Vwz+8MR3dfZmLIFH31JjrHLZQB9kvasSYnFYhnKXiejVLmIy4Owm+8C?= =?us-ascii?Q?stQZmfnDOmpkU1pBVJlyQ81zbAgVjoWejlxG4pithGDrpc+I++AsAgFSSynz?= =?us-ascii?Q?EwPU4x/LIqT+ba93k7arFYeNAyGyhxXcCu0vzat33yzv5cs5Ufv+oZJlDaTC?= =?us-ascii?Q?VDXV9tHXm/kaHxvNQg2lpmj2BVF7m8FoEPrKusJ9c9DDpKEo0LR+D8aaun1M?= =?us-ascii?Q?1jgh6p0W04yRSe6Vrre03nb7OGXIxJr/AIQ+/qOlMGuE0u9NtCs+4eGRvorg?= =?us-ascii?Q?tjTWU8tpWZDP3SmWNqF1/XKxXJpeumvIaHrsBMzWzL1ijQh5XCG9xmoHkXvb?= =?us-ascii?Q?qtCkyXKsrObPTGQcmwDFy+lKxYJBnLPpzR5aX5KtiHDsqmMRR0IqkURyhUvX?= =?us-ascii?Q?M810yxi8Cax7Hy1mwvW4AhJnuN5ovI41uNeDPwz05ec4d4bW7GFqewRc7WOa?= =?us-ascii?Q?hgj1/ypoPUmgEQUJSUKQ7K1prVaEz0KhI2SL4n2SUFX1s/bs2oVIvisaaNj9?= =?us-ascii?Q?0sVjeObJlwoIZiTCFJ4jlVLA9aExQYxVIlKstACD4wn/MnVvHdvmeNVdxgDm?= =?us-ascii?Q?9gl5kNVMrY+N4GbOOGbSjbXzoCmxShGPcRgtTJoqu4VSybseoem1DkXIePkP?= =?us-ascii?Q?iilZ/1xAl7CDrxaLuMP20Iv55AdEerAqBDIgNmVvtIVhK2v13yaYh00lfO5c?= =?us-ascii?Q?+utWI+NlcWzPsclGTZceFz/YtY+RnN1Grbd2r6q+fFl+OUD2TzR2vz3zpGpB?= =?us-ascii?Q?R0mg2/wLaKy47hlekVEnY4LydUT40kJy7deh42ybjeFrbSl97N1U/nFTDnda?= =?us-ascii?Q?nepzt0DK3w2vCN1CaRrAABkoKSCJeaD07Dlxq6NbdutrZ/nv0ZsxXFVnSgcd?= =?us-ascii?Q?27obr4gawxMRkgy1pBfgP41IhJBsckKnUvytRGEmtbKOIqknBDS7P0DmXUMS?= =?us-ascii?Q?Ur38IkiycbxRPm805o1r8+nOp0zm8TBcYZyzKGpHM9/ITPfN4K9mxRxw0rD5?= =?us-ascii?Q?SVmrikBL7jwJfNPfjQupFffT++ywR1FBpoAxjYYLuE4k3lDBKxIX1qRWxoyf?= =?us-ascii?Q?b/Bj3azorF6Amk17MgLk+xkyo+ukCy5lYpqBOJm4HRZa2zG8SpdUzkGvPmDl?= =?us-ascii?Q?1OgfNkG2Dujy7a8MUU7uSGQJ59gW5IUfzpR2b60KPkB1G7irr4LMmXYTRD4F?= =?us-ascii?Q?FWz+mPM5sgw25bRETQGgJZMR5n3GOuG9ZnUZNM6Y9987mDX58fSXvy/47Ci+?= =?us-ascii?Q?kVDiXu4FmdHN14QumPnqv2ObaNaNyC2TXGkXJInq+dHJ66FsGEcQ2BCcuJfm?= =?us-ascii?Q?CzfMCnsyN3baX3d7fS/kzLMut9wvJyNN2ZhJOHND?= X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: L4zmISCh5q8czIsW5+9pdWJAy8nBJ+uSHmb3dkfGXuB6DuWNkMgbRsbMcoDoCUo5/jD4SYq5/sKsvT/rrA8Hlu9G9hzwZflJH8H/X+wLlG7DqxM/QKiusIcx/l9/bH+L2I3DCCvs/SNNxqR5sGn35X7mqev5Wr3Ao9bW0sXuDt1mK9uFPR25gKJoIlvimVLCCXGJAd0FTbNB7Ll9AeGz9e3m/XBfUVMRyVGuuUQgeKyAdDd+fvjpccjtTJVVoR0vrHignBdgUk7D5tLS4L/VW/ZwSJjBj4ckVhLP5d72//eN23X23KrSrba7qta9fA89brqx9k0HZJx11PsuHK0nsVK67UY00KBZl+duieI/LbCqEKYLz4YNQ3YM/XDZompTJ4A/9H/EtMoYw1Ta6OXjCX/LYxlHTzSvwFtXvcm5yqpdH/GvMAGZGyU0RwQ56+mTlIGdZMXmLROGKkYW7ZZDnDbY2bS0YSAGJGDCEAN3erxf/ftj6hcFr13RnFYSWfcE+BWTVBCjPb0FoItboIgoLVoDsiYP39ooUCbWUTK6VfK6iMCUXH1sQebjCI08VbJGk7za3YRA8l3hG4fbhVo6BnSjR+BaSAFCMvFZZ3Nih2I= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: 59c927f4-f155-4304-9100-08ddc7e71c83 X-MS-Exchange-CrossTenant-AuthSource: CH3PR10MB7329.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Jul 2025 23:42:38.8072 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: p9dAxyA/Tu86SjPENo6zPkpkOJooWih5rdm5LGBB30sY89W57dW3vEUcTP/rahfqnXGdG3Gpjsmby1TOpiAkZQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR10MB6395 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1099,Hydra:6.1.9,FMLib:17.12.80.40 definitions=2025-07-20_02,2025-07-17_02,2025-03-28_01 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 adultscore=0 bulkscore=0 suspectscore=0 mlxscore=0 phishscore=0 mlxlogscore=999 malwarescore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2505160000 definitions=main-2507200228 X-Proofpoint-ORIG-GUID: w7jD10sj-9lgRf7I-Gk9s1Wuv5IF8T19 X-Authority-Analysis: v=2.4 cv=YY+95xRf c=1 sm=1 tr=0 ts=687d7ef2 b=1 cx=c_pps a=zPCbziy225d3KhSqZt3L1A==:117 a=zPCbziy225d3KhSqZt3L1A==:17 a=6eWqkTHjU83fiwn7nKZWdM+Sl24=:19 a=lCpzRmAYbLLaTzLvsPZ7Mbvzbb8=:19 a=wKuvFiaSGQ0qltdbU6+NXLB8nM8=:19 a=Ol13hO9ccFRV9qXi2t6ftBPywas=:19 a=xqWC_Br6kY4A:10 a=Wb1JkmetP80A:10 a=GoEa3M9JfhUA:10 a=VwQbUJbxAAAA:8 a=QyXUC8HyAAAA:8 a=yPCof4ZbAAAA:8 a=U6_OK38MrKt_FgBMkhMA:9 cc=ntf awl=host:12061 X-Proofpoint-GUID: w7jD10sj-9lgRf7I-Gk9s1Wuv5IF8T19 X-Proofpoint-Spam-Details-Enc: AW1haW4tMjUwNzIwMDIyOCBTYWx0ZWRfXyoLhmEZtcc9l bIrf5d1OAi6FAQYa7rbL3sF85Y73j+vyzOM9U5O0vF0AoI8XXSkTp1I4VH703DGieivw4mNxtSt L7hTK3RwPdoOkgJQlbguV0U0UV04KQ2fkykhqi7j5LVvDMGeNkldrZx3MypfqAkJthIJf7QdoU1 ouw7L3IVXIHWUzjRhyllHU6pG5TNGX4pRQkGfWfRTfmbsZpTDoX2tS3sL0jY2jL1CwDzOdgAmyR MOnbDh4ZxCjcViEkBCUi7EBIAJsEbpTOmIsSaOmVx64ggglJJittQ4WjiJis6L8Q846HizcrGt7 04YiHzCclwCm7x5sXlMxHnoQEBTD+BPkUZ8tUgxN5qy753tKuV2/X76xl6i5zfNHHGfsyTw8n5n uXvIUbldzpSVuzzGEy5kX71pUgRRYYHGQ+wycAX857RiJouQymQzBM3eMvzHY2hKePI985qH Content-Type: text/plain; charset="utf-8" Introduce p*d_populate_kernel_safe() and convert p*d_populate{,_init}() to p*d_populate_kernel{,_init}() to ensure synchronization of kernel mappings when populating PGD entries. By converting them, we eliminate the risk of forgetting to synchronize top-level page tables after populating PGD entries. Cc: stable@vger.kernel.org Suggested-by: Dave Hansen Signed-off-by: Harry Yoo --- arch/x86/include/asm/pgalloc.h | 20 ++++++++++++++++++++ arch/x86/mm/init_64.c | 25 +++++++++++++++++++------ arch/x86/mm/kasan_init_64.c | 8 ++++---- 3 files changed, 43 insertions(+), 10 deletions(-) diff --git a/arch/x86/include/asm/pgalloc.h b/arch/x86/include/asm/pgalloc.h index ead834e8141a..aea3b16e7a35 100644 --- a/arch/x86/include/asm/pgalloc.h +++ b/arch/x86/include/asm/pgalloc.h @@ -122,6 +122,15 @@ static inline void p4d_populate_safe(struct mm_struct = *mm, p4d_t *p4d, pud_t *pu set_p4d_safe(p4d, __p4d(_PAGE_TABLE | __pa(pud))); } =20 +static inline void p4d_populate_kernel_safe(unsigned long addr, + p4d_t *p4d, pud_t *pud) +{ + paravirt_alloc_pud(&init_mm, __pa(pud) >> PAGE_SHIFT); + set_p4d_safe(p4d, __p4d(_PAGE_TABLE | __pa(pud))); + if (ARCH_PAGE_TABLE_SYNC_MASK & PGTBL_P4D_MODIFIED) + arch_sync_kernel_mappings(addr, addr); +} + extern void ___pud_free_tlb(struct mmu_gather *tlb, pud_t *pud); =20 static inline void __pud_free_tlb(struct mmu_gather *tlb, pud_t *pud, @@ -147,6 +156,17 @@ static inline void pgd_populate_safe(struct mm_struct = *mm, pgd_t *pgd, p4d_t *p4 set_pgd_safe(pgd, __pgd(_PAGE_TABLE | __pa(p4d))); } =20 +static inline void pgd_populate_kernel_safe(unsigned long addr, + pgd_t *pgd, p4d_t *p4d) +{ + if (!pgtable_l5_enabled()) + return; + paravirt_alloc_p4d(&init_mm, __pa(p4d) >> PAGE_SHIFT); + set_pgd_safe(pgd, __pgd(_PAGE_TABLE | __pa(p4d))); + if (ARCH_PAGE_TABLE_SYNC_MASK & PGTBL_PGD_MODIFIED) + arch_sync_kernel_mappings(addr, addr); +} + extern void ___p4d_free_tlb(struct mmu_gather *tlb, p4d_t *p4d); =20 static inline void __p4d_free_tlb(struct mmu_gather *tlb, p4d_t *p4d, diff --git a/arch/x86/mm/init_64.c b/arch/x86/mm/init_64.c index 3800479022e4..e4922b9c8403 100644 --- a/arch/x86/mm/init_64.c +++ b/arch/x86/mm/init_64.c @@ -75,6 +75,19 @@ DEFINE_POPULATE(pgd_populate, pgd, p4d, init) DEFINE_POPULATE(pud_populate, pud, pmd, init) DEFINE_POPULATE(pmd_populate_kernel, pmd, pte, init) =20 +#define DEFINE_POPULATE_KERNEL(fname, type1, type2, init) \ +static inline void fname##_init(unsigned long addr, \ + type1##_t *arg1, type2##_t *arg2, bool init) \ +{ \ + if (init) \ + fname##_safe(addr, arg1, arg2); \ + else \ + fname(addr, arg1, arg2); \ +} + +DEFINE_POPULATE_KERNEL(pgd_populate_kernel, pgd, p4d, init) +DEFINE_POPULATE_KERNEL(p4d_populate_kernel, p4d, pud, init) + #define DEFINE_ENTRY(type1, type2, init) \ static inline void set_##type1##_init(type1##_t *arg1, \ type2##_t arg2, bool init) \ @@ -255,7 +268,7 @@ static p4d_t *fill_p4d(pgd_t *pgd, unsigned long vaddr) { if (pgd_none(*pgd)) { p4d_t *p4d =3D (p4d_t *)spp_getpage(); - pgd_populate(&init_mm, pgd, p4d); + pgd_populate_kernel(vaddr, pgd, p4d); if (p4d !=3D p4d_offset(pgd, 0)) printk(KERN_ERR "PAGETABLE BUG #00! %p <-> %p\n", p4d, p4d_offset(pgd, 0)); @@ -267,7 +280,7 @@ static pud_t *fill_pud(p4d_t *p4d, unsigned long vaddr) { if (p4d_none(*p4d)) { pud_t *pud =3D (pud_t *)spp_getpage(); - p4d_populate(&init_mm, p4d, pud); + p4d_populate_kernel(vaddr, p4d, pud); if (pud !=3D pud_offset(p4d, 0)) printk(KERN_ERR "PAGETABLE BUG #01! %p <-> %p\n", pud, pud_offset(p4d, 0)); @@ -720,7 +733,7 @@ phys_p4d_init(p4d_t *p4d_page, unsigned long paddr, uns= igned long paddr_end, page_size_mask, prot, init); =20 spin_lock(&init_mm.page_table_lock); - p4d_populate_init(&init_mm, p4d, pud, init); + p4d_populate_kernel_init(vaddr, p4d, pud, init); spin_unlock(&init_mm.page_table_lock); } =20 @@ -762,10 +775,10 @@ __kernel_physical_mapping_init(unsigned long paddr_st= art, =20 spin_lock(&init_mm.page_table_lock); if (pgtable_l5_enabled()) - pgd_populate_init(&init_mm, pgd, p4d, init); + pgd_populate_kernel_init(vaddr, pgd, p4d, init); else - p4d_populate_init(&init_mm, p4d_offset(pgd, vaddr), - (pud_t *) p4d, init); + p4d_populate_kernel_init(vaddr, p4d_offset(pgd, vaddr), + (pud_t *) p4d, init); =20 spin_unlock(&init_mm.page_table_lock); pgd_changed =3D true; diff --git a/arch/x86/mm/kasan_init_64.c b/arch/x86/mm/kasan_init_64.c index 0539efd0d216..e825952d25b2 100644 --- a/arch/x86/mm/kasan_init_64.c +++ b/arch/x86/mm/kasan_init_64.c @@ -108,7 +108,7 @@ static void __init kasan_populate_p4d(p4d_t *p4d, unsig= ned long addr, if (p4d_none(*p4d)) { void *p =3D early_alloc(PAGE_SIZE, nid, true); =20 - p4d_populate(&init_mm, p4d, p); + p4d_populate_kernel(addr, p4d, p); } =20 pud =3D pud_offset(p4d, addr); @@ -128,7 +128,7 @@ static void __init kasan_populate_pgd(pgd_t *pgd, unsig= ned long addr, =20 if (pgd_none(*pgd)) { p =3D early_alloc(PAGE_SIZE, nid, true); - pgd_populate(&init_mm, pgd, p); + pgd_populate_kernel(addr, pgd, p); } =20 p4d =3D p4d_offset(pgd, addr); @@ -255,7 +255,7 @@ static void __init kasan_shallow_populate_p4ds(pgd_t *p= gd, =20 if (p4d_none(*p4d)) { p =3D early_alloc(PAGE_SIZE, NUMA_NO_NODE, true); - p4d_populate(&init_mm, p4d, p); + p4d_populate_kernel(addr, p4d, p); } } while (p4d++, addr =3D next, addr !=3D end); } @@ -273,7 +273,7 @@ static void __init kasan_shallow_populate_pgds(void *st= art, void *end) =20 if (pgd_none(*pgd)) { p =3D early_alloc(PAGE_SIZE, NUMA_NO_NODE, true); - pgd_populate(&init_mm, pgd, p); + pgd_populate_kernel(addr, pgd, p); } =20 /* --=20 2.43.0 From nobody Mon Oct 6 13:20:34 2025 Received: from mx0b-00069f02.pphosted.com (mx0b-00069f02.pphosted.com [205.220.177.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 7F8C7239E9F; Sun, 20 Jul 2025 23:43:37 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=205.220.177.32 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753055019; cv=fail; b=a9gPXgPMSiEF2vML0LzT3WzI0rGN29HBgT3/ZpbTtFNmlTe+dlykjkTU/lLXZO+W2M7ThDP/8o4GyW5jAhsri8fFt3j3CNbjKUnC+0eQm4QGdo1lrIltvoRyydhkiDR76KS7AhXa39AVaro9w0UV74Tv+ls/Nc1vmIEV0bAOKXs= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753055019; c=relaxed/simple; bh=2nxf4JlsNgpI5gw88Zv4B0E7JENDIKBWNJjQzv6MaSE=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: Content-Type:MIME-Version; b=K2o+sIVVn4gWYcD3jFvmDyWIHPd616XdXkaOzQnEDtueDvoQnj1HWq0o7FbYcq7fiho2bsHHHiIm4Vat7Qpeh0gVnaGj1Yo11p8qfZTIe0np9K84noZFkBptS/0eJ8vXjLuq+Wmsk6s0wEoc2AgYLb7r62PI0tAAiOXVPglX90w= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oracle.com; spf=pass smtp.mailfrom=oracle.com; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b=KFMrSTdN; dkim=pass (1024-bit key) header.d=oracle.onmicrosoft.com header.i=@oracle.onmicrosoft.com header.b=H6IlS58x; arc=fail smtp.client-ip=205.220.177.32 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oracle.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=oracle.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b="KFMrSTdN"; dkim=pass (1024-bit key) header.d=oracle.onmicrosoft.com header.i=@oracle.onmicrosoft.com header.b="H6IlS58x" Received: from pps.filterd (m0246632.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 56KMP29N000607; Sun, 20 Jul 2025 23:42:51 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=cc :content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s= corp-2025-04-25; bh=r2Jb0+63DSb9MMjgMOmrawzICO39CIC8ZY339dYTr6A=; b= KFMrSTdN8xR+3u8S8bV+Y0VZo91BKedEbBQL+5Hil/fSWw8Y18wC0L0eRZdAsvqA EFbrxA9jF1bpIJ1itWnqozLkAmftKelyvRVsCwikOlRMYcmSOhQcEoc/Rp46MMHJ mX059efx4zAq/ixPzA3/XNRJFnULc5cMp9ELRPEnUyK67Uc6/gg2v2KWWsSmCTaH 2CFcXVGILYk/vLVEJgnvMXfi39zPGL1jOegCXFd3Gb8DVyqQvr3I9jEXRpJ4zq23 mhTgsivw04H9Y8oP8U1+7nXu0kUtOZMzj49gYwlFpp7jDZ6Amx/MsYGALBNyfBrY p7xj3YlO6a7rXRlbMiZ8yw== Received: from iadpaimrmta01.imrmtpd1.prodappiadaev1.oraclevcn.com (iadpaimrmta01.appoci.oracle.com [130.35.100.223]) by mx0b-00069f02.pphosted.com (PPS) with ESMTPS id 4805e29hp2-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 20 Jul 2025 23:42:50 +0000 (GMT) Received: from pps.filterd (iadpaimrmta01.imrmtpd1.prodappiadaev1.oraclevcn.com [127.0.0.1]) by iadpaimrmta01.imrmtpd1.prodappiadaev1.oraclevcn.com (8.18.1.2/8.18.1.2) with ESMTP id 56KMo47L014433; Sun, 20 Jul 2025 23:42:50 GMT Received: from nam02-sn1-obe.outbound.protection.outlook.com (mail-sn1nam02on2041.outbound.protection.outlook.com [40.107.96.41]) by iadpaimrmta01.imrmtpd1.prodappiadaev1.oraclevcn.com (PPS) with ESMTPS id 4801tdpt12-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 20 Jul 2025 23:42:50 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=uw7gFEk5xzyDCbOoNT4y6bktlRJisxRENgZ2HIoTmiz/t88VGEnHaLjAJWlkX2N9WfQyDnUjPPuW+Lgks4nNgDUZI14piB81jq6JprmrZY+Lta3RKd5HiJvvlzV6TMZ7v5R4AmkLnskPzsGOJsqkPsTktqF48dSXk1hOFFnT2A8zyC0xlV25Kt3RFpDyewUFwGnXplVQHZXEAhL49jNGe5RAgHDgC2eH5dPFmZ5ymn468uy6mh/FU8Ft1ykn8JOpji4esokKy1joNyqutE6pCoYKJC6HBwPT951SSQ3lZRZ2ivIb2+8CHmtoQRkqRbM88K157Mm13BynnvmkPdM3fg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=r2Jb0+63DSb9MMjgMOmrawzICO39CIC8ZY339dYTr6A=; b=QZmyW4ZKVOb1uI52T4z9zvzqEnqkcOIzg61VN2OpiUpfh4GN3bqkelHZPGFEsrVFUorQr8UhXTTT/clXFeFzj1cLodEIHheMvvPFQm0bPSGqivlT+w2Rj3bFY5Z4zOweHaas7zcGDhfcGFGx335nQRfpJSVOmhMgjkTgBwAOHXOzl8/7uPeat31PmNX4JrmGdC8cdGpPfXnrcn3o9fdf4x7M+1ckVzk4qS8F+/SHrJx3KF6APq0Png+uIDoprRl9HLdTrGcSlkUBWRhK6tjfLbKrnx2BPDSwnwwzNFukJSwQy/0vwPmnWZMTWw6EssKUHGu+Yq+HHyKPq9NQpoN1Ag== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=r2Jb0+63DSb9MMjgMOmrawzICO39CIC8ZY339dYTr6A=; b=H6IlS58xvTDybbRUE6megpj6yONZ08WMZjdQ2ttmy+qYClfAX8Oo8vIjXhAjnTJ4EihZA2Jb94nUMRgkys88RO+I18QYnwZ+N1l/iY6o+n8rTCKmqSsZ4IHjVGltZ3p8MsmWav2ANc75jQRZ00+29lo4ScrHzhNMXMPWEQUgOdo= Received: from CH3PR10MB7329.namprd10.prod.outlook.com (2603:10b6:610:12c::16) by MW4PR10MB6395.namprd10.prod.outlook.com (2603:10b6:303:1ea::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8943.29; Sun, 20 Jul 2025 23:42:42 +0000 Received: from CH3PR10MB7329.namprd10.prod.outlook.com ([fe80::c2a4:fdda:f0c2:6f71]) by CH3PR10MB7329.namprd10.prod.outlook.com ([fe80::c2a4:fdda:f0c2:6f71%4]) with mapi id 15.20.8943.028; Sun, 20 Jul 2025 23:42:42 +0000 From: Harry Yoo To: Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , Andy Lutomirski , Peter Zijlstra , Andrey Ryabinin , Arnd Bergmann , Andrew Morton , Dennis Zhou , Tejun Heo , Christoph Lameter Cc: "H . Peter Anvin" , Alexander Potapenko , Andrey Konovalov , Dmitry Vyukov , Vincenzo Frascino , Juergen Gross , Kevin Brodsky , Muchun Song , Oscar Salvador , Joao Martins , Lorenzo Stoakes , Jane Chu , Alistair Popple , Mike Rapoport , David Hildenbrand , Gwan-gyeong Mun , "Aneesh Kumar K . V" , x86@kernel.org, linux-kernel@vger.kernel.org, linux-arch@vger.kernel.org, linux-mm@kvack.org, Harry Yoo , stable@vger.kernel.org Subject: [PATCH v2 mm-hotfixes 5/5] x86/mm: drop unnecessary calls to sync_global_pgds() and fold into its sole user Date: Mon, 21 Jul 2025 08:42:03 +0900 Message-ID: <20250720234203.9126-6-harry.yoo@oracle.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20250720234203.9126-1-harry.yoo@oracle.com> References: <20250720234203.9126-1-harry.yoo@oracle.com> Content-Transfer-Encoding: quoted-printable X-ClientProxiedBy: SEWP216CA0137.KORP216.PROD.OUTLOOK.COM (2603:1096:101:2c0::6) To CH3PR10MB7329.namprd10.prod.outlook.com (2603:10b6:610:12c::16) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH3PR10MB7329:EE_|MW4PR10MB6395:EE_ X-MS-Office365-Filtering-Correlation-Id: 093436e7-0ff5-4ffa-a42b-08ddc7e71e94 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|376014|7416014|366016|921020; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?1ZFmLwl+ZerztF6rtsUYTVwYP3HUxc9WFoTclMVduAd3HQu3ViTQcLJQJY0+?= =?us-ascii?Q?ne4YjPImymLQNGdFeYSo72hWVYXfKLEOI5ajz17ObOumCgrU3GMMeHf5U1y0?= =?us-ascii?Q?OWTCGqg6y3OlXjYjlCke0Qj/RoHRmf7dr0RMomcuZ8mEuNBDJz5DDNeQ2bAU?= =?us-ascii?Q?GGT1rHqSUj3LT4HsOAuCpCpzuP4RU6Rok8T7Ejx/xjfiapL1azfi+p5dR5dX?= =?us-ascii?Q?xR01ErUr6elhwbLfLlg2ySnYqPRKfkZDS66tpM4EXlhW3z135cMI6Cv9DRm6?= =?us-ascii?Q?uHJ7CKQ4CytWjY9JDdfhoaS5BAXpigjZkFGtPZRGK3lK8bEztfV8IlOIRFcj?= =?us-ascii?Q?s3uWnF5nU/qIrQawvMVI4BdZ9McvGnLuOK0Vo8GsbJ1qumODlMixL31EZSpA?= =?us-ascii?Q?HSE1u+Lorze3iPhYCa0YKbmgAYtmmolp/B9hoDM4p0oET7ozlzgck05wYq0L?= =?us-ascii?Q?Xs18qiN6XYQ76inJnLUOLkNpdUKc59FA8/0/ujIs201HCGLQtVvmkXKVfhBp?= =?us-ascii?Q?k0FvRcL4gyCKtB9mAT54Es6dqpVv+GPsNUCt8EBt1/33Diet7xtVVpyS9idR?= =?us-ascii?Q?N7PwWvgVcSA/jfqCR9WAXM12RLgSQYRt6T8NDm1VqIj/RBlRkpw8Rl+hH+Za?= =?us-ascii?Q?MsEnX5J+/4hbfbLDQ7jeBi0fceZOUytlwUjmHIWLJ6O0Il69+d28H96w4ZPi?= =?us-ascii?Q?i0Vtgc8vZifMZJVhbXydTdGx8zoMkwRQJnYm0Pm0z7zSf4THalWVHjkzalt8?= =?us-ascii?Q?OYKq5iykdVAvT5QYKIuv7tOUK/2a5fCdh83RK48xsEOFYJV72+cCWg2JdUFJ?= =?us-ascii?Q?pH6ZkqGhyMBF/8ENUUT227Qb0ySoseGrDVWV7it/KlyS2lKsC5lbDJHcsOZn?= =?us-ascii?Q?eEk20irrX6K4yrQJFpkI+bb97gViXLeONI9IsgT9ObD3cyqtV5KTCMZRWr7c?= =?us-ascii?Q?xM5C3XfWvZ+rl/qva1Bqj9XhFtbi12dfdPIlFmyg5FUAVaV+ELtkT/jKIJ3t?= =?us-ascii?Q?q4hfFBHsXoQHVrdN1ByOzrf6IbrRGm3Q1iWsEfEKA1IAlHa/p0YCwwD8LTTj?= =?us-ascii?Q?PJg5LWRVyVgfhQLoxpJrZy6wrKkvLPskHt6Fn2YLkyQQ/1TCXf0s1rAROT6J?= =?us-ascii?Q?MZagEwLvYXXgfS8tsOVVX2UgZunQn/JLfEyVWu6H8KNItzBLX9+kwPzLTtb8?= =?us-ascii?Q?HiM456L7StOrWA/PCvuCbsqginycx06VvjTDfG9WUhml3iVsiNIpupqsmNkZ?= =?us-ascii?Q?oYdlHScBdFaW/m1628HcKqzhN31DlUygs+O0IMSlCrFizZ8Puf0HWBf9FLzi?= =?us-ascii?Q?ridhxCkqxV4uykmr52FTkfkP5nidhsKFIsOdTb7W4E4qlD3gO59gNRT4bM4S?= =?us-ascii?Q?53tc6whAjBR1dIcqYpTix7KbyZKby6qkPCYWVGZ4k4YZ6HLKmvyrtR6YNJAe?= =?us-ascii?Q?H1yV2slOYegvKOUryHqmM9MfhWtlTLkH?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CH3PR10MB7329.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(376014)(7416014)(366016)(921020);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?jhc1qBiB+DecX8JWxZHqaA+525sODg6ddJGm4URrlTgKaEhWr4hd0sPHB/8n?= =?us-ascii?Q?GfM+a6Nyc4inzRG95nhWgJ1Fbhs/S/oDDYVjS4OzWcP32qTGju2hIhgT2FQ2?= =?us-ascii?Q?QoRryBK4gZ+Kcfs4YXjxh9ad0iTVZ2ZVYw8gR2jxsr661QdMKu/JGDJ5MGWM?= =?us-ascii?Q?cCOvbMJVJQDL+T7CSL+KFgkGBpL2P5cxO0lqw+cWDBldDaKnEs1ZNnZVD4aP?= =?us-ascii?Q?jACEWz7CSbh+rlAtwjX65jJe91tJS/TuI10Q6Zrk308L+BXnC2S/HMm3EJkY?= =?us-ascii?Q?Q6CuQ3g0RmvV6djdJCz9ZFYTeD/EkGKsOj15ap1c7k6I7zDm5ZkGr8ybZgQw?= =?us-ascii?Q?wSRB979lOmfNAAvdSM5/suHyBSngV0LbK185+yBbuCX2ljCs5n5yWkbE7wtX?= =?us-ascii?Q?r9hkWqo3FL2clUDp3lJavqEchW4z3GuinilrK9TCRweigO06eGlWIugHbLMl?= =?us-ascii?Q?m/vDFqmacYj0sIcMEgfSO+mWp8L/lHonjFUhG24w/OH2h3p5v7ciBtA6WKYl?= =?us-ascii?Q?L1XWGvANkEqMEb1c8OmwndL9NAmWJhK0rQvCutYmxRaE53XCK8p28qWGAi/L?= =?us-ascii?Q?prAMQckGNCr1UUd54HNWutV/+PW+Q3/6VLi9latjZmRTtchmKbVZ+bKXR8V5?= =?us-ascii?Q?jFxmDL3hxqiYiucQEokXFx0A/tbL+lcG9kaTQOx2q7HSwon3tfxRahG2juvT?= =?us-ascii?Q?uguLdwrX4pNR0WyNFSbElGE+xzQj+YUkvPPjLtR50WvGGXVs6vNGygxSAcq9?= =?us-ascii?Q?Aj8yE6H8KIUs/A8DmGDld9CGhx0lfMa6UvSbSA5xZzHvXTmQPhpDRUZgZGDt?= =?us-ascii?Q?gTvmdbf6WS9/engeWmM6dmnIb09zCz9RLtUIMkkWeu+FxQB0x0uhqNB4tKRK?= =?us-ascii?Q?sesdtOqiPGaNwOLFsElXxX8x3YmhZ6owd2ZfDHoGOn03XSqQ/MsygqsyuUGq?= =?us-ascii?Q?AHpqfOKediNmvKar2h15wPipOwPJ0cmcNUXWO1Jt7dy9ZQi633fxcxY48h5J?= =?us-ascii?Q?Rd89fDIFvHBDSNDT80HcFqNPpvq+Wea6nnN/yqty0lAGaKqugC44vZRgyzXs?= =?us-ascii?Q?hya57iLoabrQAE1T1QXfZDBHIrXgyOseHRx9lHUJ9qrceDp2j+ZZ+ohe/hx2?= =?us-ascii?Q?xIjNpXUYKyJG+FHWf8QJpQaPqmK99/LuiBF6hSDZQfglVi1KN5BILUNk7Qre?= =?us-ascii?Q?9skhBcDmYcf9yccWutdgI4EMyvxS2xKdNBSLObn7iJixM9p39PPcVURyGGiv?= =?us-ascii?Q?s9RbgyWIQE3p1+jK+dLjXYspzl+uQH2pYQFJtEu20ggZQFgRvj5QxvMutuHt?= =?us-ascii?Q?C9JAS3tsbV5Ek3/3kdpZXGaWlYqcaYizs2+Ao6Y1yn1C4s8uHK7KGHphQ9JG?= =?us-ascii?Q?yInJ0C4DogwJV7ZSJqe+pWcj+ZbZ6u+qyLjZYJO207lXia3zIelB1zlaymU4?= =?us-ascii?Q?uXXOlqDaxR3RNBS097HHBNaBULjfe4wD43v/yeSS1Zyu0aBhDqN2fQO4hB13?= =?us-ascii?Q?n1VcrUj2R2pRYqwIdmCWwMK7W11atk0MwNwQp8rHCvOoG5szQTn41q+CQAhi?= =?us-ascii?Q?MEPxIURzyBbrKafBNAbJwKXsZu4A0+dlvhOPdND6?= X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: kOprNKC+PtKnfLGnhV9xMBVPAp13hexIUdwBVs7uSiOxSndCIgomLtCrazaLYU5JjAHYpJUS9ymAHN1EASkGUvcWmT6lcTXc1UsjalSFxYqR9gOch0rJl03uISJLavQXSdyMGZhDIm1qrdW21NeJkFM1LiJoiSp/VI6lZUaoKrruRJ7SM1gYPQ0JRgtSqcX7krULPSOdgjN6ncyzLbOPYLOjoPgEC7A67mV7z+NPBpkjz6nTAf5SqTVBJQDSEO3FLDSnrRYpycvyv67Dn7X2RznHJGiSu4xkmcd2zi059MrJ+pFhbIjwHuob+feaVoyIKtY4Lte7wJJvn78iSjV9zDxzJWKqvq9QVf/h9i/INsHSX3en1/XRWj97Kbsy57EWoVQWC4PYZ2vqoeEEz+SDYuJwh/P62UVcypvrdZjify8kaZB5JiKpXDAEla/qDGLFoQBfBhIkvQCJLP9Kd8nGy/iX0vBKqmffAQFttvTT6T7v/ItLWgqphvT31BTk46AbGlH75AzWwfbs6fN6hZlWeW5/NlB0I0ivm9omw9GLbD+qVDyhy9tMlV2tF07R+TzqRpzPEuJWP9IvhBYkRRHI9YvYfXM/lHuOFSLeiEFXkJU= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: 093436e7-0ff5-4ffa-a42b-08ddc7e71e94 X-MS-Exchange-CrossTenant-AuthSource: CH3PR10MB7329.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Jul 2025 23:42:42.3148 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: BDUomHQWFjHcVbmtQ3pb4xVzS3Cj8h/GUzL2Qhr1t0Bf9J1eWyXmnlvc/jOlGF5RaYMkTD7by7hZGQS48d8PXQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR10MB6395 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1099,Hydra:6.1.9,FMLib:17.12.80.40 definitions=2025-07-20_02,2025-07-17_02,2025-03-28_01 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 adultscore=0 bulkscore=0 suspectscore=0 mlxscore=0 phishscore=0 mlxlogscore=999 malwarescore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2505160000 definitions=main-2507200228 X-Authority-Analysis: v=2.4 cv=WaYMa1hX c=1 sm=1 tr=0 ts=687d7efb b=1 cx=c_pps a=zPCbziy225d3KhSqZt3L1A==:117 a=zPCbziy225d3KhSqZt3L1A==:17 a=6eWqkTHjU83fiwn7nKZWdM+Sl24=:19 a=lCpzRmAYbLLaTzLvsPZ7Mbvzbb8=:19 a=wKuvFiaSGQ0qltdbU6+NXLB8nM8=:19 a=Ol13hO9ccFRV9qXi2t6ftBPywas=:19 a=xqWC_Br6kY4A:10 a=Wb1JkmetP80A:10 a=GoEa3M9JfhUA:10 a=VwQbUJbxAAAA:8 a=QyXUC8HyAAAA:8 a=yPCof4ZbAAAA:8 a=dP5MOTGk7IcSfjIVwswA:9 cc=ntf awl=host:12061 X-Proofpoint-GUID: AcVDYv-dbkeVkIMrJOT4WURRafi_YcaU X-Proofpoint-Spam-Details-Enc: AW1haW4tMjUwNzIwMDIyOCBTYWx0ZWRfX49h/4cDE6oQt vnjuQVlo2MaKBbJGnW++A6xTacnTlN9+xySr5O376z+1rN9Ax0YBHg4vxgBAemYIstWjdzBeEKe EfBwlZ14LaiAjYiFc/O2seSkeJJ2x8FWpT7VmO1MeYyL6/jsp9z2bnUbKieLDoZrg+E5MaUfH54 O784ocPNdJxaf/0howFMigENrZLAD3VLvacaZ0To2exPTMeUVz7P/EDHBqWVDbiYujz5dxILTVc bI66mwf2XzvFbkzW8qVaK24pj/GWQ4mLzbnMA1NEeMvizVjCDV+7Ux51Tgyiw9REburka2fj88V TY3sil2vy4bl2ZKsKk304hql5EbeyaWmFyeiI3LBftabg55WIiyCggys8Y9Mr8zf5OKIPP3zuXF sAmE7lVe5Ms12VXqovCYPXHW4hReZ3Fxpq847MzzWbWImGJB0woi8SNydtkN8/VvBkjHL0/U X-Proofpoint-ORIG-GUID: AcVDYv-dbkeVkIMrJOT4WURRafi_YcaU Content-Type: text/plain; charset="utf-8" Now that p*d_populate_kernel{,init}() handles page table synchronization, calling sync_global_pgds() is no longer necessary. Remove those redundant calls. Additionally, since arch_sync_kernel_mappings() is now the only remaining caller of sync_global_pgds(), fold the function into its user. Cc: stable@vger.kernel.org Suggested-by: Dave Hansen Signed-off-by: Harry Yoo --- arch/x86/mm/init_64.c | 17 ++--------------- 1 file changed, 2 insertions(+), 15 deletions(-) diff --git a/arch/x86/mm/init_64.c b/arch/x86/mm/init_64.c index e4922b9c8403..f1507de3b7a3 100644 --- a/arch/x86/mm/init_64.c +++ b/arch/x86/mm/init_64.c @@ -228,7 +228,7 @@ static void sync_global_pgds_l4(unsigned long start, un= signed long end) * When memory was added make sure all the processes MM have * suitable PGD entries in the local PGD level page. */ -static void sync_global_pgds(unsigned long start, unsigned long end) +void arch_sync_kernel_mappings(unsigned long start, unsigned long end) { if (pgtable_l5_enabled()) sync_global_pgds_l5(start, end); @@ -236,11 +236,6 @@ static void sync_global_pgds(unsigned long start, unsi= gned long end) sync_global_pgds_l4(start, end); } =20 -void arch_sync_kernel_mappings(unsigned long start, unsigned long end) -{ - sync_global_pgds(start, end); -} - /* * NOTE: This function is marked __ref because it calls __init function * (alloc_bootmem_pages). It's safe to do it ONLY when after_bootmem =3D= =3D 0. @@ -746,13 +741,11 @@ __kernel_physical_mapping_init(unsigned long paddr_st= art, unsigned long page_size_mask, pgprot_t prot, bool init) { - bool pgd_changed =3D false; - unsigned long vaddr, vaddr_start, vaddr_end, vaddr_next, paddr_last; + unsigned long vaddr, vaddr_end, vaddr_next, paddr_last; =20 paddr_last =3D paddr_end; vaddr =3D (unsigned long)__va(paddr_start); vaddr_end =3D (unsigned long)__va(paddr_end); - vaddr_start =3D vaddr; =20 for (; vaddr < vaddr_end; vaddr =3D vaddr_next) { pgd_t *pgd =3D pgd_offset_k(vaddr); @@ -781,12 +774,8 @@ __kernel_physical_mapping_init(unsigned long paddr_sta= rt, (pud_t *) p4d, init); =20 spin_unlock(&init_mm.page_table_lock); - pgd_changed =3D true; } =20 - if (pgd_changed) - sync_global_pgds(vaddr_start, vaddr_end - 1); - return paddr_last; } =20 @@ -1580,8 +1569,6 @@ int __meminit vmemmap_populate(unsigned long start, u= nsigned long end, int node, err =3D -ENOMEM; } else err =3D vmemmap_populate_basepages(start, end, node, NULL); - if (!err) - sync_global_pgds(start, end - 1); return err; } =20 --=20 2.43.0