From nobody Mon Feb 9 10:47:54 2026 Received: from mail-pf1-f175.google.com (mail-pf1-f175.google.com [209.85.210.175]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 77C8B2EF665 for ; Sun, 25 Jan 2026 17:58:10 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.210.175 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1769363891; cv=none; b=rANIQUjijvJv9dnoScytmgdan2NnZ+96wPiDSa5peC4ARzqym1r6fnk+ZHb0D/7toRipsU+5uBDjHs/hkcIqmTfV73YWzuauaCOS3cOBHCR2D/hzHH5KXrKHEbcWSIZ+wpbY1dct/ybNp0GtOKnhgVHM/umvQU/HuXdcoWbchyI= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1769363891; c=relaxed/simple; bh=kO89w4TSJX4bByAX1RSmDOrEA4P5dAaQCy7BjrZ/M2M=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=o8+p7NBD1j0Mi8xM8xyKifvzV4jG1zyeS3mAGDfSFfPc8YW8JKCtwX6S3Lk+G3rOLzLIJrxBdkVrnmyPSedi8nBAAy+ATlEyDXC+l3G+y0sjHRRqjx1wqfgzjXv7BIqkaql0c0KZXzCBun7MD+3TXx5AQ4l7xjaIW+lbpbGKr6Q= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=B/+vyksR; arc=none smtp.client-ip=209.85.210.175 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="B/+vyksR" Received: by mail-pf1-f175.google.com with SMTP id d2e1a72fcca58-81e8a9d521dso2208901b3a.2 for ; Sun, 25 Jan 2026 09:58:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1769363890; x=1769968690; darn=vger.kernel.org; h=cc:to:in-reply-to:references:message-id:content-transfer-encoding :mime-version:subject:date:from:from:to:cc:subject:date:message-id :reply-to; bh=jHlSAs5DuvtfLFcO72y/SZVl/BNUOfJD+/3/mENU6eI=; b=B/+vyksRQvP3nVL9wBTgTfPbRoiWiCFeWG4hTrto7P8G+zNoQTq2sOFVCrnkeYbJHQ Slo51OLPniGvowo3Z5/2cY4aG9dm4KNkfAtQNCYe3YFL5USxYgl4wKhmEffW+H3GR/Qo 4WdcQN/0pelEJNfsI1l0Qsjx0i1fimydXHu/8/Y7oKkgxEeU592skxd68t91ieAbLkiK tcTB99MZdQ/1e8Pibr9giANnPbS5iYYAdlU0hSQ8jXwZS323y5XbDWXKlWGfpYG5DsQ1 S+NIK78idyEXpPoIQfxcb25qbVJ853FM+CJgOKIojfJkcvOBwTcjJSCCj3NjkQ1beCPR Npyw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1769363890; x=1769968690; h=cc:to:in-reply-to:references:message-id:content-transfer-encoding :mime-version:subject:date:from:x-gm-gg:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=jHlSAs5DuvtfLFcO72y/SZVl/BNUOfJD+/3/mENU6eI=; b=SenVXpBRCGDxo6uOHxFSzIhaUcruihVKBgj93QmQU+N5vbA7Bjc8W+N54ge/P1Mu4d rtpSyI0+UtJckvv1vziJbvXfDu3CG9Bi184uLMBdilMJtSQP8TBir4LI3JF+OQUyv35T ebX2hWF+SSpF25EoJBQ3n+0PucDfAG9WkkS9tlxTa1dcwoxTkpJG7spzw4OBCCN3D2Ax FZfKAfGqwRM7HmAgj384dXHYatsOMBBZ5cXggxYxmsZEg98TViqkRDclyrL/22sZsye4 PSb1vbn7/HzOSsQPyQTRFl0DH8DbqBFJgHmBcf6XyTfKf2a8sLIdtBwJgNLHCPBHNf5t w+mg== X-Forwarded-Encrypted: i=1; AJvYcCW9u7jWOIiQnLSj4tL05GMQYSi/RzOoOcRbg+V3y5P7jOc+f8ZfLkS1c7QQP1C2VJmzTy/H7i75VmxoN9s=@vger.kernel.org X-Gm-Message-State: AOJu0Yy3jRQoBOYPqw7/0TDzHGunwHWbVUlEQIwryaC/crQFG4Ngj8/4 nJYaJPXWJH38TXlX8CILPY21WSeDQoUIOQr0l4kNg0W2sV8zaOugkaVa X-Gm-Gg: AZuq6aKxdR3mqeMgYC5ngtMAYMv+MHj3zaB5dnwtxWtMoKzIAr3F7Ygepp3GJEf6tsS +Qc9+psDpbCd2ibnB9ZDUP9r+CRDOJyH6m7dO6EWBZZS521GmF6P55K2KMWi3tjNpytX9vPCUc0 kHbuPFEA39Pf02KXWrzHitw/+9yVQeacji4V1L7HoS/GryDmxdGanW2a5d8iKLoWnQqB/tCm4Tm dx5rCOcFf1y1phYT0+jk8lPezT25x6GqAKSB0ukEe86AObL2/vPAkCih159YDMpWeYkUN2qW1f9 v3UUWMCy1ovjSQDdrva9Lfhhn40Cne3cUl7its55XVQApk4b8u8s5ieGEA2dGdJVlSotGgHpGWX 6z3bqbecZR2lRg90ZHjYoHdQqPnYoOpsd5mDlb5hM4drgltQRb1udYonAUEdEmxEhYef+dRNLpx MrVO3VGvkm6P0oGnZvxopJqe3/HERcANaMXL9TnQNyvI6+K3A6Y8r7uBtsKYM= X-Received: by 2002:aa7:88c6:0:b0:81d:d666:72e1 with SMTP id d2e1a72fcca58-823411e00b6mr1765829b3a.10.1769363889653; Sun, 25 Jan 2026 09:58:09 -0800 (PST) Received: from [127.0.0.1] ([101.32.222.185]) by smtp.gmail.com with ESMTPSA id d2e1a72fcca58-8231876e718sm7405963b3a.62.2026.01.25.09.58.05 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 25 Jan 2026 09:58:09 -0800 (PST) From: Kairui Song Date: Mon, 26 Jan 2026 01:57:25 +0800 Subject: [PATCH 02/12] mm, swap: clean up swapon process and locking Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <20260126-swap-table-p3-v1-2-a74155fab9b0@tencent.com> References: <20260126-swap-table-p3-v1-0-a74155fab9b0@tencent.com> In-Reply-To: <20260126-swap-table-p3-v1-0-a74155fab9b0@tencent.com> To: linux-mm@kvack.org Cc: Andrew Morton , Kemeng Shi , Nhat Pham , Baoquan He , Barry Song , Johannes Weiner , David Hildenbrand , Lorenzo Stoakes , linux-kernel@vger.kernel.org, Chris Li , Kairui Song X-Mailer: b4 0.14.3 X-Developer-Signature: v=1; a=ed25519-sha256; t=1769363877; l=8467; i=kasong@tencent.com; s=kasong-sign-tencent; h=from:subject:message-id; bh=GJOWST4EwFrMORO0TdNo6OHVZqB7RqYtXfEdQQZxN/s=; b=1+Q0vMwGlsfOLBPgZnFYykSZjHWaTml+SZM7kwZ5syYpPD+PnO8XuyTJXA8RNo2mdHC+SJ0hj soclkuBW5DXDg7uHf8r+yXfzeah0MBi6BWWAr3uvZo7zxtFLbxbMiri X-Developer-Key: i=kasong@tencent.com; a=ed25519; pk=kCdoBuwrYph+KrkJnrr7Sm1pwwhGDdZKcKrqiK8Y1mI= From: Kairui Song Slightly clean up the swapon process. Add comments about what swap_lock protects, introduce and rename helpers that wrap swap_map and cluster_info setup, and do it outside of the swap_lock lock. This lock protection is not needed for swap_map and cluster_info setup because all swap users must either hold the percpu ref or hold a stable allocated swap entry (e.g., locking a folio in the swap cache) before accessing. So before the swap device is exposed by enable_swap_info, nothing would use the swap device's map or cluster. So we are safe to allocate and set up swap data freely first, then expose the swap device and set the SWP_WRITEOK flag. Signed-off-by: Kairui Song --- mm/swapfile.c | 87 ++++++++++++++++++++++++++++++++-----------------------= ---- 1 file changed, 48 insertions(+), 39 deletions(-) diff --git a/mm/swapfile.c b/mm/swapfile.c index 521f7713a7c3..53ce222c3aba 100644 --- a/mm/swapfile.c +++ b/mm/swapfile.c @@ -65,6 +65,13 @@ static void move_cluster(struct swap_info_struct *si, struct swap_cluster_info *ci, struct list_head *list, enum swap_cluster_flags new_flags); =20 +/* + * Protects the swap_info array, and the SWP_USED flag. swap_info contains + * lazily allocated & freed swap device info struts, and SWP_USED indicates + * which device is used, ~SWP_USED devices and can be reused. + * + * Also protects swap_active_head total_swap_pages, and the SWP_WRITEOK fl= ag. + */ static DEFINE_SPINLOCK(swap_lock); static unsigned int nr_swapfiles; atomic_long_t nr_swap_pages; @@ -2646,8 +2653,6 @@ static int setup_swap_extents(struct swap_info_struct= *sis, } =20 static void setup_swap_info(struct swap_info_struct *si, int prio, - unsigned char *swap_map, - struct swap_cluster_info *cluster_info, unsigned long *zeromap) { si->prio =3D prio; @@ -2657,8 +2662,6 @@ static void setup_swap_info(struct swap_info_struct *= si, int prio, */ si->list.prio =3D -si->prio; si->avail_list.prio =3D -si->prio; - si->swap_map =3D swap_map; - si->cluster_info =3D cluster_info; si->zeromap =3D zeromap; } =20 @@ -2676,13 +2679,11 @@ static void _enable_swap_info(struct swap_info_stru= ct *si) } =20 static void enable_swap_info(struct swap_info_struct *si, int prio, - unsigned char *swap_map, - struct swap_cluster_info *cluster_info, - unsigned long *zeromap) + unsigned long *zeromap) { spin_lock(&swap_lock); spin_lock(&si->lock); - setup_swap_info(si, prio, swap_map, cluster_info, zeromap); + setup_swap_info(si, prio, zeromap); spin_unlock(&si->lock); spin_unlock(&swap_lock); /* @@ -2700,7 +2701,7 @@ static void reinsert_swap_info(struct swap_info_struc= t *si) { spin_lock(&swap_lock); spin_lock(&si->lock); - setup_swap_info(si, si->prio, si->swap_map, si->cluster_info, si->zeromap= ); + setup_swap_info(si, si->prio, si->zeromap); _enable_swap_info(si); spin_unlock(&si->lock); spin_unlock(&swap_lock); @@ -2724,8 +2725,8 @@ static void wait_for_allocation(struct swap_info_stru= ct *si) } } =20 -static void free_cluster_info(struct swap_cluster_info *cluster_info, - unsigned long maxpages) +static void free_swap_cluster_info(struct swap_cluster_info *cluster_info, + unsigned long maxpages) { struct swap_cluster_info *ci; int i, nr_clusters =3D DIV_ROUND_UP(maxpages, SWAPFILE_CLUSTER); @@ -2883,7 +2884,7 @@ SYSCALL_DEFINE1(swapoff, const char __user *, special= file) p->global_cluster =3D NULL; vfree(swap_map); kvfree(zeromap); - free_cluster_info(cluster_info, maxpages); + free_swap_cluster_info(cluster_info, maxpages); /* Destroy swap account information */ swap_cgroup_swapoff(p->type); =20 @@ -3232,10 +3233,15 @@ static unsigned long read_swap_header(struct swap_i= nfo_struct *si, =20 static int setup_swap_map(struct swap_info_struct *si, union swap_header *swap_header, - unsigned char *swap_map, unsigned long maxpages) { unsigned long i; + unsigned char *swap_map; + + swap_map =3D vzalloc(maxpages); + si->swap_map =3D swap_map; + if (!swap_map) + return -ENOMEM; =20 swap_map[0] =3D SWAP_MAP_BAD; /* omit header page */ for (i =3D 0; i < swap_header->info.nr_badpages; i++) { @@ -3256,9 +3262,9 @@ static int setup_swap_map(struct swap_info_struct *si, return 0; } =20 -static struct swap_cluster_info *setup_clusters(struct swap_info_struct *s= i, - union swap_header *swap_header, - unsigned long maxpages) +static int setup_swap_clusters_info(struct swap_info_struct *si, + union swap_header *swap_header, + unsigned long maxpages) { unsigned long nr_clusters =3D DIV_ROUND_UP(maxpages, SWAPFILE_CLUSTER); struct swap_cluster_info *cluster_info; @@ -3328,10 +3334,11 @@ static struct swap_cluster_info *setup_clusters(str= uct swap_info_struct *si, } } =20 - return cluster_info; + si->cluster_info =3D cluster_info; + return 0; err: - free_cluster_info(cluster_info, maxpages); - return ERR_PTR(err); + free_swap_cluster_info(cluster_info, maxpages); + return err; } =20 SYSCALL_DEFINE2(swapon, const char __user *, specialfile, int, swap_flags) @@ -3347,9 +3354,7 @@ SYSCALL_DEFINE2(swapon, const char __user *, specialf= ile, int, swap_flags) int nr_extents; sector_t span; unsigned long maxpages; - unsigned char *swap_map =3D NULL; unsigned long *zeromap =3D NULL; - struct swap_cluster_info *cluster_info =3D NULL; struct folio *folio =3D NULL; struct inode *inode =3D NULL; bool inced_nr_rotate_swap =3D false; @@ -3360,6 +3365,11 @@ SYSCALL_DEFINE2(swapon, const char __user *, special= file, int, swap_flags) if (!capable(CAP_SYS_ADMIN)) return -EPERM; =20 + /* + * Allocate or reuse existing !SWP_USED swap_info. The returned + * si will stay in a dying status, so nothing will access its content + * until enable_swap_info resurrects its percpu ref and expose it. + */ si =3D alloc_swap_info(); if (IS_ERR(si)) return PTR_ERR(si); @@ -3442,18 +3452,17 @@ SYSCALL_DEFINE2(swapon, const char __user *, specia= lfile, int, swap_flags) =20 maxpages =3D si->max; =20 - /* OK, set up the swap map and apply the bad block list */ - swap_map =3D vzalloc(maxpages); - if (!swap_map) { - error =3D -ENOMEM; + /* Setup the swap map and apply bad block */ + error =3D setup_swap_map(si, swap_header, maxpages); + if (error) goto bad_swap_unlock_inode; - } =20 - error =3D swap_cgroup_swapon(si->type, maxpages); + /* Set up the swap cluster info */ + error =3D setup_swap_clusters_info(si, swap_header, maxpages); if (error) goto bad_swap_unlock_inode; =20 - error =3D setup_swap_map(si, swap_header, swap_map, maxpages); + error =3D swap_cgroup_swapon(si->type, maxpages); if (error) goto bad_swap_unlock_inode; =20 @@ -3481,13 +3490,6 @@ SYSCALL_DEFINE2(swapon, const char __user *, special= file, int, swap_flags) inced_nr_rotate_swap =3D true; } =20 - cluster_info =3D setup_clusters(si, swap_header, maxpages); - if (IS_ERR(cluster_info)) { - error =3D PTR_ERR(cluster_info); - cluster_info =3D NULL; - goto bad_swap_unlock_inode; - } - if ((swap_flags & SWAP_FLAG_DISCARD) && si->bdev && bdev_max_discard_sectors(si->bdev)) { /* @@ -3540,7 +3542,9 @@ SYSCALL_DEFINE2(swapon, const char __user *, specialf= ile, int, swap_flags) prio =3D swap_flags & SWAP_FLAG_PRIO_MASK; =20 si->swap_file =3D swap_file; - enable_swap_info(si, prio, swap_map, cluster_info, zeromap); + + /* Sets SWP_WRITEOK, resurrect the percpu ref, expose the swap device */ + enable_swap_info(si, prio, zeromap); =20 pr_info("Adding %uk swap on %s. Priority:%d extents:%d across:%lluk %s%s= %s%s\n", K(si->pages), name->name, si->prio, nr_extents, @@ -3566,13 +3570,18 @@ SYSCALL_DEFINE2(swapon, const char __user *, specia= lfile, int, swap_flags) inode =3D NULL; destroy_swap_extents(si, swap_file); swap_cgroup_swapoff(si->type); + vfree(si->swap_map); + si->swap_map =3D NULL; + free_swap_cluster_info(si->cluster_info, si->max); + si->cluster_info =3D NULL; + /* + * Clear the SWP_USED flag after all resources are freed so + * alloc_swap_info can reuse this si safely. + */ spin_lock(&swap_lock); si->flags =3D 0; spin_unlock(&swap_lock); - vfree(swap_map); kvfree(zeromap); - if (cluster_info) - free_cluster_info(cluster_info, maxpages); if (inced_nr_rotate_swap) atomic_dec(&nr_rotate_swap); if (swap_file) --=20 2.52.0