mm/page_alloc.c | 2 ++ 1 file changed, 2 insertions(+)
The bulk allocation path in alloc_pages_bulk_noprof() currently misses
trace_mm_page_alloc() and kmsan_alloc_page() calls, leaving bulk-allocated
pages invisible to ftrace/BPF/perf and leaving KMSAN shadow memory stale.
Add both calls in the bulk loop to match the standard allocation path,
placing them before set_page_refcounted() for consistency. The gfp mask
passed to kmsan_alloc_page() is stripped of __GFP_RECLAIM because the
bulk loop runs under the PCP spinlock, and KMSAN's stack depot allocation
must not sleep.
Both are no-ops when their respective features are disabled, so there
is no overhead in production kernels.
Suggested-by: Gregory Price <gourry@gourry.net>
Signed-off-by: Qiqi Liu <liuqiqi@kylinos.cn>
---
mm/page_alloc.c | 2 ++
1 file changed, 2 insertions(+)
diff --git a/mm/page_alloc.c b/mm/page_alloc.c
index 12fac9084c48..eac419eef697 100644
--- a/mm/page_alloc.c
+++ b/mm/page_alloc.c
@@ -5279,6 +5279,8 @@ unsigned long alloc_pages_bulk_noprof(gfp_t gfp, int preferred_nid,
nr_account++;
prep_new_page(page, 0, gfp, ALLOC_DEFAULT);
+ trace_mm_page_alloc(page, 0, gfp, ac.migratetype);
+ kmsan_alloc_page(page, 0, gfp & ~__GFP_RECLAIM);
set_page_refcounted(page);
page_array[nr_populated++] = page;
}
--
2.25.1
On Tue Sep 8, 2026 at 6:23 AM EDT, Qiqi Liu wrote: > The bulk allocation path in alloc_pages_bulk_noprof() currently misses > trace_mm_page_alloc() and kmsan_alloc_page() calls, leaving bulk-allocated > pages invisible to ftrace/BPF/perf and leaving KMSAN shadow memory stale. > > Add both calls in the bulk loop to match the standard allocation path, > placing them before set_page_refcounted() for consistency. The gfp mask > passed to kmsan_alloc_page() is stripped of __GFP_RECLAIM because the > bulk loop runs under the PCP spinlock, and KMSAN's stack depot allocation > must not sleep. > > Both are no-ops when their respective features are disabled, so there > is no overhead in production kernels. > > Suggested-by: Gregory Price <gourry@gourry.net> > Signed-off-by: Qiqi Liu <liuqiqi@kylinos.cn> > --- > mm/page_alloc.c | 2 ++ > 1 file changed, 2 insertions(+) > LGTM. Reviewed-by: Zi Yan <ziy@nvidia.com> BTW, please send new versions in a new thread instead of replying to the old one. Thanks. -- Best Regards, Yan, Zi
On Tue, Sep 08, 2026 at 06:23:56PM +0800, Qiqi Liu wrote: > The bulk allocation path in alloc_pages_bulk_noprof() currently misses > trace_mm_page_alloc() and kmsan_alloc_page() calls, leaving bulk-allocated > pages invisible to ftrace/BPF/perf and leaving KMSAN shadow memory stale. > > Add both calls in the bulk loop to match the standard allocation path, > placing them before set_page_refcounted() for consistency. The gfp mask > passed to kmsan_alloc_page() is stripped of __GFP_RECLAIM because the > bulk loop runs under the PCP spinlock, and KMSAN's stack depot allocation > must not sleep. > > Both are no-ops when their respective features are disabled, so there > is no overhead in production kernels. > > Suggested-by: Gregory Price <gourry@gourry.net> > Signed-off-by: Qiqi Liu <liuqiqi@kylinos.cn> Thanks! Reviewed-by: Gregory Price (Meta) <gourry@gourry.net>
On 9/8/26 12:23, Qiqi Liu wrote: > The bulk allocation path in alloc_pages_bulk_noprof() currently misses > trace_mm_page_alloc() and kmsan_alloc_page() calls, leaving bulk-allocated > pages invisible to ftrace/BPF/perf and leaving KMSAN shadow memory stale. > > Add both calls in the bulk loop to match the standard allocation path, > placing them before set_page_refcounted() for consistency. The gfp mask > passed to kmsan_alloc_page() is stripped of __GFP_RECLAIM because the > bulk loop runs under the PCP spinlock, and KMSAN's stack depot allocation > must not sleep. > > Both are no-ops when their respective features are disabled, so there > is no overhead in production kernels. > > Suggested-by: Gregory Price <gourry@gourry.net> > Signed-off-by: Qiqi Liu <liuqiqi@kylinos.cn> Reviewed-by: Vlastimil Babka (SUSE) <vbabka@kernel.org> > --- > mm/page_alloc.c | 2 ++ > 1 file changed, 2 insertions(+) > > diff --git a/mm/page_alloc.c b/mm/page_alloc.c > index 12fac9084c48..eac419eef697 100644 > --- a/mm/page_alloc.c > +++ b/mm/page_alloc.c > @@ -5279,6 +5279,8 @@ unsigned long alloc_pages_bulk_noprof(gfp_t gfp, int preferred_nid, > nr_account++; > > prep_new_page(page, 0, gfp, ALLOC_DEFAULT); > + trace_mm_page_alloc(page, 0, gfp, ac.migratetype); > + kmsan_alloc_page(page, 0, gfp & ~__GFP_RECLAIM); > set_page_refcounted(page); > page_array[nr_populated++] = page; > }
© 2016 - 2026 Red Hat, Inc.