include/linux/damon.h | 1 + mm/damon/core.c | 45 ++++++++++++++----------------------------- 2 files changed, 15 insertions(+), 31 deletions(-)
When kdamond_fn() main loop is finished, the function cancels all
remaining damon_call() requests and unset the damon_ctx->kdamond so that
API callers can show the context is terminated. damon_call() adds the
caller's request to the queue first. After that, it shows if the
kdamond of the damon_ctx is still running (damon_ctx->kdamond is set).
Only if the kdamond is running, damon_call() starts waiting for the
kdamond's handling of the newly added request.
The damon_call() requests registration and damon_ctx->kdamond unset are
protected by different mutexes, though. Hence, damon_call() could race
with damon_ctx->kdamond unset, and result in deadlocks.
For example, let's suppose kdamond successfully finished the
damon_call() requests cancelling. Right after that, damon_call() is
called for the context. It registers the new request, and shows the
context is still running, because damon_ctx->kdamond unset is not yet
done. Hence the damon_call() caller starts waiting for the handling of
the request. However, the kdamond is already on the termination steps,
so it never handles the new request. As a result, the damon_call()
caller threads infinitely waits.
Fix this by introducing another damon_ctx field, namely
call_controls_obsolete. It is protected by the
damon_ctx->call_controls_lock, which protects damon_call() registration.
Initialize (unset) it in kdamond_init_ctx() and set it just before the
cancelling of remaining damon_call() is executed. damon_call() reads
the obsolete field under the lock and avoids adding a new request.
After this change, only requests that are guaranteed to be handled or
cancelled are registered. Hence the after-registration DAMON context
termination check is no longer needed. Remove it together.
The issue is found by sashiko [1].
[1] https://lore.kernel.org/20260325141956.87144-1-sj@kernel.org
Fixes: 42b7491af14c ("mm/damon/core: introduce damon_call()")
Cc: <stable@vger.kernel.org> # 6.14.x
Signed-off-by: SeongJae Park <sj@kernel.org>
---
Changes from RFC v1
(https://lore.kernel.org/20260326062347.88569-3-sj@kernel.org)
- Clarify damon_call() call condition.
- Init call_controls_obsolete before kdamond_started completion.
- Wordsmith commit message.
include/linux/damon.h | 1 +
mm/damon/core.c | 45 ++++++++++++++-----------------------------
2 files changed, 15 insertions(+), 31 deletions(-)
diff --git a/include/linux/damon.h b/include/linux/damon.h
index d9a3babbafc1..5129de70e7b7 100644
--- a/include/linux/damon.h
+++ b/include/linux/damon.h
@@ -818,6 +818,7 @@ struct damon_ctx {
/* lists of &struct damon_call_control */
struct list_head call_controls;
+ bool call_controls_obsolete;
struct mutex call_controls_lock;
struct damos_walk_control *walk_control;
diff --git a/mm/damon/core.c b/mm/damon/core.c
index db6c67e52d2b..1e8fce6a2a96 100644
--- a/mm/damon/core.c
+++ b/mm/damon/core.c
@@ -1573,35 +1573,6 @@ int damon_kdamond_pid(struct damon_ctx *ctx)
return pid;
}
-/*
- * damon_call_handle_inactive_ctx() - handle DAMON call request that added to
- * an inactive context.
- * @ctx: The inactive DAMON context.
- * @control: Control variable of the call request.
- *
- * This function is called in a case that @control is added to @ctx but @ctx is
- * not running (inactive). See if @ctx handled @control or not, and cleanup
- * @control if it was not handled.
- *
- * Returns 0 if @control was handled by @ctx, negative error code otherwise.
- */
-static int damon_call_handle_inactive_ctx(
- struct damon_ctx *ctx, struct damon_call_control *control)
-{
- struct damon_call_control *c;
-
- mutex_lock(&ctx->call_controls_lock);
- list_for_each_entry(c, &ctx->call_controls, list) {
- if (c == control) {
- list_del(&control->list);
- mutex_unlock(&ctx->call_controls_lock);
- return -EINVAL;
- }
- }
- mutex_unlock(&ctx->call_controls_lock);
- return 0;
-}
-
/**
* damon_call() - Invoke a given function on DAMON worker thread (kdamond).
* @ctx: DAMON context to call the function for.
@@ -1619,6 +1590,10 @@ static int damon_call_handle_inactive_ctx(
* synchronization. The return value of the function will be saved in
* &damon_call_control->return_code.
*
+ * Note that this function should be called only after damon_start() with the
+ * @ctx has succeed. Otherwise, this function could fall into an indefinite
+ * wait.
+ *
* Return: 0 on success, negative error code otherwise.
*/
int damon_call(struct damon_ctx *ctx, struct damon_call_control *control)
@@ -1629,10 +1604,12 @@ int damon_call(struct damon_ctx *ctx, struct damon_call_control *control)
INIT_LIST_HEAD(&control->list);
mutex_lock(&ctx->call_controls_lock);
+ if (ctx->call_controls_obsolete) {
+ mutex_unlock(&ctx->call_controls_lock);
+ return -ECANCELED;
+ }
list_add_tail(&control->list, &ctx->call_controls);
mutex_unlock(&ctx->call_controls_lock);
- if (!damon_is_running(ctx))
- return damon_call_handle_inactive_ctx(ctx, control);
if (control->repeat)
return 0;
wait_for_completion(&control->completion);
@@ -2952,6 +2929,9 @@ static int kdamond_fn(void *data)
pr_debug("kdamond (%d) starts\n", current->pid);
+ mutex_lock(&ctx->call_controls_lock);
+ ctx->call_controls_obsolete = false;
+ mutex_unlock(&ctx->call_controls_lock);
complete(&ctx->kdamond_started);
kdamond_init_ctx(ctx);
@@ -3062,6 +3042,9 @@ static int kdamond_fn(void *data)
damon_destroy_targets(ctx);
kfree(ctx->regions_score_histogram);
+ mutex_lock(&ctx->call_controls_lock);
+ ctx->call_controls_obsolete = true;
+ mutex_unlock(&ctx->call_controls_lock);
kdamond_call(ctx, true);
damos_walk_cancel(ctx);
base-commit: 871ee9fc2ebebaa1fa26d4a266ebdf36252b53cf
--
2.47.3
On Thu, 26 Mar 2026 17:49:51 -0700 SeongJae Park <sj@kernel.org> wrote: > When kdamond_fn() main loop is finished, the function cancels all > remaining damon_call() requests and unset the damon_ctx->kdamond so that > API callers can show the context is terminated. damon_call() adds the > caller's request to the queue first. After that, it shows if the > kdamond of the damon_ctx is still running (damon_ctx->kdamond is set). > Only if the kdamond is running, damon_call() starts waiting for the > kdamond's handling of the newly added request. > > The damon_call() requests registration and damon_ctx->kdamond unset are > protected by different mutexes, though. Hence, damon_call() could race > with damon_ctx->kdamond unset, and result in deadlocks. > > For example, let's suppose kdamond successfully finished the > damon_call() requests cancelling. Right after that, damon_call() is > called for the context. It registers the new request, and shows the > context is still running, because damon_ctx->kdamond unset is not yet > done. Hence the damon_call() caller starts waiting for the handling of > the request. However, the kdamond is already on the termination steps, > so it never handles the new request. As a result, the damon_call() > caller threads infinitely waits. > > Fix this by introducing another damon_ctx field, namely > call_controls_obsolete. It is protected by the > damon_ctx->call_controls_lock, which protects damon_call() registration. > Initialize (unset) it in kdamond_init_ctx() In this veersion, I updated the initialization to be done in kdamond_fn() before the damon_started completion. But I forgot updating the above sentence. I will make the update in the next version. Thanks, SJ [...]
Forwarding Sashiko review for doing discussions via mails. # review url: https://sashiko.dev/#/patchset/20260327004952.58266-1-sj@kernel.org # start of sashiko.dev inline review commit 36b78ee39968830aca3d375219a2cfce73d0d1d0 Author: SeongJae Park <sj@kernel.org> mm/damon/core: fix damon_call() vs kdamond_fn() exit race deadlock This commit fixes a race condition between damon_call and the kdamond_fn exit path that could result in a deadlock. It introduces a call_controls_obsolete flag to prevent damon_call from waiting indefinitely for a terminating thread. Link: https://lore.kernel.org/20260325141956.87144-1-sj@kernel.org > diff --git a/mm/damon/core.c b/mm/damon/core.c > --- a/mm/damon/core.c > +++ b/mm/damon/core.c [ ... ] > @@ -3062,6 +3042,9 @@ static int kdamond_fn(void *data) > damon_destroy_targets(ctx); > > kfree(ctx->regions_score_histogram); > + mutex_lock(&ctx->call_controls_lock); > + ctx->call_controls_obsolete = true; > + mutex_unlock(&ctx->call_controls_lock); > kdamond_call(ctx, true); > damos_walk_cancel(ctx); Does damos_walk suffer from the same exit race regression that this patch fixes for damon_call? In kdamond_fn, the thread termination sequence executes damos_walk_cancel and only later sets ctx->kdamond = NULL under the kdamond_lock. damos_walk appears to use the same pattern as the old damon_call where it registers ctx->walk_control, checks damon_is_running (which verifies ctx->kdamond != NULL), and then unconditionally blocks on wait_for_completion. If a user triggers a DAMOS walk in the exact window after damos_walk_cancel has finished but before ctx->kdamond = NULL is executed, wouldn't damos_walk successfully register its control and pass the damon_is_running check? If so, it would then block indefinitely on wait_for_completion because the cancellation phase has already passed and the thread is exiting. Because damos_walk is invoked via state_store with the global damon_sysfs_lock held, could this infinite wait block the entire DAMON sysfs interface for all users on the system? # end of sashiko.dev inline review # review url: https://sashiko.dev/#/patchset/20260327004952.58266-1-sj@kernel.org # # hkml [1] generated a draft of this mail. It can be regenerated # using below command: # # hkml patch sashiko_dev --for_forwarding \ # 20260327004952.58266-1-sj@kernel.org # # [1] https://github.com/sjp38/hackermail Sent using hkml (https://github.com/sjp38/hackermail)
On Thu, 26 Mar 2026 19:15:45 -0700 SeongJae Park <sj@kernel.org> wrote: > Forwarding Sashiko review for doing discussions via mails. > > # review url: https://sashiko.dev/#/patchset/20260327004952.58266-1-sj@kernel.org > # start of sashiko.dev inline review > commit 36b78ee39968830aca3d375219a2cfce73d0d1d0 > Author: SeongJae Park <sj@kernel.org> > > mm/damon/core: fix damon_call() vs kdamond_fn() exit race deadlock > > This commit fixes a race condition between damon_call and the > kdamond_fn exit path that could result in a deadlock. It introduces a > call_controls_obsolete flag to prevent damon_call from waiting > indefinitely for a terminating thread. > > Link: https://lore.kernel.org/20260325141956.87144-1-sj@kernel.org > > > diff --git a/mm/damon/core.c b/mm/damon/core.c > > --- a/mm/damon/core.c > > +++ b/mm/damon/core.c > > [ ... ] > > > @@ -3062,6 +3042,9 @@ static int kdamond_fn(void *data) > > damon_destroy_targets(ctx); > > > > kfree(ctx->regions_score_histogram); > > + mutex_lock(&ctx->call_controls_lock); > > + ctx->call_controls_obsolete = true; > > + mutex_unlock(&ctx->call_controls_lock); > > kdamond_call(ctx, true); > > damos_walk_cancel(ctx); > > Does damos_walk suffer from the same exit race regression that this patch > fixes for damon_call? > > In kdamond_fn, the thread termination sequence executes damos_walk_cancel > and only later sets ctx->kdamond = NULL under the kdamond_lock. > > damos_walk appears to use the same pattern as the old damon_call where it > registers ctx->walk_control, checks damon_is_running (which verifies > ctx->kdamond != NULL), and then unconditionally blocks on wait_for_completion. > > If a user triggers a DAMOS walk in the exact window after damos_walk_cancel > has finished but before ctx->kdamond = NULL is executed, wouldn't damos_walk > successfully register its control and pass the damon_is_running check? > > If so, it would then block indefinitely on wait_for_completion because the > cancellation phase has already passed and the thread is exiting. > > Because damos_walk is invoked via state_store with the global > damon_sysfs_lock held, could this infinite wait block the entire DAMON sysfs > interface for all users on the system? Yes, and I'm working on it separately, as I also replied [1] to the previous version. [1] https://lore.kernel.org/20260326135146.90670-1-sj@kernel.org Thanks, SJ [...]
On Thu, 26 Mar 2026 19:20:13 -0700 SeongJae Park <sj@kernel.org> wrote: > On Thu, 26 Mar 2026 19:15:45 -0700 SeongJae Park <sj@kernel.org> wrote: > > > Forwarding Sashiko review for doing discussions via mails. > > > > # review url: https://sashiko.dev/#/patchset/20260327004952.58266-1-sj@kernel.org > > # start of sashiko.dev inline review > > commit 36b78ee39968830aca3d375219a2cfce73d0d1d0 > > Author: SeongJae Park <sj@kernel.org> > > > > mm/damon/core: fix damon_call() vs kdamond_fn() exit race deadlock > > > > This commit fixes a race condition between damon_call and the > > kdamond_fn exit path that could result in a deadlock. It introduces a > > call_controls_obsolete flag to prevent damon_call from waiting > > indefinitely for a terminating thread. > > > > Link: https://lore.kernel.org/20260325141956.87144-1-sj@kernel.org > > > > > diff --git a/mm/damon/core.c b/mm/damon/core.c > > > --- a/mm/damon/core.c > > > +++ b/mm/damon/core.c > > > > [ ... ] > > > > > @@ -3062,6 +3042,9 @@ static int kdamond_fn(void *data) > > > damon_destroy_targets(ctx); > > > > > > kfree(ctx->regions_score_histogram); > > > + mutex_lock(&ctx->call_controls_lock); > > > + ctx->call_controls_obsolete = true; > > > + mutex_unlock(&ctx->call_controls_lock); > > > kdamond_call(ctx, true); > > > damos_walk_cancel(ctx); > > > > Does damos_walk suffer from the same exit race regression that this patch > > fixes for damon_call? > > > > In kdamond_fn, the thread termination sequence executes damos_walk_cancel > > and only later sets ctx->kdamond = NULL under the kdamond_lock. > > > > damos_walk appears to use the same pattern as the old damon_call where it > > registers ctx->walk_control, checks damon_is_running (which verifies > > ctx->kdamond != NULL), and then unconditionally blocks on wait_for_completion. > > > > If a user triggers a DAMOS walk in the exact window after damos_walk_cancel > > has finished but before ctx->kdamond = NULL is executed, wouldn't damos_walk > > successfully register its control and pass the damon_is_running check? > > > > If so, it would then block indefinitely on wait_for_completion because the > > cancellation phase has already passed and the thread is exiting. > > > > Because damos_walk is invoked via state_store with the global > > damon_sysfs_lock held, could this infinite wait block the entire DAMON sysfs > > interface for all users on the system? > > Yes, and I'm working on it separately, as I also replied [1] to the previous > version. Maybe I will make the next version of this patch as a series of two patches, one for this one and the other one for the damos_walk() race fix. > > [1] https://lore.kernel.org/20260326135146.90670-1-sj@kernel.org Thanks, SJ [...]
© 2016 - 2026 Red Hat, Inc.