From nobody Sat Nov 23 08:44:02 2024 Received: from mail-qv1-f41.google.com (mail-qv1-f41.google.com [209.85.219.41]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 598DC201279 for ; Wed, 13 Nov 2024 14:28:01 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.219.41 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1731508084; cv=none; b=oScFnWzQ+sypUkzhCs/12Ba7UP73rtG3/y76P+oQPdPD8lmzh5Dyh7hNXKMfBN5B67Tqmh6DLTlHZqCXhLeDSsMDMfiXrg10vseki20R/IdjdG4XlnIb7gKJvNxmXCYVJL4DvQQtEtf8MpAjjRrPlrDsrDjXxlFh26SY34b36lc= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1731508084; c=relaxed/simple; bh=7Eni9NORmKjkt8SWZ+OGibbslnMQLpddsvCL8STPwwo=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=HWLk/nknH5dwhhwInpCOGA88sNgFqW2GoC4E/LLyJ4OCGO0YRUEcFAMzhMql9k7hOOADJHPmOZaFc2CZ1zT6nQv9NnwKOAdwSJCghtpZY7eoK4eE+z5ITspeT4DYlrT8s8lJ432Ym7MkLK2RF6aBfWctQzri0rnxM2opz3OAG90= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=broadcom.com; spf=fail smtp.mailfrom=broadcom.com; dkim=pass (1024-bit key) header.d=broadcom.com header.i=@broadcom.com header.b=G5aqhW3D; arc=none smtp.client-ip=209.85.219.41 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=broadcom.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=broadcom.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=broadcom.com header.i=@broadcom.com header.b="G5aqhW3D" Received: by mail-qv1-f41.google.com with SMTP id 6a1803df08f44-6d396a6f6aaso50318656d6.2 for ; Wed, 13 Nov 2024 06:28:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=broadcom.com; s=google; t=1731508080; x=1732112880; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=Ani2W2ZQrBBpRmgkjhMcO9RTPfyjpQdKdikE2zOpotQ=; b=G5aqhW3DAnupYVQbz9ppwOuebVIkkxcipkPGbiGgL/tehFzdQJhadx8ptlJRx0XXLE 5uy4GaQnOMSJ7iiBLkQcef7cS/xxQYM253agatDgTZd0KIKtuwutgCXRrBM9hp1X1dJO XwLyXSH8lWdiBP+DvKxJ17VXETrQLOHjbLosE= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1731508080; x=1732112880; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=Ani2W2ZQrBBpRmgkjhMcO9RTPfyjpQdKdikE2zOpotQ=; b=fic8xKezJrQTWoJTTn0d5E+znsdLapWNCclEERlhFzeqKv2reTtSmb1lidCZV6F+vD SobslzywoFC0qPCsziAMzOEd0vjEExKwRDsA8ItvkNt20C6Jhu8oOgLI2VHu6ij7/80U 513gP5cN32FLAEvSXUgK/19/8Gf/9CSK9c/rLWCMjOlrHkChvx0w/ELfjgtyLZo9kJgT EmmtxNOda9fDi50nMdLCRkq0ZW4D1dyTshWTKVIsOUgxMV19mcMZKnLn3EkPUMPBk4PR cgTgel853Jmvf8OKL+s6UOw8O81UxNc+P3GCncTxRkjDkZp1sqlLDELfecp84LcbjsNx me+g== X-Forwarded-Encrypted: i=1; AJvYcCVsQ83Yif0lxULF/qVqPkbIZYm1NIampyMoC5c/14jYkYNEGCohmO1vhAHbSYp8MzHeLNe44xAhvmUZDlo=@vger.kernel.org X-Gm-Message-State: AOJu0YxeFTm8F8cYjgAXp8sI0xFT0w15J00S9xVluzFaVxPf0vD16H3a yq/jaycTLyhlndJ1XfFmGDYxd440mnzQ0wry7qQgd5mE+11mTFT86yxE4jE0ww== X-Google-Smtp-Source: AGHT+IEI4ykwHsoz1dNLWyvPcKgN33L/wFe+HGOnWCnxtwEzVUOCsxchyzq0ByuGvekTc9rx43TbHQ== X-Received: by 2002:a05:6214:5c07:b0:6d3:4849:1b8a with SMTP id 6a1803df08f44-6d39e14cdb2mr295420966d6.21.1731508080057; Wed, 13 Nov 2024 06:28:00 -0800 (PST) Received: from vb004028-vm1.. ([192.19.161.250]) by smtp.gmail.com with ESMTPSA id 6a1803df08f44-6d3961defe5sm85134976d6.10.2024.11.13.06.27.58 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 13 Nov 2024 06:27:59 -0800 (PST) From: Vamsi Krishna Brahmajosyula To: stable@vger.kernel.org, gregkh@linuxfoundation.org Cc: rostedt@goodmis.org, mhiramat@kernel.org, mqaio@linux.alibaba.com, namhyung.kim@lge.com, oleg@redhat.com, andrii@kernel.org, jolsa@kernel.org, sashal@kernel.org, linux-kernel@vger.kernel.org, bpf@vger.kernel.org, ajay.kaher@broadcom.com, alexey.makhalov@broadcom.com, vasavi.sirnapalli@broadcom.com, Vamsi Krishna Brahmajosyula Subject: [PATCH v6.1 1/2] uprobes: encapsulate preparation of uprobe args buffer Date: Wed, 13 Nov 2024 14:27:33 +0000 Message-Id: <20241113142734.2406886-2-vamsi-krishna.brahmajosyula@broadcom.com> X-Mailer: git-send-email 2.39.4 In-Reply-To: <20241113142734.2406886-1-vamsi-krishna.brahmajosyula@broadcom.com> References: <20241113142734.2406886-1-vamsi-krishna.brahmajosyula@broadcom.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" From: Andrii Nakryiko [ Upstream commit 3eaea21b4d27cff0017c20549aeb53034c58fc23 ] Move the logic of fetching temporary per-CPU uprobe buffer and storing uprobes args into it to a new helper function. Store data size as part of this buffer, simplifying interfaces a bit, as now we only pass single uprobe_cpu_buffer reference around, instead of pointer + dsize. This logic was duplicated across uprobe_dispatcher and uretprobe_dispatcher, and now will be centralized. All this is also in preparation to make this uprobe_cpu_buffer handling logic optional in the next patch. Link: https://lore.kernel.org/all/20240318181728.2795838-2-andrii@kernel.or= g/ [Masami: update for v6.9-rc3 kernel] Signed-off-by: Andrii Nakryiko Reviewed-by: Jiri Olsa Acked-by: Masami Hiramatsu (Google) Signed-off-by: Masami Hiramatsu (Google) Stable-dep-of: 373b9338c972 ("uprobe: avoid out-of-bounds memory access of = fetching args") Signed-off-by: Sasha Levin Signed-off-by: Vamsi Krishna Brahmajosyula --- kernel/trace/trace_uprobe.c | 79 +++++++++++++++++++------------------ 1 file changed, 41 insertions(+), 38 deletions(-) diff --git a/kernel/trace/trace_uprobe.c b/kernel/trace/trace_uprobe.c index 127c78aec17d..e09eef65d32f 100644 --- a/kernel/trace/trace_uprobe.c +++ b/kernel/trace/trace_uprobe.c @@ -858,6 +858,7 @@ static const struct file_operations uprobe_profile_ops = =3D { struct uprobe_cpu_buffer { struct mutex mutex; void *buf; + int dsize; }; static struct uprobe_cpu_buffer __percpu *uprobe_cpu_buffer; static int uprobe_buffer_refcnt; @@ -947,9 +948,26 @@ static void uprobe_buffer_put(struct uprobe_cpu_buffer= *ucb) mutex_unlock(&ucb->mutex); } =20 +static struct uprobe_cpu_buffer *prepare_uprobe_buffer(struct trace_uprobe= *tu, + struct pt_regs *regs) +{ + struct uprobe_cpu_buffer *ucb; + int dsize, esize; + + esize =3D SIZEOF_TRACE_ENTRY(is_ret_probe(tu)); + dsize =3D __get_data_size(&tu->tp, regs); + + ucb =3D uprobe_buffer_get(); + ucb->dsize =3D tu->tp.size + dsize; + + store_trace_args(ucb->buf, &tu->tp, regs, esize, dsize); + + return ucb; +} + static void __uprobe_trace_func(struct trace_uprobe *tu, unsigned long func, struct pt_regs *regs, - struct uprobe_cpu_buffer *ucb, int dsize, + struct uprobe_cpu_buffer *ucb, struct trace_event_file *trace_file) { struct uprobe_trace_entry_head *entry; @@ -960,14 +978,14 @@ static void __uprobe_trace_func(struct trace_uprobe *= tu, =20 WARN_ON(call !=3D trace_file->event_call); =20 - if (WARN_ON_ONCE(tu->tp.size + dsize > PAGE_SIZE)) + if (WARN_ON_ONCE(ucb->dsize > PAGE_SIZE)) return; =20 if (trace_trigger_soft_disabled(trace_file)) return; =20 esize =3D SIZEOF_TRACE_ENTRY(is_ret_probe(tu)); - size =3D esize + tu->tp.size + dsize; + size =3D esize + ucb->dsize; entry =3D trace_event_buffer_reserve(&fbuffer, trace_file, size); if (!entry) return; @@ -981,14 +999,14 @@ static void __uprobe_trace_func(struct trace_uprobe *= tu, data =3D DATAOF_TRACE_ENTRY(entry, false); } =20 - memcpy(data, ucb->buf, tu->tp.size + dsize); + memcpy(data, ucb->buf, ucb->dsize); =20 trace_event_buffer_commit(&fbuffer); } =20 /* uprobe handler */ static int uprobe_trace_func(struct trace_uprobe *tu, struct pt_regs *regs, - struct uprobe_cpu_buffer *ucb, int dsize) + struct uprobe_cpu_buffer *ucb) { struct event_file_link *link; =20 @@ -997,7 +1015,7 @@ static int uprobe_trace_func(struct trace_uprobe *tu, = struct pt_regs *regs, =20 rcu_read_lock(); trace_probe_for_each_link_rcu(link, &tu->tp) - __uprobe_trace_func(tu, 0, regs, ucb, dsize, link->file); + __uprobe_trace_func(tu, 0, regs, ucb, link->file); rcu_read_unlock(); =20 return 0; @@ -1005,13 +1023,13 @@ static int uprobe_trace_func(struct trace_uprobe *t= u, struct pt_regs *regs, =20 static void uretprobe_trace_func(struct trace_uprobe *tu, unsigned long fu= nc, struct pt_regs *regs, - struct uprobe_cpu_buffer *ucb, int dsize) + struct uprobe_cpu_buffer *ucb) { struct event_file_link *link; =20 rcu_read_lock(); trace_probe_for_each_link_rcu(link, &tu->tp) - __uprobe_trace_func(tu, func, regs, ucb, dsize, link->file); + __uprobe_trace_func(tu, func, regs, ucb, link->file); rcu_read_unlock(); } =20 @@ -1339,7 +1357,7 @@ static bool uprobe_perf_filter(struct uprobe_consumer= *uc, =20 static void __uprobe_perf_func(struct trace_uprobe *tu, unsigned long func, struct pt_regs *regs, - struct uprobe_cpu_buffer *ucb, int dsize) + struct uprobe_cpu_buffer *ucb) { struct trace_event_call *call =3D trace_probe_event_call(&tu->tp); struct uprobe_trace_entry_head *entry; @@ -1360,7 +1378,7 @@ static void __uprobe_perf_func(struct trace_uprobe *t= u, =20 esize =3D SIZEOF_TRACE_ENTRY(is_ret_probe(tu)); =20 - size =3D esize + tu->tp.size + dsize; + size =3D esize + ucb->dsize; size =3D ALIGN(size + sizeof(u32), sizeof(u64)) - sizeof(u32); if (WARN_ONCE(size > PERF_MAX_TRACE_SIZE, "profile buffer not large enoug= h")) return; @@ -1383,13 +1401,10 @@ static void __uprobe_perf_func(struct trace_uprobe = *tu, data =3D DATAOF_TRACE_ENTRY(entry, false); } =20 - memcpy(data, ucb->buf, tu->tp.size + dsize); - - if (size - esize > tu->tp.size + dsize) { - int len =3D tu->tp.size + dsize; + memcpy(data, ucb->buf, ucb->dsize); =20 - memset(data + len, 0, size - esize - len); - } + if (size - esize > ucb->dsize) + memset(data + ucb->dsize, 0, size - esize - ucb->dsize); =20 perf_trace_buf_submit(entry, size, rctx, call->event.type, 1, regs, head, NULL); @@ -1399,21 +1414,21 @@ static void __uprobe_perf_func(struct trace_uprobe = *tu, =20 /* uprobe profile handler */ static int uprobe_perf_func(struct trace_uprobe *tu, struct pt_regs *regs, - struct uprobe_cpu_buffer *ucb, int dsize) + struct uprobe_cpu_buffer *ucb) { if (!uprobe_perf_filter(&tu->consumer, 0, current->mm)) return UPROBE_HANDLER_REMOVE; =20 if (!is_ret_probe(tu)) - __uprobe_perf_func(tu, 0, regs, ucb, dsize); + __uprobe_perf_func(tu, 0, regs, ucb); return 0; } =20 static void uretprobe_perf_func(struct trace_uprobe *tu, unsigned long fun= c, struct pt_regs *regs, - struct uprobe_cpu_buffer *ucb, int dsize) + struct uprobe_cpu_buffer *ucb) { - __uprobe_perf_func(tu, func, regs, ucb, dsize); + __uprobe_perf_func(tu, func, regs, ucb); } =20 int bpf_get_uprobe_info(const struct perf_event *event, u32 *fd_type, @@ -1479,10 +1494,8 @@ static int uprobe_dispatcher(struct uprobe_consumer = *con, struct pt_regs *regs) struct trace_uprobe *tu; struct uprobe_dispatch_data udd; struct uprobe_cpu_buffer *ucb; - int dsize, esize; int ret =3D 0; =20 - tu =3D container_of(con, struct trace_uprobe, consumer); tu->nhit++; =20 @@ -1494,18 +1507,14 @@ static int uprobe_dispatcher(struct uprobe_consumer= *con, struct pt_regs *regs) if (WARN_ON_ONCE(!uprobe_cpu_buffer)) return 0; =20 - dsize =3D __get_data_size(&tu->tp, regs); - esize =3D SIZEOF_TRACE_ENTRY(is_ret_probe(tu)); - - ucb =3D uprobe_buffer_get(); - store_trace_args(ucb->buf, &tu->tp, regs, esize, dsize); + ucb =3D prepare_uprobe_buffer(tu, regs); =20 if (trace_probe_test_flag(&tu->tp, TP_FLAG_TRACE)) - ret |=3D uprobe_trace_func(tu, regs, ucb, dsize); + ret |=3D uprobe_trace_func(tu, regs, ucb); =20 #ifdef CONFIG_PERF_EVENTS if (trace_probe_test_flag(&tu->tp, TP_FLAG_PROFILE)) - ret |=3D uprobe_perf_func(tu, regs, ucb, dsize); + ret |=3D uprobe_perf_func(tu, regs, ucb); #endif uprobe_buffer_put(ucb); return ret; @@ -1517,7 +1526,6 @@ static int uretprobe_dispatcher(struct uprobe_consume= r *con, struct trace_uprobe *tu; struct uprobe_dispatch_data udd; struct uprobe_cpu_buffer *ucb; - int dsize, esize; =20 tu =3D container_of(con, struct trace_uprobe, consumer); =20 @@ -1529,18 +1537,13 @@ static int uretprobe_dispatcher(struct uprobe_consu= mer *con, if (WARN_ON_ONCE(!uprobe_cpu_buffer)) return 0; =20 - dsize =3D __get_data_size(&tu->tp, regs); - esize =3D SIZEOF_TRACE_ENTRY(is_ret_probe(tu)); - - ucb =3D uprobe_buffer_get(); - store_trace_args(ucb->buf, &tu->tp, regs, esize, dsize); - + ucb =3D prepare_uprobe_buffer(tu, regs); if (trace_probe_test_flag(&tu->tp, TP_FLAG_TRACE)) - uretprobe_trace_func(tu, func, regs, ucb, dsize); + uretprobe_trace_func(tu, func, regs, ucb); =20 #ifdef CONFIG_PERF_EVENTS if (trace_probe_test_flag(&tu->tp, TP_FLAG_PROFILE)) - uretprobe_perf_func(tu, func, regs, ucb, dsize); + uretprobe_perf_func(tu, func, regs, ucb); #endif uprobe_buffer_put(ucb); return 0; --=20 2.39.4 From nobody Sat Nov 23 08:44:02 2024 Received: from mail-qv1-f50.google.com (mail-qv1-f50.google.com [209.85.219.50]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 6D8AF2022F1 for ; Wed, 13 Nov 2024 14:28:04 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.219.50 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1731508086; cv=none; b=cqktyorAU1Xk1A3/sJCshJES3CPryqlw1fiUdwi8WC+nHpACQjhwdZPd200iQsOJ+8NoK+th0+rBL+neYW9spZwvqDdTiMkZ/Wi3zfzBuQvrDqrJH1Bg9UgerUQ49vf0ogcD2gNetbNR8HGepvf7lTyytMR3svWzjQisFI22wDg= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1731508086; c=relaxed/simple; bh=e3tKvAENgT1t91Jk2QWLaDwnuAoEYVDBIwQYDspG3d8=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=Kiyi/nkTekPfuXQVrLusU5pjTJluZhAuaxnk3m7vIGNOu2718AzxHBZwUwrhLy3yKgD9kXHYPp0qqznv+94TDBliV4ZzKoB/DsiCXmEb8GQSP1Uf6dZvwNLc4SlbkdLjeaxl2LMeccRPcad0X9fo8Qoehzv1H0EK5Gn4KQCGGNk= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=broadcom.com; spf=fail smtp.mailfrom=broadcom.com; dkim=pass (1024-bit key) header.d=broadcom.com header.i=@broadcom.com header.b=dUN837Gt; arc=none smtp.client-ip=209.85.219.50 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=broadcom.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=broadcom.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=broadcom.com header.i=@broadcom.com header.b="dUN837Gt" Received: by mail-qv1-f50.google.com with SMTP id 6a1803df08f44-6d352707ea7so44742736d6.2 for ; Wed, 13 Nov 2024 06:28:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=broadcom.com; s=google; t=1731508083; x=1732112883; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=XEHbh/duNWJqgspUZhgQYf55G1Gom+pwpEcdzlYloE8=; b=dUN837GtgJ1JDKlkS1aIv5lpzvtAy9vPRbrlOPisGmBrgMBKR9TlmNlsP6lZ9kdi0P 4JJ1DlLCj/4ivN42Dc5sbwX/omIjjRjk7lc0JRJW8ejRcD5akBmkeMhqYA2vWbop+G+Q NLr1WS5iRiSuTyS4ctzKT/p5lCUE80DXa6NF4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1731508083; x=1732112883; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=XEHbh/duNWJqgspUZhgQYf55G1Gom+pwpEcdzlYloE8=; b=XHmQ7ODD9C0dcumjWPQnJ8pYDsJHbdutEOSBHGSy2nyufK4ZFIJ/HrIrwZ0GJDHuIB DfaDHbbiXKlDaw6Aess9qtyFaub8gpbuIkWbjq52PoxmSlHdd2qrr4v4UpVUHrtuw7DM 6gX6XzXzE5mXmfcHawH8YqT+0c33u5VQVnfn9freCfZN9PN3/jLYUKmhmlAWT8847Gqi VqvJ3j+rzGR3xstB7U2+o7ZYOnVz6UQ9kfAMfpA5vhSuYPa216vlFp6coBFIQGKGgYC9 mBJ1y/p0tqP7Q1qNRjBXI55QCeMDMhuS8x1Wt2I+h0uiJKcu9TmwDHJ+kFS1ALM0eHgH c0oQ== X-Forwarded-Encrypted: i=1; AJvYcCXStv+zBD/ALpnA2Z/HEh4FEztQ2aqLW4Dn6OpdOtiyiAS30ONJBjOQjPLbfvPf6rD3oRYhtizpBZ1ONMI=@vger.kernel.org X-Gm-Message-State: AOJu0YwbHwQCfV5TuaSYlSM6vnZ6/an8GJS9LSh8GO/bxzPUvfcucLlG TmXeg75nZMWF0UlG12SdUiFnr7Xf9l/jVtDt/NiBnDfNnrp5+5VnZMZvn6/lBg== X-Google-Smtp-Source: AGHT+IGKsfb5qCjLVoyCtZSg3Na9acwl7ff97AOrrv2+jJxIw+mkA/tSW7GMk8T0IzM/qYZJ/Czvyg== X-Received: by 2002:a05:6214:4990:b0:6cb:3c08:6a6a with SMTP id 6a1803df08f44-6d39e1ce9b1mr331094176d6.49.1731508083409; Wed, 13 Nov 2024 06:28:03 -0800 (PST) Received: from vb004028-vm1.. ([192.19.161.250]) by smtp.gmail.com with ESMTPSA id 6a1803df08f44-6d3961defe5sm85134976d6.10.2024.11.13.06.28.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 13 Nov 2024 06:28:02 -0800 (PST) From: Vamsi Krishna Brahmajosyula To: stable@vger.kernel.org, gregkh@linuxfoundation.org Cc: rostedt@goodmis.org, mhiramat@kernel.org, mqaio@linux.alibaba.com, namhyung.kim@lge.com, oleg@redhat.com, andrii@kernel.org, jolsa@kernel.org, sashal@kernel.org, linux-kernel@vger.kernel.org, bpf@vger.kernel.org, ajay.kaher@broadcom.com, alexey.makhalov@broadcom.com, vasavi.sirnapalli@broadcom.com, Vamsi Krishna Brahmajosyula Subject: [PATCH v6.1 2/2] uprobe: avoid out-of-bounds memory access of fetching args Date: Wed, 13 Nov 2024 14:27:34 +0000 Message-Id: <20241113142734.2406886-3-vamsi-krishna.brahmajosyula@broadcom.com> X-Mailer: git-send-email 2.39.4 In-Reply-To: <20241113142734.2406886-1-vamsi-krishna.brahmajosyula@broadcom.com> References: <20241113142734.2406886-1-vamsi-krishna.brahmajosyula@broadcom.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" From: Qiao Ma [ Upstream commit 373b9338c9722a368925d83bc622c596896b328e ] Uprobe needs to fetch args into a percpu buffer, and then copy to ring buffer to avoid non-atomic context problem. Sometimes user-space strings, arrays can be very large, but the size of percpu buffer is only page size. And store_trace_args() won't check whether these data exceeds a single page or not, caused out-of-bounds memory access. It could be reproduced by following steps: 1. build kernel with CONFIG_KASAN enabled 2. save follow program as test.c ``` \#include \#include \#include // If string length large than MAX_STRING_SIZE, the fetch_store_strlen() // will return 0, cause __get_data_size() return shorter size, and // store_trace_args() will not trigger out-of-bounds access. // So make string length less than 4096. \#define STRLEN 4093 void generate_string(char *str, int n) { int i; for (i =3D 0; i < n; ++i) { char c =3D i % 26 + 'a'; str[i] =3D c; } str[n-1] =3D '\0'; } void print_string(char *str) { printf("%s\n", str); } int main() { char tmp[STRLEN]; generate_string(tmp, STRLEN); print_string(tmp); return 0; } ``` 3. compile program `gcc -o test test.c` 4. get the offset of `print_string()` ``` objdump -t test | grep -w print_string 0000000000401199 g F .text 000000000000001b print_string ``` 5. configure uprobe with offset 0x1199 ``` off=3D0x1199 cd /sys/kernel/debug/tracing/ echo "p /root/test:${off} arg1=3D+0(%di):ustring arg2=3D\$comm arg3=3D+0(%d= i):ustring" > uprobe_events echo 1 > events/uprobes/enable echo 1 > tracing_on ``` 6. run `test`, and kasan will report error. =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D BUG: KASAN: use-after-free in strncpy_from_user+0x1d6/0x1f0 Write of size 8 at addr ffff88812311c004 by task test/499CPU: 0 UID: 0 PID:= 499 Comm: test Not tainted 6.12.0-rc3+ #18 Hardware name: Red Hat KVM, BIOS 1.16.0-4.al8 04/01/2014 Call Trace: dump_stack_lvl+0x55/0x70 print_address_description.constprop.0+0x27/0x310 kasan_report+0x10f/0x120 ? strncpy_from_user+0x1d6/0x1f0 strncpy_from_user+0x1d6/0x1f0 ? rmqueue.constprop.0+0x70d/0x2ad0 process_fetch_insn+0xb26/0x1470 ? __pfx_process_fetch_insn+0x10/0x10 ? _raw_spin_lock+0x85/0xe0 ? __pfx__raw_spin_lock+0x10/0x10 ? __pte_offset_map+0x1f/0x2d0 ? unwind_next_frame+0xc5f/0x1f80 ? arch_stack_walk+0x68/0xf0 ? is_bpf_text_address+0x23/0x30 ? kernel_text_address.part.0+0xbb/0xd0 ? __kernel_text_address+0x66/0xb0 ? unwind_get_return_address+0x5e/0xa0 ? __pfx_stack_trace_consume_entry+0x10/0x10 ? arch_stack_walk+0xa2/0xf0 ? _raw_spin_lock_irqsave+0x8b/0xf0 ? __pfx__raw_spin_lock_irqsave+0x10/0x10 ? depot_alloc_stack+0x4c/0x1f0 ? _raw_spin_unlock_irqrestore+0xe/0x30 ? stack_depot_save_flags+0x35d/0x4f0 ? kasan_save_stack+0x34/0x50 ? kasan_save_stack+0x24/0x50 ? mutex_lock+0x91/0xe0 ? __pfx_mutex_lock+0x10/0x10 prepare_uprobe_buffer.part.0+0x2cd/0x500 uprobe_dispatcher+0x2c3/0x6a0 ? __pfx_uprobe_dispatcher+0x10/0x10 ? __kasan_slab_alloc+0x4d/0x90 handler_chain+0xdd/0x3e0 handle_swbp+0x26e/0x3d0 ? __pfx_handle_swbp+0x10/0x10 ? uprobe_pre_sstep_notifier+0x151/0x1b0 irqentry_exit_to_user_mode+0xe2/0x1b0 asm_exc_int3+0x39/0x40 RIP: 0033:0x401199 Code: 01 c2 0f b6 45 fb 88 02 83 45 fc 01 8b 45 fc 3b 45 e4 7c b7 8b 45 e4 = 48 98 48 8d 50 ff 48 8b 45 e8 48 01 d0 ce RSP: 002b:00007ffdf00576a8 EFLAGS: 00000206 RAX: 00007ffdf00576b0 RBX: 0000000000000000 RCX: 0000000000000ff2 RDX: 0000000000000ffc RSI: 0000000000000ffd RDI: 00007ffdf00576b0 RBP: 00007ffdf00586b0 R08: 00007feb2f9c0d20 R09: 00007feb2f9c0d20 R10: 0000000000000001 R11: 0000000000000202 R12: 0000000000401040 R13: 00007ffdf0058780 R14: 0000000000000000 R15: 0000000000000000 This commit enforces the buffer's maxlen less than a page-size to avoid store_trace_args() out-of-memory access. Link: https://lore.kernel.org/all/20241015060148.1108331-1-mqaio@linux.alib= aba.com/ Fixes: dcad1a204f72 ("tracing/uprobes: Fetch args before reserving a ring b= uffer") Signed-off-by: Qiao Ma Signed-off-by: Masami Hiramatsu (Google) Signed-off-by: Sasha Levin Signed-off-by: Vamsi Krishna Brahmajosyula --- kernel/trace/trace_uprobe.c | 9 ++++++--- 1 file changed, 6 insertions(+), 3 deletions(-) diff --git a/kernel/trace/trace_uprobe.c b/kernel/trace/trace_uprobe.c index e09eef65d32f..a6a3ff2a441e 100644 --- a/kernel/trace/trace_uprobe.c +++ b/kernel/trace/trace_uprobe.c @@ -862,6 +862,7 @@ struct uprobe_cpu_buffer { }; static struct uprobe_cpu_buffer __percpu *uprobe_cpu_buffer; static int uprobe_buffer_refcnt; +#define MAX_UCB_BUFFER_SIZE PAGE_SIZE =20 static int uprobe_buffer_init(void) { @@ -960,6 +961,11 @@ static struct uprobe_cpu_buffer *prepare_uprobe_buffer= (struct trace_uprobe *tu, ucb =3D uprobe_buffer_get(); ucb->dsize =3D tu->tp.size + dsize; =20 + if (WARN_ON_ONCE(ucb->dsize > MAX_UCB_BUFFER_SIZE)) { + ucb->dsize =3D MAX_UCB_BUFFER_SIZE; + dsize =3D MAX_UCB_BUFFER_SIZE - tu->tp.size; + } + store_trace_args(ucb->buf, &tu->tp, regs, esize, dsize); =20 return ucb; @@ -978,9 +984,6 @@ static void __uprobe_trace_func(struct trace_uprobe *tu, =20 WARN_ON(call !=3D trace_file->event_call); =20 - if (WARN_ON_ONCE(ucb->dsize > PAGE_SIZE)) - return; - if (trace_trigger_soft_disabled(trace_file)) return; =20 --=20 2.39.4