From nobody Mon Feb 9 08:28:51 2026 Received: from mail-pl1-f193.google.com (mail-pl1-f193.google.com [209.85.214.193]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 345073816EF for ; Tue, 20 Jan 2026 07:06:23 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.214.193 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1768892788; cv=none; b=kG3wWeRbgt/+jSYIlv1dH2vOVL+ecVDrgTzHoBLXQ3CCqiuk3tuHU7RE7gL55CSXt8cyqto7oL6s2W6HAR1y1sU8CVzNqcd0Dw/97k/xC+mhHmia07MfixPKqcP9VllNidTGkNmRDs/H/AWqfwNx346PfSy8ozZW/u5PV1YMqgU= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1768892788; c=relaxed/simple; bh=bkEnpN35ROgLb1TaATahFCU+nYmJUOdqiUA5VNDzRiY=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=dYJ1NSgyBqegDm79dqJGiFB2DiQ2BECsecISoesipGUxyvv99kZTe2vZwUAK4Gav3ma5pr/WbF8rk42VBH9+5MMVezL8/rT6cZDP3OkPrEuTzbowsXt/RuckYNj+8fteEEt/LfD3/2xU09tfX+uxaPMk+0R1TY/1n2XOTDHZYgg= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=BIpbwsK8; arc=none smtp.client-ip=209.85.214.193 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="BIpbwsK8" Received: by mail-pl1-f193.google.com with SMTP id d9443c01a7336-2a09757004cso44953255ad.3 for ; Mon, 19 Jan 2026 23:06:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1768892778; x=1769497578; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=AoyD4uV9eCRwWiRSuwU/fXn0oAa1lUGxNCw5PqJhjBU=; b=BIpbwsK8IFYvCZ5UM6BF2qr/i7osYi3MA2+M0lEvSqHQZMB7VpEkGSrGTrqxQPMsVt xffOdLinNu8OWRhyJ02aZ2eDeS/nugwYSGWlw4KLjNsfPG8vynnNzWi66SIHDvK5V/GD /2qipx/jpeol5mIg1oe05eSfOmtJ45bAC/z/VQ8Gp0HSo6uDxpTIxoatzullIsxzb+0y tNRiF1E/KG/FwyJcNl2ZYpkv0fWN5hiYmV70w5qznyUqmZebvIb0OVjvsCVzPJkWLWeU 7BWhuIjM7tT//vqyvXofo4qckw0DTktmhTr//XRKFRttrFkIDvbAEOFRL//2jm1/HV3e q23g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1768892778; x=1769497578; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-gg:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=AoyD4uV9eCRwWiRSuwU/fXn0oAa1lUGxNCw5PqJhjBU=; b=ly8lmpVxiyUCFs1BCKR70EyiUZjfE1C2ZCNIRKD66VvLGePsq0VzUx4Xa//up3d6ox cMj1tyUgm/3uKND2wq+8UZ6WBtOEadIyep7F6hc8TWyZTEtMG0hNoIcc34sz3Xbe85su rOxUNReBONWxXVlNp6UWq1vCe1gQJo8cu3Lf4KZIJ++/EEXXQGok3LUR5tTVi+cGUYXd D4hlQuWLshLjq4Q3zXNntK8hpq4989l/JxomKzTPLmIuVg5U+npGCvF8k/U2mgi0m51T LMTV4pf77riI817i5Dn+T7H/Zsr9GUWImS5vPBJSoIpCVQ+q1IfZbGIWyDVe1oM7iO2S 3Jog== X-Forwarded-Encrypted: i=1; AJvYcCXRvukVoQM8NM5D+vjQPO90oIHf7KmzF4hr13OrMvxkoKdZfmhVGFBOCG20rviqXyluuT8jI8RQvg+jmko=@vger.kernel.org X-Gm-Message-State: AOJu0YwYgHECUQF6BA5wd6B5XquXudv722E2klo+E8085589IcqVRc+O aaIPRQ/BDAb5EIhoM9peto4oLGwGBs1RcbGxMrAcF0hGfFnKy2mRdlDj X-Gm-Gg: AZuq6aLzNCBQcQ6yaiACV9++zgldjL3XTqsiAgKY8JxXR8ROPDxF1CE5zitJC9geerc lw5HATLS0pjP9ifJeFsxwCwmIe47dawSt1lkb1EFvBZbdM94zgd3Misq20T3Ls8LouHk9qh0B3d yOFpSlm492cjUfa1/tL5xEj+6gcpg6BydIORLNW8Oqg6B8vvZzQE4ILrKakb132uVIQthMNENKm st/KX7pSH5JQx6om3JAGoXeeNdfuBF7xX9k66t/7/BUi6LJ+Xrni4OEndRT6A8agl0xwT4aPR/U Bcalr5I51c1llga7q2LcHfTtUTwpqFze2BXflXLW945PnAVoP7GhTW6zRxvt0YEN2Nl7vXU1QXz i8/6P1N2WvWwva+UbAaw3+3CnjVQ857EGMZNKy0Q766nsYBDNu0yONe+opzNJ/Nn5nRGF4jatr3 qRhq3EDV3M X-Received: by 2002:a17:903:1a2e:b0:298:6a79:397b with SMTP id d9443c01a7336-2a7176cc35bmr123268025ad.56.1768892778110; Mon, 19 Jan 2026 23:06:18 -0800 (PST) Received: from 7950hx ([103.173.155.241]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-2a7190ce534sm111695665ad.27.2026.01.19.23.06.09 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 19 Jan 2026 23:06:17 -0800 (PST) From: Menglong Dong X-Google-Original-From: Menglong Dong To: ast@kernel.org, eddyz87@gmail.com Cc: davem@davemloft.net, dsahern@kernel.org, daniel@iogearbox.net, andrii@kernel.org, martin.lau@linux.dev, song@kernel.org, yonghong.song@linux.dev, john.fastabend@gmail.com, kpsingh@kernel.org, sdf@fomichev.me, haoluo@google.com, jolsa@kernel.org, tglx@linutronix.de, mingo@redhat.com, bp@alien8.de, dave.hansen@linux.intel.com, x86@kernel.org, hpa@zytor.com, netdev@vger.kernel.org, bpf@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [PATCH bpf-next v6 1/2] bpf, x86: inline bpf_get_current_task() for x86_64 Date: Tue, 20 Jan 2026 15:05:54 +0800 Message-ID: <20260120070555.233486-2-dongml2@chinatelecom.cn> X-Mailer: git-send-email 2.52.0 In-Reply-To: <20260120070555.233486-1-dongml2@chinatelecom.cn> References: <20260120070555.233486-1-dongml2@chinatelecom.cn> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Inline bpf_get_current_task() and bpf_get_current_task_btf() for x86_64 to obtain better performance. Signed-off-by: Menglong Dong Acked-by: Eduard Zingerman --- v5: - don't support the !CONFIG_SMP case v4: - handle the !CONFIG_SMP case v3: - implement it in the verifier with BPF_MOV64_PERCPU_REG() instead of in x86_64 JIT. --- kernel/bpf/verifier.c | 22 ++++++++++++++++++++++ 1 file changed, 22 insertions(+) diff --git a/kernel/bpf/verifier.c b/kernel/bpf/verifier.c index 9de0ec0c3ed9..c4e2ffadfb1f 100644 --- a/kernel/bpf/verifier.c +++ b/kernel/bpf/verifier.c @@ -17739,6 +17739,10 @@ static bool verifier_inlines_helper_call(struct bp= f_verifier_env *env, s32 imm) switch (imm) { #ifdef CONFIG_X86_64 case BPF_FUNC_get_smp_processor_id: +#ifdef CONFIG_SMP + case BPF_FUNC_get_current_task_btf: + case BPF_FUNC_get_current_task: +#endif return env->prog->jit_requested && bpf_jit_supports_percpu_insn(); #endif default: @@ -23319,6 +23323,24 @@ static int do_misc_fixups(struct bpf_verifier_env = *env) insn =3D new_prog->insnsi + i + delta; goto next_insn; } + + /* Implement bpf_get_current_task() and bpf_get_current_task_btf() inlin= e. */ + if ((insn->imm =3D=3D BPF_FUNC_get_current_task || insn->imm =3D=3D BPF_= FUNC_get_current_task_btf) && + verifier_inlines_helper_call(env, insn->imm)) { + insn_buf[0] =3D BPF_MOV64_IMM(BPF_REG_0, (u32)(unsigned long)¤t_t= ask); + insn_buf[1] =3D BPF_MOV64_PERCPU_REG(BPF_REG_0, BPF_REG_0); + insn_buf[2] =3D BPF_LDX_MEM(BPF_DW, BPF_REG_0, BPF_REG_0, 0); + cnt =3D 3; + + new_prog =3D bpf_patch_insn_data(env, i + delta, insn_buf, cnt); + if (!new_prog) + return -ENOMEM; + + delta +=3D cnt - 1; + env->prog =3D prog =3D new_prog; + insn =3D new_prog->insnsi + i + delta; + goto next_insn; + } #endif /* Implement bpf_get_func_arg inline. */ if (prog_type =3D=3D BPF_PROG_TYPE_TRACING && --=20 2.52.0