From nobody Sat Sep 13 18:45:52 2025 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id E6BD4C636D3 for ; Tue, 31 Jan 2023 04:36:23 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230346AbjAaEgV (ORCPT ); Mon, 30 Jan 2023 23:36:21 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:42912 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230319AbjAaEgE (ORCPT ); Mon, 30 Jan 2023 23:36:04 -0500 Received: from mail-qt1-x82d.google.com (mail-qt1-x82d.google.com [IPv6:2607:f8b0:4864:20::82d]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 239BD39CEC for ; Mon, 30 Jan 2023 20:35:38 -0800 (PST) Received: by mail-qt1-x82d.google.com with SMTP id z9so12359996qtv.5 for ; Mon, 30 Jan 2023 20:35:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance-com.20210112.gappssmtp.com; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=HkWYM1Agnb6SFeBCP7iogJ9isqJihH/76SzByqWUQe0=; b=O1kZO9T1c/FNAOYfMaZIaFvslrSG4WyAZC5cVfDmIS1S40z/yokk5X3vxuLXXHH1HL ZXkDy1AjNEHQJaaAhaMDINgCDNdYg5B51IzCcF4ThEtUVrdwQ4oHj2CnHe9WoZSknvA2 K9873w2WQz6ThdfPFyhcPgO6gf7NKVuprXJl2DFYE1Gs+t+fam6LT9Jrih8t+v49xYZh KUXMOxJmCXtWG4pc/sWJXwXNGUkoPtVwDElxlCXRu+VlOxaL3HWNXqOIXpag2S5sCkvR 04CaiGqnEiVjavjGZiv0gybuqggSQp7NG1+8uQwk4Dxv4UUiy9GrTnH07XqaUqG4DCiU eumw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=HkWYM1Agnb6SFeBCP7iogJ9isqJihH/76SzByqWUQe0=; b=fHJnYdJoNO6z1eEeObLq2rl4wt6KL1zSueLAPlx29GG82RFuVwADechKjUt0bu8DJW jX/St1ZZqp/6Ctg5038/q8I5VSAvFZ7slhWHtO3A6Aco/SxrNW9JuSVuDDuvXssZvMoG JOC9cuC4GO0j5xwCDGvdq4q0FxNI9LmiRxSWHgcKYlzEHJOlBqDJXNLAQTmM5dFwEOwP wYGx8m5Yt5Fp8rHfLJlhMkUuLyNumOhTcYbP3VH+c56xpcXBmoKc853KyDjVEFlEN1AF IDGqXp0M3JgEyjT5hTuNGChxYFM5PAkUyKy8yIJ7Qmohan07QDt7sLn/ANcD4GZvQ/eU Y0FA== X-Gm-Message-State: AO0yUKWAaZoVjPk7nj2rxnR4GcO8lYi2zYGxpX+7m18gRTN3eyJ094+Y 5epc8yJj+nZbjuIghkzjQ7IULA== X-Google-Smtp-Source: AK7set9NlFzo5H56pde4LYWXbhaukH0nN4E7ogUjRLNhw9uwIIdJNzBAWfVX46066sVMCufClW6Nlw== X-Received: by 2002:a05:622a:1349:b0:3b8:695b:aadb with SMTP id w9-20020a05622a134900b003b8695baadbmr13351866qtk.44.1675139736983; Mon, 30 Jan 2023 20:35:36 -0800 (PST) Received: from C02G8BMUMD6R.bytedance.net ([148.59.24.152]) by smtp.gmail.com with ESMTPSA id b13-20020ac801cd000000b003a6a19ee4f0sm9260682qtg.33.2023.01.30.20.35.30 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 30 Jan 2023 20:35:36 -0800 (PST) From: Bobby Eshleman To: Stefan Hajnoczi , Stefano Garzarella , "Michael S. Tsirkin" , Jason Wang , "David S. Miller" , Eric Dumazet , Jakub Kicinski , Paolo Abeni , Andrii Nakryiko , Mykola Lysenko , Alexei Starovoitov , Daniel Borkmann , Martin KaFai Lau , Song Liu , Yonghong Song , John Fastabend , KP Singh , Stanislav Fomichev , Hao Luo , Jiri Olsa , Shuah Khan Cc: Bobby Eshleman , Bobby Eshleman , linux-kernel@vger.kernel.org, kvm@vger.kernel.org, virtualization@lists.linux-foundation.org, netdev@vger.kernel.org, bpf@vger.kernel.org, linux-kselftest@vger.kernel.org, jakub@cloudflare.com, hdanton@sina.com, cong.wang@bytedance.com Subject: [PATCH RFC net-next v2 1/3] vsock: support sockmap Date: Mon, 30 Jan 2023 20:35:12 -0800 Message-Id: <20230118-support-vsock-sockmap-connectible-v2-1-58ffafde0965@bytedance.com> X-Mailer: git-send-email 2.35.1 In-Reply-To: <20230118-support-vsock-sockmap-connectible-v2-0-58ffafde0965@bytedance.com> References: <20230118-support-vsock-sockmap-connectible-v2-0-58ffafde0965@bytedance.com> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Mailer: b4 0.12.1 Content-Transfer-Encoding: quoted-printable Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This patch adds sockmap support for vsock sockets. It is intended to be usable by all transports, but only the virtio transport is implemented. Signed-off-by: Bobby Eshleman --- drivers/vhost/vsock.c | 1 + include/linux/virtio_vsock.h | 1 + include/net/af_vsock.h | 17 ++++ net/vmw_vsock/Makefile | 1 + net/vmw_vsock/af_vsock.c | 55 ++++++++-- net/vmw_vsock/virtio_transport.c | 2 + net/vmw_vsock/virtio_transport_common.c | 24 +++++ net/vmw_vsock/vsock_bpf.c | 175 ++++++++++++++++++++++++++++= ++++ net/vmw_vsock/vsock_loopback.c | 2 + 9 files changed, 272 insertions(+), 6 deletions(-) diff --git a/drivers/vhost/vsock.c b/drivers/vhost/vsock.c index 1f3b89c885cc..3c6dc036b904 100644 --- a/drivers/vhost/vsock.c +++ b/drivers/vhost/vsock.c @@ -439,6 +439,7 @@ static struct virtio_transport vhost_transport =3D { .notify_send_post_enqueue =3D virtio_transport_notify_send_post_enqueue, .notify_buffer_size =3D virtio_transport_notify_buffer_size, =20 + .read_skb =3D virtio_transport_read_skb, }, =20 .send_pkt =3D vhost_transport_send_pkt, diff --git a/include/linux/virtio_vsock.h b/include/linux/virtio_vsock.h index 3f9c16611306..c58453699ee9 100644 --- a/include/linux/virtio_vsock.h +++ b/include/linux/virtio_vsock.h @@ -245,4 +245,5 @@ u32 virtio_transport_get_credit(struct virtio_vsock_soc= k *vvs, u32 wanted); void virtio_transport_put_credit(struct virtio_vsock_sock *vvs, u32 credit= ); void virtio_transport_deliver_tap_pkt(struct sk_buff *skb); int virtio_transport_purge_skbs(void *vsk, struct sk_buff_head *list); +int virtio_transport_read_skb(struct vsock_sock *vsk, skb_read_actor_t rea= d_actor); #endif /* _LINUX_VIRTIO_VSOCK_H */ diff --git a/include/net/af_vsock.h b/include/net/af_vsock.h index 568a87c5e0d0..a73f5fbd296a 100644 --- a/include/net/af_vsock.h +++ b/include/net/af_vsock.h @@ -75,6 +75,7 @@ struct vsock_sock { void *trans; }; =20 +s64 vsock_connectible_has_data(struct vsock_sock *vsk); s64 vsock_stream_has_data(struct vsock_sock *vsk); s64 vsock_stream_has_space(struct vsock_sock *vsk); struct sock *vsock_create_connected(struct sock *parent); @@ -173,6 +174,9 @@ struct vsock_transport { =20 /* Addressing. */ u32 (*get_local_cid)(void); + + /* Read a single skb */ + int (*read_skb)(struct vsock_sock *, skb_read_actor_t); }; =20 /**** CORE ****/ @@ -225,5 +229,18 @@ int vsock_init_tap(void); int vsock_add_tap(struct vsock_tap *vt); int vsock_remove_tap(struct vsock_tap *vt); void vsock_deliver_tap(struct sk_buff *build_skb(void *opaque), void *opaq= ue); +int vsock_connectible_recvmsg(struct socket *sock, struct msghdr *msg, siz= e_t len, + int flags); +int vsock_dgram_recvmsg(struct socket *sock, struct msghdr *msg, + size_t len, int flags); + +#ifdef CONFIG_BPF_SYSCALL +extern struct proto vsock_proto; +int vsock_bpf_update_proto(struct sock *sk, struct sk_psock *psock, bool r= estore); +void __init vsock_bpf_build_proto(void); +#else +static inline void __init vsock_bpf_build_proto(void) +{} +#endif =20 #endif /* __AF_VSOCK_H__ */ diff --git a/net/vmw_vsock/Makefile b/net/vmw_vsock/Makefile index 6a943ec95c4a..5da74c4a9f1d 100644 --- a/net/vmw_vsock/Makefile +++ b/net/vmw_vsock/Makefile @@ -8,6 +8,7 @@ obj-$(CONFIG_HYPERV_VSOCKETS) +=3D hv_sock.o obj-$(CONFIG_VSOCKETS_LOOPBACK) +=3D vsock_loopback.o =20 vsock-y +=3D af_vsock.o af_vsock_tap.o vsock_addr.o +vsock-$(CONFIG_BPF_SYSCALL) +=3D vsock_bpf.o =20 vsock_diag-y +=3D diag.o =20 diff --git a/net/vmw_vsock/af_vsock.c b/net/vmw_vsock/af_vsock.c index 19aea7cba26e..f2cc04fb8b13 100644 --- a/net/vmw_vsock/af_vsock.c +++ b/net/vmw_vsock/af_vsock.c @@ -116,10 +116,13 @@ static void vsock_sk_destruct(struct sock *sk); static int vsock_queue_rcv_skb(struct sock *sk, struct sk_buff *skb); =20 /* Protocol family. */ -static struct proto vsock_proto =3D { +struct proto vsock_proto =3D { .name =3D "AF_VSOCK", .owner =3D THIS_MODULE, .obj_size =3D sizeof(struct vsock_sock), +#ifdef CONFIG_BPF_SYSCALL + .psock_update_sk_prot =3D vsock_bpf_update_proto, +#endif }; =20 /* The default peer timeout indicates how long we will wait for a peer res= ponse @@ -865,7 +868,7 @@ s64 vsock_stream_has_data(struct vsock_sock *vsk) } EXPORT_SYMBOL_GPL(vsock_stream_has_data); =20 -static s64 vsock_connectible_has_data(struct vsock_sock *vsk) +s64 vsock_connectible_has_data(struct vsock_sock *vsk) { struct sock *sk =3D sk_vsock(vsk); =20 @@ -874,6 +877,7 @@ static s64 vsock_connectible_has_data(struct vsock_sock= *vsk) else return vsock_stream_has_data(vsk); } +EXPORT_SYMBOL_GPL(vsock_connectible_has_data); =20 s64 vsock_stream_has_space(struct vsock_sock *vsk) { @@ -1131,6 +1135,13 @@ static __poll_t vsock_poll(struct file *file, struct= socket *sock, return mask; } =20 +static int vsock_read_skb(struct sock *sk, skb_read_actor_t read_actor) +{ + struct vsock_sock *vsk =3D vsock_sk(sk); + + return vsk->transport->read_skb(vsk, read_actor); +} + static int vsock_dgram_sendmsg(struct socket *sock, struct msghdr *msg, size_t len) { @@ -1241,19 +1252,34 @@ static int vsock_dgram_connect(struct socket *sock, =20 memcpy(&vsk->remote_addr, remote_addr, sizeof(vsk->remote_addr)); sock->state =3D SS_CONNECTED; + sk->sk_state =3D TCP_ESTABLISHED; =20 out: release_sock(sk); return err; } =20 -static int vsock_dgram_recvmsg(struct socket *sock, struct msghdr *msg, - size_t len, int flags) +int vsock_dgram_recvmsg(struct socket *sock, struct msghdr *msg, + size_t len, int flags) { - struct vsock_sock *vsk =3D vsock_sk(sock->sk); +#ifdef CONFIG_BPF_SYSCALL + const struct proto *prot; +#endif + struct vsock_sock *vsk; + struct sock *sk; + + sk =3D sock->sk; + vsk =3D vsock_sk(sk); + +#ifdef CONFIG_BPF_SYSCALL + prot =3D READ_ONCE(sk->sk_prot); + if (prot !=3D &vsock_proto) + return prot->recvmsg(sk, msg, len, flags, NULL); +#endif =20 return vsk->transport->dgram_dequeue(vsk, msg, len, flags); } +EXPORT_SYMBOL_GPL(vsock_dgram_recvmsg); =20 static const struct proto_ops vsock_dgram_ops =3D { .family =3D PF_VSOCK, @@ -1272,6 +1298,7 @@ static const struct proto_ops vsock_dgram_ops =3D { .recvmsg =3D vsock_dgram_recvmsg, .mmap =3D sock_no_mmap, .sendpage =3D sock_no_sendpage, + .read_skb =3D vsock_read_skb, }; =20 static int vsock_transport_cancel_pkt(struct vsock_sock *vsk) @@ -2086,13 +2113,16 @@ static int __vsock_seqpacket_recvmsg(struct sock *s= k, struct msghdr *msg, return err; } =20 -static int +int vsock_connectible_recvmsg(struct socket *sock, struct msghdr *msg, size_t = len, int flags) { struct sock *sk; struct vsock_sock *vsk; const struct vsock_transport *transport; +#ifdef CONFIG_BPF_SYSCALL + const struct proto *prot; +#endif int err; =20 sk =3D sock->sk; @@ -2139,6 +2169,14 @@ vsock_connectible_recvmsg(struct socket *sock, struc= t msghdr *msg, size_t len, goto out; } =20 +#ifdef CONFIG_BPF_SYSCALL + prot =3D READ_ONCE(sk->sk_prot); + if (prot !=3D &vsock_proto) { + release_sock(sk); + return prot->recvmsg(sk, msg, len, flags, NULL); + } +#endif + if (sk->sk_type =3D=3D SOCK_STREAM) err =3D __vsock_stream_recvmsg(sk, msg, len, flags); else @@ -2148,6 +2186,7 @@ vsock_connectible_recvmsg(struct socket *sock, struct= msghdr *msg, size_t len, release_sock(sk); return err; } +EXPORT_SYMBOL_GPL(vsock_connectible_recvmsg); =20 static int vsock_set_rcvlowat(struct sock *sk, int val) { @@ -2188,6 +2227,7 @@ static const struct proto_ops vsock_stream_ops =3D { .mmap =3D sock_no_mmap, .sendpage =3D sock_no_sendpage, .set_rcvlowat =3D vsock_set_rcvlowat, + .read_skb =3D vsock_read_skb, }; =20 static const struct proto_ops vsock_seqpacket_ops =3D { @@ -2209,6 +2249,7 @@ static const struct proto_ops vsock_seqpacket_ops =3D= { .recvmsg =3D vsock_connectible_recvmsg, .mmap =3D sock_no_mmap, .sendpage =3D sock_no_sendpage, + .read_skb =3D vsock_read_skb, }; =20 static int vsock_create(struct net *net, struct socket *sock, @@ -2348,6 +2389,8 @@ static int __init vsock_init(void) goto err_unregister_proto; } =20 + vsock_bpf_build_proto(); + return 0; =20 err_unregister_proto: diff --git a/net/vmw_vsock/virtio_transport.c b/net/vmw_vsock/virtio_transp= ort.c index 28b5a8e8e094..e95df847176b 100644 --- a/net/vmw_vsock/virtio_transport.c +++ b/net/vmw_vsock/virtio_transport.c @@ -457,6 +457,8 @@ static struct virtio_transport virtio_transport =3D { .notify_send_pre_enqueue =3D virtio_transport_notify_send_pre_enqueue, .notify_send_post_enqueue =3D virtio_transport_notify_send_post_enqueue, .notify_buffer_size =3D virtio_transport_notify_buffer_size, + + .read_skb =3D virtio_transport_read_skb, }, =20 .send_pkt =3D virtio_transport_send_pkt, diff --git a/net/vmw_vsock/virtio_transport_common.c b/net/vmw_vsock/virtio= _transport_common.c index a1581c77cf84..82bdaf61ee02 100644 --- a/net/vmw_vsock/virtio_transport_common.c +++ b/net/vmw_vsock/virtio_transport_common.c @@ -1388,6 +1388,30 @@ int virtio_transport_purge_skbs(void *vsk, struct sk= _buff_head *queue) } EXPORT_SYMBOL_GPL(virtio_transport_purge_skbs); =20 +int virtio_transport_read_skb(struct vsock_sock *vsk, skb_read_actor_t rec= v_actor) +{ + struct virtio_vsock_sock *vvs =3D vsk->trans; + struct sock *sk =3D sk_vsock(vsk); + struct sk_buff *skb; + int off =3D 0; + int copied; + int err; + + spin_lock_bh(&vvs->rx_lock); + /* Use __skb_recv_datagram() for race-free handling of the receive. It + * works for types other than dgrams. */ + skb =3D __skb_recv_datagram(sk, &vvs->rx_queue, MSG_DONTWAIT, &off, &err); + spin_unlock_bh(&vvs->rx_lock); + + if (!skb) + return err; + + copied =3D recv_actor(sk, skb); + kfree_skb(skb); + return copied; +} +EXPORT_SYMBOL_GPL(virtio_transport_read_skb); + MODULE_LICENSE("GPL v2"); MODULE_AUTHOR("Asias He"); MODULE_DESCRIPTION("common code for virtio vsock"); diff --git a/net/vmw_vsock/vsock_bpf.c b/net/vmw_vsock/vsock_bpf.c new file mode 100644 index 000000000000..ee92a1f42031 --- /dev/null +++ b/net/vmw_vsock/vsock_bpf.c @@ -0,0 +1,175 @@ +// SPDX-License-Identifier: GPL-2.0 +/* Copyright (c) 2022 Bobby Eshleman + * + * Based off of net/unix/unix_bpf.c + */ + +#include +#include +#include +#include +#include +#include +#include + +#define vsock_sk_has_data(__sk, __psock) \ + ({ !skb_queue_empty(&__sk->sk_receive_queue) || \ + !skb_queue_empty(&__psock->ingress_skb) || \ + !list_empty(&__psock->ingress_msg); \ + }) + +static struct proto *vsock_prot_saved __read_mostly; +static DEFINE_SPINLOCK(vsock_prot_lock); +static struct proto vsock_bpf_prot; + +static bool vsock_has_data(struct sock *sk, struct sk_psock *psock) +{ + struct vsock_sock *vsk =3D vsock_sk(sk); + s64 ret; + + ret =3D vsock_connectible_has_data(vsk); + if (ret > 0) + return true; + + return vsock_sk_has_data(sk, psock); +} + +static int vsock_msg_wait_data(struct sock *sk, struct sk_psock *psock, lo= ng timeo) +{ + int ret =3D 0; + + DEFINE_WAIT_FUNC(wait, woken_wake_function); + + if (sk->sk_shutdown & RCV_SHUTDOWN) + return 1; + + if (!timeo) + return ret; + + add_wait_queue(sk_sleep(sk), &wait); + sk_set_bit(SOCKWQ_ASYNC_WAITDATA, sk); + ret =3D vsock_has_data(sk, psock); + if (!ret) { + wait_woken(&wait, TASK_INTERRUPTIBLE, timeo); + ret =3D vsock_has_data(sk, psock); + } + sk_clear_bit(SOCKWQ_ASYNC_WAITDATA, sk); + remove_wait_queue(sk_sleep(sk), &wait); + return ret; +} + +static int __vsock_recvmsg(struct sock *sk, struct msghdr *msg, size_t len= , int flags) +{ + struct socket *sock =3D sk->sk_socket; + int err; + + if (sk->sk_type =3D=3D SOCK_STREAM || sk->sk_type =3D=3D SOCK_SEQPACKET) + err =3D vsock_connectible_recvmsg(sock, msg, len, flags); + else if (sk->sk_type =3D=3D SOCK_DGRAM) + err =3D vsock_dgram_recvmsg(sock, msg, len, flags); + else + err =3D -EPROTOTYPE; + + return err; +} + +static int vsock_bpf_recvmsg(struct sock *sk, struct msghdr *msg, + size_t len, int flags, int *addr_len) +{ + struct sk_psock *psock; + int copied; + + psock =3D sk_psock_get(sk); + lock_sock(sk); + if (unlikely(!psock)) { + release_sock(sk); + return __vsock_recvmsg(sk, msg, len, flags); + } + + if (vsock_has_data(sk, psock) && sk_psock_queue_empty(psock)) { + release_sock(sk); + sk_psock_put(sk, psock); + return __vsock_recvmsg(sk, msg, len, flags); + } + +msg_bytes_ready: + copied =3D sk_msg_recvmsg(sk, psock, msg, len, flags); + if (!copied) { + long timeo; + int data; + + timeo =3D sock_rcvtimeo(sk, flags & MSG_DONTWAIT); + data =3D vsock_msg_wait_data(sk, psock, timeo); + if (data) { + if (!sk_psock_queue_empty(psock)) + goto msg_bytes_ready; + release_sock(sk); + sk_psock_put(sk, psock); + return __vsock_recvmsg(sk, msg, len, flags); + } + copied =3D -EAGAIN; + } + release_sock(sk); + sk_psock_put(sk, psock); + + return copied; +} + +/* Copy of original proto with updated sock_map methods */ +static struct proto vsock_bpf_prot =3D { + .close =3D sock_map_close, + .recvmsg =3D vsock_bpf_recvmsg, + .sock_is_readable =3D sk_msg_is_readable, + .unhash =3D sock_map_unhash, +}; + +static void vsock_bpf_rebuild_protos(struct proto *prot, const struct prot= o *base) +{ + *prot =3D *base; + prot->close =3D sock_map_close; + prot->recvmsg =3D vsock_bpf_recvmsg; + prot->sock_is_readable =3D sk_msg_is_readable; +} + +static void vsock_bpf_check_needs_rebuild(struct proto *ops) +{ + /* Paired with the smp_store_release() below. */ + if (unlikely(ops !=3D smp_load_acquire(&vsock_prot_saved))) { + spin_lock_bh(&vsock_prot_lock); + if (likely(ops !=3D vsock_prot_saved)) { + vsock_bpf_rebuild_protos(&vsock_bpf_prot, ops); + /* Make sure proto function pointers are updated before publishing the + * pointer to the struct. + */ + smp_store_release(&vsock_prot_saved, ops); + } + spin_unlock_bh(&vsock_prot_lock); + } +} + +int vsock_bpf_update_proto(struct sock *sk, struct sk_psock *psock, bool r= estore) +{ + struct vsock_sock *vsk; + + if (restore) { + sk->sk_write_space =3D psock->saved_write_space; + sock_replace_proto(sk, psock->sk_proto); + return 0; + } + + vsk =3D vsock_sk(sk); + if (!vsk->transport) + return -ENODEV; + + if (!vsk->transport->read_skb) + return -EOPNOTSUPP; + + vsock_bpf_check_needs_rebuild(psock->sk_proto); + sock_replace_proto(sk, &vsock_bpf_prot); + return 0; +} + +void __init vsock_bpf_build_proto(void) +{ + vsock_bpf_rebuild_protos(&vsock_bpf_prot, &vsock_proto); +} diff --git a/net/vmw_vsock/vsock_loopback.c b/net/vmw_vsock/vsock_loopback.c index 671e03240fc5..40753b661c13 100644 --- a/net/vmw_vsock/vsock_loopback.c +++ b/net/vmw_vsock/vsock_loopback.c @@ -94,6 +94,8 @@ static struct virtio_transport loopback_transport =3D { .notify_send_pre_enqueue =3D virtio_transport_notify_send_pre_enqueue, .notify_send_post_enqueue =3D virtio_transport_notify_send_post_enqueue, .notify_buffer_size =3D virtio_transport_notify_buffer_size, + + .read_skb =3D virtio_transport_read_skb, }, =20 .send_pkt =3D vsock_loopback_send_pkt, --=20 2.35.1 From nobody Sat Sep 13 18:45:52 2025 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1C9BEC38142 for ; Tue, 31 Jan 2023 04:36:46 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229661AbjAaEgo (ORCPT ); Mon, 30 Jan 2023 23:36:44 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:43018 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230414AbjAaEgN (ORCPT ); Mon, 30 Jan 2023 23:36:13 -0500 Received: from mail-qt1-x82d.google.com (mail-qt1-x82d.google.com [IPv6:2607:f8b0:4864:20::82d]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 9D83B39CDD for ; Mon, 30 Jan 2023 20:35:46 -0800 (PST) Received: by mail-qt1-x82d.google.com with SMTP id z9so12360169qtv.5 for ; Mon, 30 Jan 2023 20:35:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance-com.20210112.gappssmtp.com; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=9YmT560oTftw19JZaSdqN79G8win6E1yvXJ4AismDYA=; b=fp+7E2dha4r9VCUXBWObySLYq0twxXrxh48Mf9108NaZCq1sgZ8EYxK6VLWxtguqha RZPLT9YxdCKjMH/GgjC/F9BPJnPI6dGV3zK6pPrRvu50o9zV/YlXb7T5ZF+GO5E2e5N3 9KF0VXSdqC3UIfAZGW2K0hmZKfv55IR3jRlsK71WkguiVBTO0RhzVqst5vezPM93+S5y j2HV/noeJj3G5rPnUrmxzXLCa877lUepPQj0KLQ2nwj6ra1a5Qa1VA5K/MkkD/BEifl8 PepRamh3hVU2kCeQ6vt730JFer0Sk8JuIJexTT7CG8uNGqYzSJ1OsEkiwVvyHW90kMcx dDZQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=9YmT560oTftw19JZaSdqN79G8win6E1yvXJ4AismDYA=; b=e8zu/+8WihuScnWJNtHQUC+iRntnGqxR1Oa0ZUTor+/vAh7siesK0jkX1mnE+s4ssj 8+LDCDzoEy793H9n8CWqRAS74SCaOOLqMGx4Ky/1sxLEdre7EyitsQ6CDoYzI54pgdKE MxLh55ux/+2bpriPvDy1Ib/nThOHta7Wtcb8DQX4S7aSAwxGaIikmOVEFwyZ4+2ESzDl KJKu2FUkLy6qrOphflXcqCb8QphwKClJ30Tv7ykz6t+3p3CZx/Rslkv/P5PuAjlI38et 8kFrMYnWp90jFv+RAei0KBU6h46ym1Yl9ra4KOaO6kvwvAmsoTPeWEb5DjoxnLkbCdfV KIhg== X-Gm-Message-State: AO0yUKXIHD6D5jeUsoUgrA71tyjVlM94SooMTlwwamHQ3IqD2U1e5BAa SefWBKBsRWCx0GQbfxHZ7gWatQ== X-Google-Smtp-Source: AK7set+jOiGnB8wQtiTzhJPJ4pzCzwkUKNNkB6ogZiIUW7dzSxfuY4VlR3/gF3ab0rqhbOtSNk2zog== X-Received: by 2002:a05:622a:1016:b0:3b8:248b:a035 with SMTP id d22-20020a05622a101600b003b8248ba035mr27029137qte.19.1675139746210; Mon, 30 Jan 2023 20:35:46 -0800 (PST) Received: from C02G8BMUMD6R.bytedance.net ([148.59.24.152]) by smtp.gmail.com with ESMTPSA id b13-20020ac801cd000000b003a6a19ee4f0sm9260682qtg.33.2023.01.30.20.35.37 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 30 Jan 2023 20:35:45 -0800 (PST) From: Bobby Eshleman To: Stefan Hajnoczi , Stefano Garzarella , "Michael S. Tsirkin" , Jason Wang , "David S. Miller" , Eric Dumazet , Jakub Kicinski , Paolo Abeni , Andrii Nakryiko , Mykola Lysenko , Alexei Starovoitov , Daniel Borkmann , Martin KaFai Lau , Song Liu , Yonghong Song , John Fastabend , KP Singh , Stanislav Fomichev , Hao Luo , Jiri Olsa , Shuah Khan Cc: Bobby Eshleman , Bobby Eshleman , linux-kernel@vger.kernel.org, kvm@vger.kernel.org, virtualization@lists.linux-foundation.org, netdev@vger.kernel.org, bpf@vger.kernel.org, linux-kselftest@vger.kernel.org, jakub@cloudflare.com, hdanton@sina.com, cong.wang@bytedance.com Subject: [PATCH RFC net-next v2 2/3] selftests/bpf: add vsock to vmtest.sh Date: Mon, 30 Jan 2023 20:35:13 -0800 Message-Id: <20230118-support-vsock-sockmap-connectible-v2-2-58ffafde0965@bytedance.com> X-Mailer: git-send-email 2.35.1 In-Reply-To: <20230118-support-vsock-sockmap-connectible-v2-0-58ffafde0965@bytedance.com> References: <20230118-support-vsock-sockmap-connectible-v2-0-58ffafde0965@bytedance.com> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Mailer: b4 0.12.1 Content-Transfer-Encoding: quoted-printable Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Add vsock loopback to the test kernel. This allows sockmap for vsock to be tested. Signed-off-by: Bobby Eshleman Acked-by: Stefano Garzarella --- tools/testing/selftests/bpf/config.aarch64 | 2 ++ tools/testing/selftests/bpf/config.s390x | 3 +++ tools/testing/selftests/bpf/config.x86_64 | 3 +++ 3 files changed, 8 insertions(+) diff --git a/tools/testing/selftests/bpf/config.aarch64 b/tools/testing/sel= ftests/bpf/config.aarch64 index 1f0437644186..253821494884 100644 --- a/tools/testing/selftests/bpf/config.aarch64 +++ b/tools/testing/selftests/bpf/config.aarch64 @@ -176,6 +176,8 @@ CONFIG_VIRTIO_MMIO_CMDLINE_DEVICES=3Dy CONFIG_VIRTIO_MMIO=3Dy CONFIG_VIRTIO_NET=3Dy CONFIG_VIRTIO_PCI=3Dy +CONFIG_VIRTIO_VSOCKETS_COMMON=3Dy CONFIG_VLAN_8021Q=3Dy CONFIG_VSOCKETS=3Dy +CONFIG_VSOCKETS_LOOPBACK=3Dy CONFIG_XFRM_USER=3Dy diff --git a/tools/testing/selftests/bpf/config.s390x b/tools/testing/selft= ests/bpf/config.s390x index d49f6170e7bd..2ba92167be35 100644 --- a/tools/testing/selftests/bpf/config.s390x +++ b/tools/testing/selftests/bpf/config.s390x @@ -140,5 +140,8 @@ CONFIG_VIRTIO_BALLOON=3Dy CONFIG_VIRTIO_BLK=3Dy CONFIG_VIRTIO_NET=3Dy CONFIG_VIRTIO_PCI=3Dy +CONFIG_VIRTIO_VSOCKETS_COMMON=3Dy CONFIG_VLAN_8021Q=3Dy +CONFIG_VSOCKETS=3Dy +CONFIG_VSOCKETS_LOOPBACK=3Dy CONFIG_XFRM_USER=3Dy diff --git a/tools/testing/selftests/bpf/config.x86_64 b/tools/testing/self= tests/bpf/config.x86_64 index dd97d61d325c..b650b2e617b8 100644 --- a/tools/testing/selftests/bpf/config.x86_64 +++ b/tools/testing/selftests/bpf/config.x86_64 @@ -234,7 +234,10 @@ CONFIG_VIRTIO_BLK=3Dy CONFIG_VIRTIO_CONSOLE=3Dy CONFIG_VIRTIO_NET=3Dy CONFIG_VIRTIO_PCI=3Dy +CONFIG_VIRTIO_VSOCKETS_COMMON=3Dy CONFIG_VLAN_8021Q=3Dy +CONFIG_VSOCKETS=3Dy +CONFIG_VSOCKETS_LOOPBACK=3Dy CONFIG_X86_ACPI_CPUFREQ=3Dy CONFIG_X86_CPUID=3Dy CONFIG_X86_MSR=3Dy --=20 2.35.1 From nobody Sat Sep 13 18:45:52 2025 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id BF5B2C38142 for ; Tue, 31 Jan 2023 04:37:01 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229565AbjAaEg7 (ORCPT ); Mon, 30 Jan 2023 23:36:59 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:43340 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230522AbjAaEg1 (ORCPT ); Mon, 30 Jan 2023 23:36:27 -0500 Received: from mail-qt1-x835.google.com (mail-qt1-x835.google.com [IPv6:2607:f8b0:4864:20::835]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 8D1723A590 for ; Mon, 30 Jan 2023 20:35:54 -0800 (PST) Received: by mail-qt1-x835.google.com with SMTP id w3so3711884qts.7 for ; Mon, 30 Jan 2023 20:35:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance-com.20210112.gappssmtp.com; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=skMwyc22NR9Qk8YVny2dR/jEXQcu8nXYP2om5YcHDp8=; b=vbqASWaYlv8/x9oWVi1jq0jC7/PmzDkGXEQjFiy0sXuRAEqjH0A7jFO8775AstWjlH 1x8gnNQaryySG7a0fOiYPxDhGfddCQ0XklaZVrr/n8re5om8WYECP9s90uGxS4q8CKxK s2uEaLAXVG2MjBTBCCTKn2uGh057r+1H3pt53Kl7AWuyM7DIcXzmjvYzG23WWx5WEmk9 S04IYBPaUnvghaSOCUFoVn7WwMlS4D3dRo/uPVet+Z7CMcDBFIZZcVLQAtR389pgtGO/ uDNNsiX6IEpzwdSiQQfTFLNWp0ddWrGQR4mBNyb02t5DA6hTpNoPn8OxDv7VK0DtGJva d5NA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=skMwyc22NR9Qk8YVny2dR/jEXQcu8nXYP2om5YcHDp8=; b=TgNrejoy6X2SrGHIAXyW9CS+D3dhAn78uSe3hyxu+MX9noYnWxXHUB4y1+78TIVASO EIp9XrQHWpdm3VmaQHEvQys1FuSjRe4ajx+LNh4XY6pJsPBSJlvZG1fnsNk1hadslnqc 2tcrZL1sG0RBFX9DbqIK+6f3ZUqsuem0Ao5DaNtW9OHT7gjmRvH8fzBCLkfo2vZL2Lrr +LXerrbcLuS0WNgAEc+VizredbXBA9XChe+fIprTaCziDfgGbOwa5Zs1pYHCIGCetPa7 hVNXSR0gQrZ1L3BrvCq1Gr7Lj3kR9nIh8lJ+jzVrKJAl7lL/BuAsKr8GaomGf1M8H80Q whfA== X-Gm-Message-State: AO0yUKVJSDohcaAVfUQr2IQ6SHODEoq7gWpc8ENXkQ61dWVLy57PVssM V/7gI5Rm3OVRIUkYNlQr0vnSBw== X-Google-Smtp-Source: AK7set9BM+8iUKiCkpfLTmszHcuZgOQUjyY5cg1pD/EnFFDR3dMjz+xiPonG6jQ4anPf45O7e+VacQ== X-Received: by 2002:ac8:7e93:0:b0:3b8:2940:e2e8 with SMTP id w19-20020ac87e93000000b003b82940e2e8mr24857592qtj.14.1675139753541; Mon, 30 Jan 2023 20:35:53 -0800 (PST) Received: from C02G8BMUMD6R.bytedance.net ([148.59.24.152]) by smtp.gmail.com with ESMTPSA id b13-20020ac801cd000000b003a6a19ee4f0sm9260682qtg.33.2023.01.30.20.35.48 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 30 Jan 2023 20:35:53 -0800 (PST) From: Bobby Eshleman To: Stefan Hajnoczi , Stefano Garzarella , "Michael S. Tsirkin" , Jason Wang , "David S. Miller" , Eric Dumazet , Jakub Kicinski , Paolo Abeni , Andrii Nakryiko , Mykola Lysenko , Alexei Starovoitov , Daniel Borkmann , Martin KaFai Lau , Song Liu , Yonghong Song , John Fastabend , KP Singh , Stanislav Fomichev , Hao Luo , Jiri Olsa , Shuah Khan Cc: Bobby Eshleman , Bobby Eshleman , linux-kernel@vger.kernel.org, kvm@vger.kernel.org, virtualization@lists.linux-foundation.org, netdev@vger.kernel.org, bpf@vger.kernel.org, linux-kselftest@vger.kernel.org, jakub@cloudflare.com, hdanton@sina.com, cong.wang@bytedance.com Subject: [PATCH RFC net-next v2 3/3] selftests/bpf: Add a test case for vsock sockmap Date: Mon, 30 Jan 2023 20:35:14 -0800 Message-Id: <20230118-support-vsock-sockmap-connectible-v2-3-58ffafde0965@bytedance.com> X-Mailer: git-send-email 2.35.1 In-Reply-To: <20230118-support-vsock-sockmap-connectible-v2-0-58ffafde0965@bytedance.com> References: <20230118-support-vsock-sockmap-connectible-v2-0-58ffafde0965@bytedance.com> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Mailer: b4 0.12.1 Content-Transfer-Encoding: quoted-printable Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Add a test case testing the redirection from connectible AF_VSOCK sockets to connectible AF_UNIX sockets. Signed-off-by: Bobby Eshleman Acked-by: Stefano Garzarella --- .../selftests/bpf/prog_tests/sockmap_listen.c | 163 +++++++++++++++++= ++++ 1 file changed, 163 insertions(+) diff --git a/tools/testing/selftests/bpf/prog_tests/sockmap_listen.c b/tool= s/testing/selftests/bpf/prog_tests/sockmap_listen.c index 2cf0c7a3fe23..8b5a2e09c9ed 100644 --- a/tools/testing/selftests/bpf/prog_tests/sockmap_listen.c +++ b/tools/testing/selftests/bpf/prog_tests/sockmap_listen.c @@ -18,6 +18,7 @@ #include #include #include +#include =20 #include #include @@ -249,6 +250,16 @@ static void init_addr_loopback6(struct sockaddr_storag= e *ss, socklen_t *len) *len =3D sizeof(*addr6); } =20 +static void init_addr_loopback_vsock(struct sockaddr_storage *ss, socklen_= t *len) +{ + struct sockaddr_vm *addr =3D memset(ss, 0, sizeof(*ss)); + + addr->svm_family =3D AF_VSOCK; + addr->svm_port =3D VMADDR_PORT_ANY; + addr->svm_cid =3D VMADDR_CID_LOCAL; + *len =3D sizeof(*addr); +} + static void init_addr_loopback(int family, struct sockaddr_storage *ss, socklen_t *len) { @@ -259,6 +270,9 @@ static void init_addr_loopback(int family, struct socka= ddr_storage *ss, case AF_INET6: init_addr_loopback6(ss, len); return; + case AF_VSOCK: + init_addr_loopback_vsock(ss, len); + return; default: FAIL("unsupported address family %d", family); } @@ -1434,6 +1448,8 @@ static const char *family_str(sa_family_t family) return "IPv6"; case AF_UNIX: return "Unix"; + case AF_VSOCK: + return "VSOCK"; default: return "unknown"; } @@ -1644,6 +1660,151 @@ static void test_unix_redir(struct test_sockmap_lis= ten *skel, struct bpf_map *ma unix_skb_redir_to_connected(skel, map, sotype); } =20 +/* Returns two connected loopback vsock sockets */ +static int vsock_socketpair_connectible(int sotype, int *v0, int *v1) +{ + struct sockaddr_storage addr; + socklen_t len =3D sizeof(addr); + int s, p, c; + + s =3D socket_loopback(AF_VSOCK, sotype); + if (s < 0) + return -1; + + c =3D xsocket(AF_VSOCK, sotype | SOCK_NONBLOCK, 0); + if (c =3D=3D -1) + goto close_srv; + + if (getsockname(s, sockaddr(&addr), &len) < 0) + goto close_cli; + + if (connect(c, sockaddr(&addr), len) < 0 && errno !=3D EINPROGRESS) { + FAIL_ERRNO("connect"); + goto close_cli; + } + + len =3D sizeof(addr); + p =3D accept_timeout(s, sockaddr(&addr), &len, IO_TIMEOUT_SEC); + if (p < 0) + goto close_cli; + + *v0 =3D p; + *v1 =3D c; + + return 0; + +close_cli: + close(c); +close_srv: + close(s); + + return -1; +} + +static void vsock_unix_redir_connectible(int sock_mapfd, int verd_mapfd, + enum redir_mode mode, int sotype) +{ + const char *log_prefix =3D redir_mode_str(mode); + char a =3D 'a', b =3D 'b'; + int u0, u1, v0, v1; + int sfd[2]; + unsigned int pass; + int err, n; + u32 key; + + zero_verdict_count(verd_mapfd); + + if (socketpair(AF_UNIX, SOCK_STREAM | SOCK_NONBLOCK, 0, sfd)) + return; + + u0 =3D sfd[0]; + u1 =3D sfd[1]; + + err =3D vsock_socketpair_connectible(sotype, &v0, &v1); + if (err) { + FAIL("vsock_socketpair_connectible() failed"); + goto close_uds; + } + + err =3D add_to_sockmap(sock_mapfd, u0, v0); + if (err) { + FAIL("add_to_sockmap failed"); + goto close_vsock; + } + + n =3D write(v1, &a, sizeof(a)); + if (n < 0) + FAIL_ERRNO("%s: write", log_prefix); + if (n =3D=3D 0) + FAIL("%s: incomplete write", log_prefix); + if (n < 1) + goto out; + + n =3D recv(mode =3D=3D REDIR_INGRESS ? u0 : u1, &b, sizeof(b), MSG_DONTWA= IT); + if (n < 0) + FAIL("%s: recv() err, errno=3D%d", log_prefix, errno); + if (n =3D=3D 0) + FAIL("%s: incomplete recv", log_prefix); + if (b !=3D a) + FAIL("%s: vsock socket map failed, %c !=3D %c", log_prefix, a, b); + + key =3D SK_PASS; + err =3D xbpf_map_lookup_elem(verd_mapfd, &key, &pass); + if (err) + goto out; + if (pass !=3D 1) + FAIL("%s: want pass count 1, have %d", log_prefix, pass); +out: + key =3D 0; + bpf_map_delete_elem(sock_mapfd, &key); + key =3D 1; + bpf_map_delete_elem(sock_mapfd, &key); + +close_vsock: + close(v0); + close(v1); + +close_uds: + close(u0); + close(u1); +} + +static void vsock_unix_skb_redir_connectible(struct test_sockmap_listen *s= kel, + struct bpf_map *inner_map, + int sotype) +{ + int verdict =3D bpf_program__fd(skel->progs.prog_skb_verdict); + int verdict_map =3D bpf_map__fd(skel->maps.verdict_map); + int sock_map =3D bpf_map__fd(inner_map); + int err; + + err =3D xbpf_prog_attach(verdict, sock_map, BPF_SK_SKB_VERDICT, 0); + if (err) + return; + + skel->bss->test_ingress =3D false; + vsock_unix_redir_connectible(sock_map, verdict_map, REDIR_EGRESS, sotype); + skel->bss->test_ingress =3D true; + vsock_unix_redir_connectible(sock_map, verdict_map, REDIR_INGRESS, sotype= ); + + xbpf_prog_detach2(verdict, sock_map, BPF_SK_SKB_VERDICT); +} + +static void test_vsock_redir(struct test_sockmap_listen *skel, struct bpf_= map *map) +{ + const char *family_name, *map_name; + char s[MAX_TEST_NAME]; + + family_name =3D family_str(AF_VSOCK); + map_name =3D map_type_str(map); + snprintf(s, sizeof(s), "%s %s %s", map_name, family_name, __func__); + if (!test__start_subtest(s)) + return; + + vsock_unix_skb_redir_connectible(skel, map, SOCK_STREAM); + vsock_unix_skb_redir_connectible(skel, map, SOCK_SEQPACKET); +} + static void test_reuseport(struct test_sockmap_listen *skel, struct bpf_map *map, int family, int sotype) { @@ -2015,12 +2176,14 @@ void serial_test_sockmap_listen(void) run_tests(skel, skel->maps.sock_map, AF_INET6); test_unix_redir(skel, skel->maps.sock_map, SOCK_DGRAM); test_unix_redir(skel, skel->maps.sock_map, SOCK_STREAM); + test_vsock_redir(skel, skel->maps.sock_map); =20 skel->bss->test_sockmap =3D false; run_tests(skel, skel->maps.sock_hash, AF_INET); run_tests(skel, skel->maps.sock_hash, AF_INET6); test_unix_redir(skel, skel->maps.sock_hash, SOCK_DGRAM); test_unix_redir(skel, skel->maps.sock_hash, SOCK_STREAM); + test_vsock_redir(skel, skel->maps.sock_hash); =20 test_sockmap_listen__destroy(skel); } --=20 2.35.1