From nobody Wed Apr 1 22:13:36 2026 Received: from mail-pl1-f202.google.com (mail-pl1-f202.google.com [209.85.214.202]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 3750438B12F for ; Wed, 1 Apr 2026 10:34:45 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.214.202 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1775039686; cv=none; b=A1aZ1kjKtq385NzWvw9kUC3mIoseAKG+n3frBJ0iObs06anxU8hBtPxZ2X5AebR806H9Q4AZ7M/66GRDmybD9zpCaz10t/2Nj7cw04MOqeM6MYbFYneqqXbNRoq2k/xHsxnFkQiR3zRtGGNV5oOGi8jLdKbtCnrby9jqfgiuYp0= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1775039686; c=relaxed/simple; bh=wjxrTOFiqbNrzkBpeSHIEsXZbm1N3Jq4RcOByIT9HQg=; h=Date:Mime-Version:Message-ID:Subject:From:To:Cc:Content-Type; b=tgpM2r8h1mRa9mNmYTMlavtSg5COR0fAAnjKlL9E+1+ASsh+ph4K1Rowq2OKgCLMe+mxGsj371RzzrkAa9CqGqSt6BtGOQNCLkCUUYhtmycBZE+lEFUJ5WMstCeCJWMEMC6KtEdAm0a4TfATI9tknuGLm0ELHkyrTG2sKxV9hYE= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com; spf=pass smtp.mailfrom=flex--shivajikant.bounces.google.com; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b=OIJIjelI; arc=none smtp.client-ip=209.85.214.202 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=flex--shivajikant.bounces.google.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="OIJIjelI" Received: by mail-pl1-f202.google.com with SMTP id d9443c01a7336-2b242f76113so52596965ad.0 for ; Wed, 01 Apr 2026 03:34:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20251104; t=1775039684; x=1775644484; darn=vger.kernel.org; h=cc:to:from:subject:message-id:mime-version:date:from:to:cc:subject :date:message-id:reply-to; bh=BBENWfOz5m4aXswxX+1QLDnCjth4YArnAPodhlRMRE0=; b=OIJIjelI68juFoPjZfRxfv5rwr9/gXi7E8/9t3oEJKt7UK6CuGxZF6bLxwszXrDDhg Vw/4HFgk/Nd6KR/8MweE2quKxLqUV0n0k63X2Ig+vtgFH7zqTUNNp8vEVEYn9jj5mh3o vnd8OBbWsgwvMioaQKD2iVEp0WAImF3OdMlnTFiIy7ZNmzw7SybcPQxKWw2s21y1lDnj djt0nd7MBI6pSYV2j2kp+76RoH+f3UpRX1dhLQErMOnmCkqGoajuESzEVdRJjcWsdrjS f8AT9RcOiDsxSSLNNNfZsFbu2xoZgWT5VC0R+KwaG17WKgp8QzK098MTk7RHivJ6NDnz PGzA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1775039684; x=1775644484; h=cc:to:from:subject:message-id:mime-version:date:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=BBENWfOz5m4aXswxX+1QLDnCjth4YArnAPodhlRMRE0=; b=aXJWOF3zml/uuZir1xfiu6u6V4SOqvTV6zUy/Qd7GXtjrv5pdXwbk36/Vpqdsf6L7U eqJZ/FjoPIJTZR6NZF18gQuZkJT8bkDZcQZzrlOtP6XkXQjeDI0aK200XVeeC13Ikl1w ojhLvEyW0K47i4Ln+87MVCTAWYvFl8o1jXcxBewtLMshpMBgu49daB2spIW9eI7hc1Y1 BRWqrKapVRLLyYN97a7cfI5gDPCISfKpnw1iNERaeYyIND0qvTIjHabKPZvwtqgsbMzw 2faJWISIG0yO7jUvub1Iz6KdLtc2EPbcigK+PO/kzZvvKUlk1LL0ZdN7Sw6XNiIQkt+2 +Mxw== X-Forwarded-Encrypted: i=1; AJvYcCVh8b9vCMxkLLUqznUkNBJSoZ6C2tW6q7qGB8t5oje+Djt5Th7dcBy9BfATz5QNchRParNwcq/Uepex378=@vger.kernel.org X-Gm-Message-State: AOJu0YxlA15ss4p6E8a/5E0D9zTjEZ0SkBcQOQisMmbji1IQsLIIEMtz Bm2a+FD3XwaFkSg/gLfPLmjN+WZVZ4pxFP9a2FoxF/PQ6tCeE0MTksMHGfj4ZmFv8R77SuIksoP 6yIkQsxvAUMu033/XWdkBerCL0g== X-Received: from plfn17.prod.google.com ([2002:a17:902:e551:b0:2b0:5e63:fc48]) (user=shivajikant job=prod-delivery.src-stubby-dispatcher) by 2002:a17:903:2acb:b0:2b0:6ce3:8f7 with SMTP id d9443c01a7336-2b269cee743mr30155715ad.43.1775039684372; Wed, 01 Apr 2026 03:34:44 -0700 (PDT) Date: Wed, 1 Apr 2026 10:34:41 +0000 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: Mime-Version: 1.0 X-Mailer: git-send-email 2.53.0.1213.gd9a14994de-goog Message-ID: <20260401103441.1229964-1-shivajikant@google.com> Subject: [RFC PATCH] nvme: enable PCI P2PDMA support for RDMA transport From: Shivaji Kant To: kbusch@kernel.org, axboe@kernel.dk, hch@lst.de, sagi@grimberg.me Cc: linux-nvme@lists.infradead.org, linux-rdma@vger.kernel.org, linux-kernel@vger.kernel.org, Shivaji Kant , Pranjal Shrivastava Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Enable BLK_FEAT_PCI_P2PDMA on the NVMe when the underlying RDMA controller supports it. blk_stack_limits() currently filters out this feature bit because it is absent from BLK_FEAT_INHERIT_MASK. Manually re-assert the capability in nvme_update_ns_info() after the stacking operation. Hardware reachability remains enforced by late-stage distance checks during DMA mapping. Suggested-by: Pranjal Shrivastava Signed-off-by: Shivaji Kant --- drivers/nvme/host/core.c | 9 +++++++++ drivers/nvme/host/rdma.c | 15 +++++++++++++++ 2 files changed, 24 insertions(+) diff --git a/drivers/nvme/host/core.c b/drivers/nvme/host/core.c index a2da54f974fa..0d7b0f286895 100644 --- a/drivers/nvme/host/core.c +++ b/drivers/nvme/host/core.c @@ -2205,6 +2205,15 @@ static int nvme_update_ns_info_generic(struct nvme_n= s *ns, nvme_set_ctrl_limits(ns->ctrl, &lim, false); =20 memflags =3D blk_mq_freeze_queue(ns->disk->queue); + + /* + * Explicitly check for P2PDMA support as BLK_FEAT_PCI_P2PDMA + * is filtered out by queue_limits_stack_bdev(). + */ + if (ns->ctrl->ops->supports_pci_p2pdma && + ns->ctrl->ops->supports_pci_p2pdma(ns->ctrl)) + lim.features |=3D BLK_FEAT_PCI_P2PDMA; + ret =3D queue_limits_commit_update(ns->disk->queue, &lim); set_disk_ro(ns->disk, nvme_ns_is_readonly(ns, info)); blk_mq_unfreeze_queue(ns->disk->queue, memflags); diff --git a/drivers/nvme/host/rdma.c b/drivers/nvme/host/rdma.c index 35c0822edb2d..3ce6f3e476b0 100644 --- a/drivers/nvme/host/rdma.c +++ b/drivers/nvme/host/rdma.c @@ -2189,6 +2189,20 @@ static void nvme_rdma_reset_ctrl_work(struct work_st= ruct *work) nvme_rdma_reconnect_or_remove(ctrl, ret); } =20 +static bool nvme_rdma_supports_pci_p2pdma(struct nvme_ctrl *ctrl) +{ + struct nvme_rdma_ctrl *r_ctrl =3D to_rdma_ctrl(ctrl); + bool supported =3D false; + + if (r_ctrl && r_ctrl->device) + supported =3D ib_dma_pci_p2p_dma_supported(r_ctrl->device->dev); + + dev_dbg(ctrl->device, "PCI P2PDMA support result: %s\n", + supported ? "PASSED" : "FAILED (HW/Driver restriction)"); + + return supported; +} + static const struct nvme_ctrl_ops nvme_rdma_ctrl_ops =3D { .name =3D "rdma", .module =3D THIS_MODULE, @@ -2203,6 +2217,7 @@ static const struct nvme_ctrl_ops nvme_rdma_ctrl_ops = =3D { .get_address =3D nvmf_get_address, .stop_ctrl =3D nvme_rdma_stop_ctrl, .get_virt_boundary =3D nvme_get_virt_boundary, + .supports_pci_p2pdma =3D nvme_rdma_supports_pci_p2pdma, }; =20 /* --=20 2.53.0.1213.gd9a14994de-goog