From nobody Thu Oct 9 11:03:37 2025 Received: from mail-pf1-f179.google.com (mail-pf1-f179.google.com [209.85.210.179]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id DB62A283CAA for ; Wed, 18 Jun 2025 09:24:45 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.210.179 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1750238687; cv=none; b=Cz3bN7atEjisVABRAyeHXsiZK0I8jtuNqXEaZmCks3Pu1o4JWySIzBMKkhmB7/V9qRgok73HhhvSKqc7RKdG1ph3IcpAwCKUu+i4d3L26jCcNpRsCUlDDZ7j0KAPnLoBfQ7UM6qI6ORZxJf3AJgmCxsSfoa5EgQaPatlN7x/kEM= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1750238687; c=relaxed/simple; bh=3vl6QDP6/oKInQpbUd/mwtNJqKOcafNUpwPOeaBo8Z0=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=A0LfLNN0XJHyY9EDLjd1Ln6tCQ3USMz5rTE7yXN5bHWi/bd7GDOsLcGaF7FtM3PaOzXrogAu9Msu3FtQ8xO2ttNDpiu94X8wYTZo9Z12Hh1N0GGc8L5A5RcPiFcaVJ9ztZ5mo1nSVxi3oH/a2JoeG8QdLccqScY3wSI/90Zvx/0= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=broadcom.com; spf=fail smtp.mailfrom=broadcom.com; dkim=pass (1024-bit key) header.d=broadcom.com header.i=@broadcom.com header.b=TT4kL+GZ; arc=none smtp.client-ip=209.85.210.179 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=broadcom.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=broadcom.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=broadcom.com header.i=@broadcom.com header.b="TT4kL+GZ" Received: by mail-pf1-f179.google.com with SMTP id d2e1a72fcca58-748c3afd0dbso1702286b3a.0 for ; Wed, 18 Jun 2025 02:24:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=broadcom.com; s=google; t=1750238685; x=1750843485; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=jZ8ourLzAapYlWvSPc5AJIM32EfKtOVtF0mK8gd87tE=; b=TT4kL+GZLwCB5b+jAxcql3Gw26gjrQD4LeVsaI7jPhVPHjzPuziA4KNQmBeyj7MkGw mykUZrdCbPRX0HbeNeRvOlpcv/XnIfthxvw7h/xiDia/CPYzcwpQMJVH4LI/3lC59RwM d1Hwb519mPNUpvczIOefhX70+l5VnuqG36oaI= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1750238685; x=1750843485; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=jZ8ourLzAapYlWvSPc5AJIM32EfKtOVtF0mK8gd87tE=; b=BWhWDTxJw+goj/AcThwYILlzWK8PgIGqxCP/qsv5Hi4gZB2OFgMiwRORbs6PUTXhxi /P8xBXtDcSUhx3LjrCiWQF7Xdoki88qGbTlmx6Ck4/clCglUMydN5WEfF3uabcOsSaEC MOdQcAGjgR+t6RlTQPfOoQ9U03Ak8rHSRvBPcU2GRG76dOG61Jho0ADyci9u1238FKVe SZB4kPNCtJwVAX1mni/5AawbhLd0QpGmGngI/HDOMW+HLOFrJhyOODGDrSdL98/G1xcv 4nPqeDDVkT//kDnXr2WIpDNr0AqA6du7Sw8CeIz5k36tKgsP4V3GkTkKRSUsSyyyK22z td5g== X-Forwarded-Encrypted: i=1; AJvYcCUitr6u1xC0JMMKAUCoC9jpukKVCdpR1Sz7TEIcMWLYU3K2ncnRpgHGVPB7q1EahxkG5sdL1dMEbOjnrpg=@vger.kernel.org X-Gm-Message-State: AOJu0YwvG8U2OZXqQaFBH3ZCwnfiAbhli6GepjznCZ1Ho+0I4i90SVxr 57Y+WNrSbe9pd2tGyXZfOpV9Vdq0AoHanW4T/Nc04r2eB1/O20TpMbyP9HFd4zX6uw== X-Gm-Gg: ASbGncuc+WDhtK/340ILsuBs0alGWiY8Jpea55LhtjlJmGedK5qbJP61cBEC/sGc2GP AuZJyBGcqZYpPWpQdxvAv/LtCRAWa2e8t3yIH7i2ibDkMm8LPzs1eW59TB8+lVE7SDNO7arVZJV mpdcZR8p1dI2zlNIkguX6VWkWBKjX8R/SfzDq2e8mUArYJExj8RQ1JY0Y7L6NegNz27xuxuZFF1 vUIrs1TUOoNJZaN3hG2jH4aEm6cEXAo+gabU4aYCS7FDIQNLS0d5KKwimHplx6zkeog9iokfzR5 Tc7ugt/p9Kr2O+vj+Qin38hLQngyvp4P53priEsaTRF00iPqq7ctQdWr+OyTN3voD40Immyld8E NX+2LNkGNRK6/NB3K/OYoR9ll3rAakomdO99PTr4= X-Google-Smtp-Source: AGHT+IGJOA4NXBDo/o4TPk7suDzL2KF36mR4Chmt7HOCORSeWUnsk1Toh4o5Zx9SBDeZZ7JnlDcymg== X-Received: by 2002:a05:6a00:cd2:b0:736:9e40:13b1 with SMTP id d2e1a72fcca58-7489cfdb359mr23034981b3a.23.1750238685010; Wed, 18 Jun 2025 02:24:45 -0700 (PDT) Received: from localhost.localdomain ([192.19.203.250]) by smtp.gmail.com with ESMTPSA id d2e1a72fcca58-7488ffecd08sm10408993b3a.27.2025.06.18.02.24.41 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 18 Jun 2025 02:24:44 -0700 (PDT) From: Vikas Gupta To: davem@davemloft.net, edumazet@google.com, kuba@kernel.org, pabeni@redhat.com, andrew+netdev@lunn.ch, horms@kernel.org Cc: netdev@vger.kernel.org, linux-kernel@vger.kernel.org, michael.chan@broadcom.com, pavan.chebbi@broadcom.com, vsrama-krishna.nemani@broadcom.com, Vikas Gupta , Bhargava Chenna Marreddy , Rajashekar Hudumula Subject: [net-next, 05/10] bng_en: Add ring memory allocation support Date: Wed, 18 Jun 2025 14:47:35 +0000 Message-ID: <20250618144743.843815-6-vikas.gupta@broadcom.com> X-Mailer: git-send-email 2.47.1 In-Reply-To: <20250618144743.843815-1-vikas.gupta@broadcom.com> References: <20250618144743.843815-1-vikas.gupta@broadcom.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Add ring allocation/free mechanism which help to allocate rings (TX/RX/Completion) and backing stores memory on the host for the device. Future patches will use these functions. Signed-off-by: Vikas Gupta Reviewed-by: Bhargava Chenna Marreddy Reviewed-by: Rajashekar Hudumula --- drivers/net/ethernet/broadcom/bnge/Makefile | 3 +- .../net/ethernet/broadcom/bnge/bnge_rmem.c | 101 ++++++++++++++++++ .../net/ethernet/broadcom/bnge/bnge_rmem.h | 35 ++++++ 3 files changed, 138 insertions(+), 1 deletion(-) create mode 100644 drivers/net/ethernet/broadcom/bnge/bnge_rmem.c create mode 100644 drivers/net/ethernet/broadcom/bnge/bnge_rmem.h diff --git a/drivers/net/ethernet/broadcom/bnge/Makefile b/drivers/net/ethe= rnet/broadcom/bnge/Makefile index b8dbbc2d5972..1144594fc3f6 100644 --- a/drivers/net/ethernet/broadcom/bnge/Makefile +++ b/drivers/net/ethernet/broadcom/bnge/Makefile @@ -5,4 +5,5 @@ obj-$(CONFIG_BNGE) +=3D bng_en.o bng_en-y :=3D bnge_core.o \ bnge_devlink.o \ bnge_hwrm.o \ - bnge_hwrm_lib.o + bnge_hwrm_lib.o \ + bnge_rmem.o diff --git a/drivers/net/ethernet/broadcom/bnge/bnge_rmem.c b/drivers/net/e= thernet/broadcom/bnge/bnge_rmem.c new file mode 100644 index 000000000000..ef232c4217bc --- /dev/null +++ b/drivers/net/ethernet/broadcom/bnge/bnge_rmem.c @@ -0,0 +1,101 @@ +// SPDX-License-Identifier: GPL-2.0 +// Copyright (c) 2025 Broadcom. + +#include +#include +#include +#include +#include +#include +#include +#include + +#include "bnge.h" +#include "../bnxt/bnxt_hsi.h" +#include "bnge_hwrm_lib.h" +#include "bnge_rmem.h" + +void bnge_free_ring(struct bnge_dev *bd, struct bnge_ring_mem_info *rmem) +{ + struct pci_dev *pdev =3D bd->pdev; + int i; + + if (!rmem->pg_arr) + goto skip_pages; + + for (i =3D 0; i < rmem->nr_pages; i++) { + if (!rmem->pg_arr[i]) + continue; + + dma_free_coherent(&pdev->dev, rmem->page_size, + rmem->pg_arr[i], rmem->dma_arr[i]); + + rmem->pg_arr[i] =3D NULL; + } +skip_pages: + if (rmem->pg_tbl) { + size_t pg_tbl_size =3D rmem->nr_pages * 8; + + if (rmem->flags & BNGE_RMEM_USE_FULL_PAGE_FLAG) + pg_tbl_size =3D rmem->page_size; + dma_free_coherent(&pdev->dev, pg_tbl_size, + rmem->pg_tbl, rmem->dma_pg_tbl); + rmem->pg_tbl =3D NULL; + } + if (rmem->vmem_size && *rmem->vmem) { + vfree(*rmem->vmem); + *rmem->vmem =3D NULL; + } +} + +int bnge_alloc_ring(struct bnge_dev *bd, struct bnge_ring_mem_info *rmem) +{ + struct pci_dev *pdev =3D bd->pdev; + u64 valid_bit =3D 0; + int i; + + if (rmem->flags & (BNGE_RMEM_VALID_PTE_FLAG | BNGE_RMEM_RING_PTE_FLAG)) + valid_bit =3D PTU_PTE_VALID; + + if ((rmem->nr_pages > 1 || rmem->depth > 0) && !rmem->pg_tbl) { + size_t pg_tbl_size =3D rmem->nr_pages * 8; + + if (rmem->flags & BNGE_RMEM_USE_FULL_PAGE_FLAG) + pg_tbl_size =3D rmem->page_size; + rmem->pg_tbl =3D dma_alloc_coherent(&pdev->dev, pg_tbl_size, + &rmem->dma_pg_tbl, + GFP_KERNEL); + if (!rmem->pg_tbl) + return -ENOMEM; + } + + for (i =3D 0; i < rmem->nr_pages; i++) { + u64 extra_bits =3D valid_bit; + + rmem->pg_arr[i] =3D dma_alloc_coherent(&pdev->dev, + rmem->page_size, + &rmem->dma_arr[i], + GFP_KERNEL); + if (!rmem->pg_arr[i]) + return -ENOMEM; + + if (rmem->nr_pages > 1 || rmem->depth > 0) { + if (i =3D=3D rmem->nr_pages - 2 && + (rmem->flags & BNGE_RMEM_RING_PTE_FLAG)) + extra_bits |=3D PTU_PTE_NEXT_TO_LAST; + else if (i =3D=3D rmem->nr_pages - 1 && + (rmem->flags & BNGE_RMEM_RING_PTE_FLAG)) + extra_bits |=3D PTU_PTE_LAST; + rmem->pg_tbl[i] =3D + cpu_to_le64(rmem->dma_arr[i] | extra_bits); + } + } + + if (rmem->vmem_size) { + *rmem->vmem =3D vzalloc(rmem->vmem_size); + if (!(*rmem->vmem)) + return -ENOMEM; + } + + return 0; +} diff --git a/drivers/net/ethernet/broadcom/bnge/bnge_rmem.h b/drivers/net/e= thernet/broadcom/bnge/bnge_rmem.h new file mode 100644 index 000000000000..56de31ed6613 --- /dev/null +++ b/drivers/net/ethernet/broadcom/bnge/bnge_rmem.h @@ -0,0 +1,35 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +/* Copyright (c) 2025 Broadcom */ + +#ifndef _BNGE_RMEM_H_ +#define _BNGE_RMEM_H_ + +#define PTU_PTE_VALID 0x1UL +#define PTU_PTE_LAST 0x2UL +#define PTU_PTE_NEXT_TO_LAST 0x4UL + +struct bnge_ring_mem_info { + /* Number of pages to next level */ + int nr_pages; + int page_size; + u16 flags; +#define BNGE_RMEM_VALID_PTE_FLAG 1 +#define BNGE_RMEM_RING_PTE_FLAG 2 +#define BNGE_RMEM_USE_FULL_PAGE_FLAG 4 + + u16 depth; + + void **pg_arr; + dma_addr_t *dma_arr; + + __le64 *pg_tbl; + dma_addr_t dma_pg_tbl; + + int vmem_size; + void **vmem; +}; + +int bnge_alloc_ring(struct bnge_dev *bd, struct bnge_ring_mem_info *rmem); +void bnge_free_ring(struct bnge_dev *bd, struct bnge_ring_mem_info *rmem); + +#endif /* _BNGE_RMEM_H_ */ --=20 2.47.1