From nobody Tue Sep 29 08:22:56 2026 Received: from bali.collaboradmins.com (bali.collaboradmins.com [148.251.105.195]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id A104740861B; Mon, 10 Aug 2026 15:22:24 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=148.251.105.195 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786375346; cv=none; b=JOmBKZUq185S/HbobWdYCAtikW9W0AhHkzOYZVF//9X0/X2SOvkVjI8vJz9lUhr3pJ1d5+f7XYxymb/zqmKyn4NuVMdQRw6gTS+6vx9eofpUIIxclB4s9EW8AwAbRADViL6BqqHIMfjOH4VaCaVSsKuLwRknyyiiP1p6JBo7+X0= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786375346; c=relaxed/simple; bh=e71GDVW7JWrMuo4GRQ4jmJJ53lTpZaHnnvO0b/ljVaw=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=YaqcOyBPMlKHx5efbkHdqcaGyXUGohvvJJYefK/kYRNTy07LCcV+nP/HNB4jQaPapO7xvAdNfp5a8C/fFvVDx2yaWV6j2JV58npzN5vTQw0bbjdDe9t9C2czUlTvqFqWUB79fYDAc+VcOHQ7jraTmLvrhJFXSOW/EDgx3gxuwy4= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=collabora.com; spf=pass smtp.mailfrom=collabora.com; dkim=pass (2048-bit key) header.d=collabora.com header.i=@collabora.com header.b=ZXVL1KP3; arc=none smtp.client-ip=148.251.105.195 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=collabora.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=collabora.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=collabora.com header.i=@collabora.com header.b="ZXVL1KP3" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=collabora.com; s=mail; t=1786375342; bh=e71GDVW7JWrMuo4GRQ4jmJJ53lTpZaHnnvO0b/ljVaw=; h=From:Date:Subject:References:In-Reply-To:To:Cc:From; b=ZXVL1KP3rmA4kk5VU4wUurorKVvcVqgkaybOifIOJRVRmQvPn43oXGe+IwOn3JKAC q9+naFcgnzUj/cfisJelxbiVc30ZsgToGaWrduqq+B2dCPbTdudKwT/oLhO3R/+PQt QpDpx/gW9kWjNlrJ0SsDGSxDvYCnUw+NAGArX6IijQ6tAWH/z2go/TbXMteBsvdJzK ZnpjmB/zSPlA0YAkrqYwYV+2eA16808lueF3YuIIAlTsHVrHdZET9QIOJ9fPkpf7ro Zo79o9M0aF1p9hOhGQfozw1FeZZdKbRu+lpz/l1TaAaH3zQod6jqIymVAva1FVKEwl 2IxcMKmlPPrsg== Received: from [192.168.0.15] (unknown [100.64.0.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: detlev) by bali.collaboradmins.com (Postfix) with ESMTPSA id 5B34D17E080A; Mon, 10 Aug 2026 17:22:21 +0200 (CEST) From: Detlev Casanova Date: Mon, 10 Aug 2026 11:22:11 -0400 Subject: [PATCH v2 1/5] media: rkvdec: Keep RCB to the correct size Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <20260810-rkvdec-multicore-v2-1-986f89d22cdc@collabora.com> References: <20260810-rkvdec-multicore-v2-0-986f89d22cdc@collabora.com> In-Reply-To: <20260810-rkvdec-multicore-v2-0-986f89d22cdc@collabora.com> To: Mauro Carvalho Chehab , Ezequiel Garcia , Heiko Stuebner , Nicolas Dufresne , Hans Verkuil , Jonas Karlman Cc: =?utf-8?q?Sven_P=C3=BCschel?= , kernel@collabora.com, linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-rockchip@lists.infradead.org, linux-arm-kernel@lists.infradead.org, Detlev Casanova X-Mailer: b4 0.15.2 Currently, if a video changes resolution, the RCB size might be too small and the HW could try to write out of the allocated buffer. To fix that, make sure that the RCB size is validated for each run and increase the buffer size when needed. Fixes: e5640dbb991c ("media: rkvdec: Add RCB and SRAM support") Signed-off-by: Detlev Casanova --- .../media/platform/rockchip/rkvdec/rkvdec-rcb.c | 26 +++++++++++++++--- .../media/platform/rockchip/rkvdec/rkvdec-rcb.h | 3 ++- drivers/media/platform/rockchip/rkvdec/rkvdec.c | 31 +++++++++++-------= ---- 3 files changed, 40 insertions(+), 20 deletions(-) diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.c b/drivers/= media/platform/rockchip/rkvdec/rkvdec-rcb.c index fdcf1f177379..191f78278c01 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.c @@ -17,6 +17,8 @@ struct rkvdec_rcb_config { struct rkvdec_aux_buf *rcb_bufs; size_t rcb_count; + u32 width; + u32 height; }; =20 static size_t rkvdec_rcb_size(const struct rcb_size_info *size_info, @@ -40,6 +42,21 @@ int rkvdec_rcb_buf_count(struct rkvdec_ctx *ctx) return ctx->rcb_config->rcb_count; } =20 +bool rkvdec_rcb_buf_validate_size(struct rkvdec_ctx *ctx) +{ + struct rkvdec_rcb_config *cfg =3D ctx->rcb_config; + + bool ret =3D cfg && cfg->height >=3D ctx->decoded_fmt.fmt.pix_mp.height && + cfg->width >=3D ctx->decoded_fmt.fmt.pix_mp.width; + + if (!ret && cfg) { + dev_dbg(ctx->dev->dev, "RCB size %ux%u -> %ux%u\n", cfg->width, cfg->hei= ght, + ctx->decoded_fmt.fmt.pix_mp.width, ctx->decoded_fmt.fmt.pix_mp.height); + } + + return ret; +} + void rkvdec_free_rcb(struct rkvdec_ctx *ctx) { struct rkvdec_dev *dev =3D ctx->dev; @@ -77,14 +94,15 @@ void rkvdec_free_rcb(struct rkvdec_ctx *ctx) devm_kfree(dev->dev, cfg->rcb_bufs); =20 devm_kfree(dev->dev, cfg); + + ctx->rcb_config =3D NULL; } =20 -int rkvdec_allocate_rcb(struct rkvdec_ctx *ctx, +int rkvdec_allocate_rcb(struct rkvdec_ctx *ctx, u32 width, u32 height, const struct rcb_size_info *size_info, size_t rcb_count) { int ret, i; - u32 width, height; struct rkvdec_dev *rkvdec =3D ctx->dev; struct rkvdec_rcb_config *cfg; =20 @@ -105,8 +123,8 @@ int rkvdec_allocate_rcb(struct rkvdec_ctx *ctx, goto err_alloc; } =20 - width =3D ctx->decoded_fmt.fmt.pix_mp.width; - height =3D ctx->decoded_fmt.fmt.pix_mp.height; + cfg->width =3D width; + cfg->height =3D height; =20 for (i =3D 0; i < rcb_count; i++) { void *cpu =3D NULL; diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.h b/drivers/= media/platform/rockchip/rkvdec/rkvdec-rcb.h index 30e8002555c8..0662a4359bdf 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.h +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.h @@ -20,10 +20,11 @@ struct rcb_size_info { enum rcb_axis axis; }; =20 -int rkvdec_allocate_rcb(struct rkvdec_ctx *ctx, +int rkvdec_allocate_rcb(struct rkvdec_ctx *ctx, u32 width, u32 height, const struct rcb_size_info *size_info, size_t rcb_count); dma_addr_t rkvdec_rcb_buf_dma_addr(struct rkvdec_ctx *ctx, int id); size_t rkvdec_rcb_buf_size(struct rkvdec_ctx *ctx, int id); int rkvdec_rcb_buf_count(struct rkvdec_ctx *ctx); +bool rkvdec_rcb_buf_validate_size(struct rkvdec_ctx *ctx); void rkvdec_free_rcb(struct rkvdec_ctx *ctx); diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec.c b/drivers/medi= a/platform/rockchip/rkvdec/rkvdec.c index 1d1e9bfef8e9..31ddfcc58894 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec.c @@ -978,8 +978,7 @@ static int rkvdec_start_streaming(struct vb2_queue *q, = unsigned int count) { struct rkvdec_ctx *ctx =3D vb2_get_drv_priv(q); const struct rkvdec_coded_fmt_desc *desc; - const struct rkvdec_variant *variant =3D ctx->dev->variant; - int ret; + int ret =3D 0; =20 if (V4L2_TYPE_IS_CAPTURE(q->type)) return 0; @@ -988,20 +987,8 @@ static int rkvdec_start_streaming(struct vb2_queue *q,= unsigned int count) if (WARN_ON(!desc)) return -EINVAL; =20 - ret =3D rkvdec_allocate_rcb(ctx, variant->rcb_sizes, variant->num_rcb_siz= es); - if (ret) - return ret; - - if (desc->ops->start) { + if (desc->ops->start) ret =3D desc->ops->start(ctx); - if (ret) - goto err_ops_start; - } - - return 0; - -err_ops_start: - rkvdec_free_rcb(ctx); =20 return ret; } @@ -1174,6 +1161,20 @@ static void rkvdec_device_run(void *priv) return; } =20 + if (!rkvdec_rcb_buf_validate_size(ctx)) { + rkvdec_free_rcb(ctx); + + ret =3D rkvdec_allocate_rcb(ctx, + ctx->decoded_fmt.fmt.pix_mp.width, + ctx->decoded_fmt.fmt.pix_mp.height, + ctx->dev->variant->rcb_sizes, + ctx->dev->variant->num_rcb_sizes); + if (ret) { + rkvdec_job_finish(ctx, VB2_BUF_STATE_ERROR); + return; + } + } + ret =3D desc->ops->run(ctx); if (ret) rkvdec_job_finish(ctx, VB2_BUF_STATE_ERROR); --=20 2.55.0 From nobody Tue Sep 29 08:22:56 2026 Received: from bali.collaboradmins.com (bali.collaboradmins.com [148.251.105.195]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 91DED41D121; Mon, 10 Aug 2026 15:22:26 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=148.251.105.195 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786375348; cv=none; b=cUqv1JxsM+0hyE5r4Hbd5oNPHCJ1yPVJQaDG1gJn4IIdCbdUi9n8VDr4CJ7Xf50eH06mBm476uRJQXK2XrDBx7vm+r9768OEAE9uUicrkIvqoT7lh7KR2W/sW9k5fkYBzONmNUUcacYVtHc/hhkZ2mzeq2TAVA7Tz5zrRhzZpUI= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786375348; c=relaxed/simple; bh=HzMa2TTTRJC/kAywH5NeQSXaEXmOU6CGDcW/QAwpxFc=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=FtkpFTixPp14dECYbHiX4xbfR2OPcnXOWdwvY2Q2ICX4a1oeffSza6mR0ThBmOnRbhDc0GkRjkum9Snnqc455J2v+N1d/5ZYRA0z5SKULxWTDO8AUuY/PhhHVRwP0l10+VAuHn16Ya1Ytwd9EztX8nm8JkK9rNkjMKupBLOf1W0= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=collabora.com; spf=pass smtp.mailfrom=collabora.com; dkim=pass (2048-bit key) header.d=collabora.com header.i=@collabora.com header.b=M5e99HWy; arc=none smtp.client-ip=148.251.105.195 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=collabora.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=collabora.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=collabora.com header.i=@collabora.com header.b="M5e99HWy" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=collabora.com; s=mail; t=1786375344; bh=HzMa2TTTRJC/kAywH5NeQSXaEXmOU6CGDcW/QAwpxFc=; h=From:Date:Subject:References:In-Reply-To:To:Cc:From; b=M5e99HWylpG40RkL06JrSwYDxRNs/1/5J0ycDw3+7Qp4D2IvfiPhsxcsBU3ZTaz6m Yn94hdayDeeVmVRSE7P1QJmuZJlazLBEKTgGAJXTEBTRlnQ0vVFSCxuMn4PTTNZ6LI wn9nAwSXROAOCMac/vK8cnIJtNE5BmonT5f1+gPh6g8uX+ppDptf4MbCP81Jn/9Ogp e9tY0YHVXc6lEF2ytpkNTsUbdCRnaZyecP73esfsLp5QQ/Zz3C3DiEkmSVQ8bF6sVx rOSjzUT3K8HjdTf+CSXD7aq0GmEkuMkfHNDBAz33yOJs1ZJnuQ+qarcyOAqJtQWDLA iH54CYCoOkFtg== Received: from [192.168.0.15] (unknown [100.64.0.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: detlev) by bali.collaboradmins.com (Postfix) with ESMTPSA id 3D72317E0899; Mon, 10 Aug 2026 17:22:23 +0200 (CEST) From: Detlev Casanova Date: Mon, 10 Aug 2026 11:22:12 -0400 Subject: [PATCH v2 2/5] media: rkvdec: Remove unused need_reset Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <20260810-rkvdec-multicore-v2-2-986f89d22cdc@collabora.com> References: <20260810-rkvdec-multicore-v2-0-986f89d22cdc@collabora.com> In-Reply-To: <20260810-rkvdec-multicore-v2-0-986f89d22cdc@collabora.com> To: Mauro Carvalho Chehab , Ezequiel Garcia , Heiko Stuebner , Nicolas Dufresne , Hans Verkuil , Jonas Karlman Cc: =?utf-8?q?Sven_P=C3=BCschel?= , kernel@collabora.com, linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-rockchip@lists.infradead.org, linux-arm-kernel@lists.infradead.org, Detlev Casanova X-Mailer: b4 0.15.2 A left-over from the iommu restore mecanism was forgotten. As need_reset is never set to true, the if has no use. The actual restore function is called above it vase the IRQ isn't in a success status. Signed-off-by: Detlev Casanova --- drivers/media/platform/rockchip/rkvdec/rkvdec.c | 8 -------- 1 file changed, 8 deletions(-) diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec.c b/drivers/medi= a/platform/rockchip/rkvdec/rkvdec.c index 31ddfcc58894..db2731af06cf 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec.c @@ -1462,7 +1462,6 @@ static irqreturn_t vdpu381_irq_handler(struct rkvdec_= ctx *ctx) { struct rkvdec_dev *rkvdec =3D ctx->dev; enum vb2_buffer_state state; - bool need_reset =3D 0; u32 status; =20 status =3D readl(rkvdec->regs + VDPU381_REG_STA_INT); @@ -1478,9 +1477,6 @@ static irqreturn_t vdpu381_irq_handler(struct rkvdec_= ctx *ctx) rkvdec_iommu_restore(rkvdec); } =20 - if (need_reset) - rkvdec_iommu_restore(rkvdec); - if (cancel_delayed_work(&rkvdec->watchdog_work)) rkvdec_job_finish(ctx, state); =20 @@ -1491,7 +1487,6 @@ static irqreturn_t vdpu383_irq_handler(struct rkvdec_= ctx *ctx) { struct rkvdec_dev *rkvdec =3D ctx->dev; enum vb2_buffer_state state; - bool need_reset =3D 0; u32 status; =20 status =3D readl(rkvdec->link + VDPU383_LINK_STA_INT); @@ -1507,9 +1502,6 @@ static irqreturn_t vdpu383_irq_handler(struct rkvdec_= ctx *ctx) rkvdec_iommu_restore(rkvdec); } =20 - if (need_reset) - rkvdec_iommu_restore(rkvdec); - if (cancel_delayed_work(&rkvdec->watchdog_work)) rkvdec_job_finish(ctx, state); =20 --=20 2.55.0 From nobody Tue Sep 29 08:22:56 2026 Received: from bali.collaboradmins.com (bali.collaboradmins.com [148.251.105.195]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 7F3A940F75A; Mon, 10 Aug 2026 15:22:28 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=148.251.105.195 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786375350; cv=none; b=ZS2ePmTGMy1rCnCtxeRHZtVPBQXqmw2URSa06JBaqnIBOMYiQtI0oD50wlynLy8XPSD/F8KT+31iyoOn7Hl8uwVdfvLtVm2fyll/5lBhfni6Dnzi5LrNVD0pL+IRE2Y1siPhKVVBa+67on3FDsZhUk6H1Lh9OO3nLK6tuXk3dEo= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786375350; c=relaxed/simple; bh=7pR0JRM/UsbUq4mbJ7zowp/xReYV2Z8VN7p8X+cIgy8=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=ou5L3TBlfT/buxbq2NutiQFZL524xirdqjwQuUd7ZC4wIRc/bS0mtEPjJUSZWg0Ts5/yIDf0TmBC9HIvuMtTRDl7op7katGrx/JQDRioLYE/Ydm/YhzBNnaZKd8QbvUey13KdC0hrvqn4XhCoRrLov6pS7LBDIQxRyjyEuR+zpQ= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=collabora.com; spf=pass smtp.mailfrom=collabora.com; dkim=pass (2048-bit key) header.d=collabora.com header.i=@collabora.com header.b=DhTMRXbA; arc=none smtp.client-ip=148.251.105.195 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=collabora.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=collabora.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=collabora.com header.i=@collabora.com header.b="DhTMRXbA" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=collabora.com; s=mail; t=1786375346; bh=7pR0JRM/UsbUq4mbJ7zowp/xReYV2Z8VN7p8X+cIgy8=; h=From:Date:Subject:References:In-Reply-To:To:Cc:From; b=DhTMRXbADQpX45fzJ0DLCb+ZD/8o1IwA1RVlTrvWMiHd+aKyz4IKEOzuaCUJZ/VXL oPThHLjIsDZfHUsTd9aeQ1wZ12TeWadRFP/E5LY1OVzOCuI2+axHomRu048HmWzWMG G9eFR8e+KMs9HO1Cxrhcmnr4y/GxuIeMmICFUNhoBGbFYAclR+Ngap7fCBabUhzcLh AGzL2nSknPns0EBv0ZQC5NtbW5DgPNQzZwFt7ZHJccPZBVM5EX0pukeQXo5bd33sIe 8skzO/Z+dbweRwmOspPstIGDETy3ops3WRIzgNaKPAtHU1rb7HMq/qAn0C1w//9cSG DgLYIYfyfw5Gg== Received: from [192.168.0.15] (unknown [100.64.0.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: detlev) by bali.collaboradmins.com (Postfix) with ESMTPSA id 1F12317E0A33; Mon, 10 Aug 2026 17:22:25 +0200 (CEST) From: Detlev Casanova Date: Mon, 10 Aug 2026 11:22:13 -0400 Subject: [PATCH v2 3/5] v4l2: export v4l2_m2m_set_max_parallel_jobs Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <20260810-rkvdec-multicore-v2-3-986f89d22cdc@collabora.com> References: <20260810-rkvdec-multicore-v2-0-986f89d22cdc@collabora.com> In-Reply-To: <20260810-rkvdec-multicore-v2-0-986f89d22cdc@collabora.com> To: Mauro Carvalho Chehab , Ezequiel Garcia , Heiko Stuebner , Nicolas Dufresne , Hans Verkuil , Jonas Karlman Cc: =?utf-8?q?Sven_P=C3=BCschel?= , kernel@collabora.com, linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-rockchip@lists.infradead.org, linux-arm-kernel@lists.infradead.org, Detlev Casanova X-Mailer: b4 0.15.2 --- drivers/media/v4l2-core/v4l2-mem2mem.c | 1 + 1 file changed, 1 insertion(+) diff --git a/drivers/media/v4l2-core/v4l2-mem2mem.c b/drivers/media/v4l2-co= re/v4l2-mem2mem.c index 14ac9c85803d..f6f8864f23d2 100644 --- a/drivers/media/v4l2-core/v4l2-mem2mem.c +++ b/drivers/media/v4l2-core/v4l2-mem2mem.c @@ -128,6 +128,7 @@ void v4l2_m2m_set_max_parallel_jobs(struct v4l2_m2m_dev= *m2m_dev, { m2m_dev->max_parallel_jobs =3D max_parallel_jobs; } +EXPORT_SYMBOL(v4l2_m2m_set_max_parallel_jobs); =20 struct vb2_queue *v4l2_m2m_get_vq(struct v4l2_m2m_ctx *m2m_ctx, enum v4l2_buf_type type) --=20 2.55.0 From nobody Tue Sep 29 08:22:56 2026 Received: from bali.collaboradmins.com (bali.collaboradmins.com [148.251.105.195]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 7634841E6DC; Mon, 10 Aug 2026 15:22:30 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=148.251.105.195 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786375354; cv=none; b=H0oDpLGwKS86NjYKJfM0OM/K+4DhZpXpH8p1Ii8EpQJrOJSb3XRH3I1fHI1WUk9tx16fp1kuZQd9lq5QOLMsgLW/T/qvasO0p8VYxrHJd+M2jcTW7qbsailfdAbLpLyRCwd+JNLT+Md6XpRA7Ck0HH7J8uT/+4CPlF13wC8+FJI= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786375354; c=relaxed/simple; bh=auOzmHsFn0rFEi5FtlFoqqg8Y9HPG59fE0Dm5z3CiBk=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=fB1NHyTmCg+WohWxkjnh3n3TQaiNbaGygHwpiKwdSo9fVjQJdB2zG8e/c5zm4OAeX/SFG5cDLfIcLsHMpDs7Q67iS7G39FDZY/eQRV6RF4x5KR26PVwAXFBQptV2KoCAaMbvgpGdkrxa7ADcR3BTmFmYxkKiWpW3Bn514pMlF6s= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=collabora.com; spf=pass smtp.mailfrom=collabora.com; dkim=pass (2048-bit key) header.d=collabora.com header.i=@collabora.com header.b=WbPHhxtR; arc=none smtp.client-ip=148.251.105.195 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=collabora.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=collabora.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=collabora.com header.i=@collabora.com header.b="WbPHhxtR" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=collabora.com; s=mail; t=1786375348; bh=auOzmHsFn0rFEi5FtlFoqqg8Y9HPG59fE0Dm5z3CiBk=; h=From:Date:Subject:References:In-Reply-To:To:Cc:From; b=WbPHhxtRSFCP9G8z/DOhV4JBXa5wokISgDvP7v5lgNnOAasEavjFt3c3BvPTlg6dT ZYeRTRbniJa8MARqG+BIWMdiqE+jUmcv0A/puWgct5+A9Z3d76tcXTjMvNSr2wzYej T8BxFdZElF7XBy0d/GS+is7pva5bueu96c9vylYq1t+mM1wIGQabbtLIwt1ONeWNVt D2bav9AlxbZaQGVN2uDHERkAeyuplYvbkK8lpIIQ6BYUCCicnL4ilRYxhlSvwdLitf 93StBb5om9+6WiQ6bUjU6VjctWoH2d5NSTCOIBSZLBNL30abeVnjmhy4gvJvHbJaN/ Yd4tqNqgml+Qw== Received: from [192.168.0.15] (unknown [100.64.0.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: detlev) by bali.collaboradmins.com (Postfix) with ESMTPSA id 02F4917E0D7E; Mon, 10 Aug 2026 17:22:26 +0200 (CEST) From: Detlev Casanova Date: Mon, 10 Aug 2026 11:22:14 -0400 Subject: [PATCH v2 4/5] media: rkvdec: Split into core and master platform drivers Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <20260810-rkvdec-multicore-v2-4-986f89d22cdc@collabora.com> References: <20260810-rkvdec-multicore-v2-0-986f89d22cdc@collabora.com> In-Reply-To: <20260810-rkvdec-multicore-v2-0-986f89d22cdc@collabora.com> To: Mauro Carvalho Chehab , Ezequiel Garcia , Heiko Stuebner , Nicolas Dufresne , Hans Verkuil , Jonas Karlman Cc: =?utf-8?q?Sven_P=C3=BCschel?= , kernel@collabora.com, linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-rockchip@lists.infradead.org, linux-arm-kernel@lists.infradead.org, Detlev Casanova X-Mailer: b4 0.15.2 Prepare the driver for multi-core support by restructuring around the component framework, based on what rga does. This commit only adds the plumbing and does not yet enable more than a single core to run (Each additionnal core adding will return -EBUSY). Core specific resources are moved to a rkvdec_core struct and rkvdec_dev only retains v4l2 device info, variant info and the main_core pointer. Even though only 1 core is being used, a core pointer is added to the rkvdec_ctx struct to prepare the variant backends to retrieve information based on the core selected for the job. Signed-off-by: Detlev Casanova --- .../media/platform/rockchip/rkvdec/rkvdec-h264.c | 17 +- .../media/platform/rockchip/rkvdec/rkvdec-hevc.c | 16 +- .../media/platform/rockchip/rkvdec/rkvdec-rcb.c | 61 +-- .../media/platform/rockchip/rkvdec/rkvdec-rcb.h | 7 +- .../platform/rockchip/rkvdec/rkvdec-vdpu381-h264.c | 24 +- .../platform/rockchip/rkvdec/rkvdec-vdpu381-hevc.c | 24 +- .../platform/rockchip/rkvdec/rkvdec-vdpu383-h264.c | 24 +- .../platform/rockchip/rkvdec/rkvdec-vdpu383-hevc.c | 26 +- .../media/platform/rockchip/rkvdec/rkvdec-vp9.c | 27 +- drivers/media/platform/rockchip/rkvdec/rkvdec.c | 506 ++++++++++++++---= ---- drivers/media/platform/rockchip/rkvdec/rkvdec.h | 23 +- 11 files changed, 472 insertions(+), 283 deletions(-) diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec-h264.c b/drivers= /media/platform/rockchip/rkvdec/rkvdec-h264.c index ffa606038192..d3841dc84d35 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec-h264.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec-h264.c @@ -227,6 +227,7 @@ static void set_poc_reg(struct rkvdec_regs *regs, uint3= 2_t poc, int id, bool bot static void config_registers(struct rkvdec_ctx *ctx, struct rkvdec_h264_run *run) { + struct rkvdec_core *core =3D ctx->core; struct rkvdec_dev *rkvdec =3D ctx->dev; const struct v4l2_ctrl_h264_decode_params *dec_params =3D run->decode_par= ams; const struct v4l2_ctrl_h264_sps *sps =3D run->sps; @@ -333,7 +334,7 @@ static void config_registers(struct rkvdec_ctx *ctx, offset =3D offsetof(struct rkvdec_h264_priv_tbl, err_info); regs->h26x.errorinfo_base =3D priv_start_addr + offset; =20 - rkvdec_memcpy_toio(rkvdec->regs, regs, + rkvdec_memcpy_toio(core->regs, regs, MIN(sizeof(*regs), sizeof(u32) * rkvdec->variant->num_regs)); } =20 @@ -358,7 +359,7 @@ static int rkvdec_h264_start(struct rkvdec_ctx *ctx) if (!h264_ctx) return -ENOMEM; =20 - priv_tbl =3D dma_alloc_coherent(rkvdec->dev, sizeof(*priv_tbl), + priv_tbl =3D dma_alloc_coherent(rkvdec->main_core->dev, sizeof(*priv_tbl), &h264_ctx->priv_tbl.dma, GFP_KERNEL); if (!priv_tbl) { ret =3D -ENOMEM; @@ -383,7 +384,7 @@ static void rkvdec_h264_stop(struct rkvdec_ctx *ctx) struct rkvdec_h264_ctx *h264_ctx =3D ctx->priv; struct rkvdec_dev *rkvdec =3D ctx->dev; =20 - dma_free_coherent(rkvdec->dev, h264_ctx->priv_tbl.size, + dma_free_coherent(rkvdec->main_core->dev, h264_ctx->priv_tbl.size, h264_ctx->priv_tbl.cpu, h264_ctx->priv_tbl.dma); kfree(h264_ctx); } @@ -391,7 +392,7 @@ static void rkvdec_h264_stop(struct rkvdec_ctx *ctx) static int rkvdec_h264_run(struct rkvdec_ctx *ctx) { struct v4l2_h264_reflist_builder reflist_builder; - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; struct rkvdec_h264_ctx *h264_ctx =3D ctx->priv; struct rkvdec_h264_run run; struct rkvdec_h264_priv_tbl *tbl =3D h264_ctx->priv_tbl.cpu; @@ -413,15 +414,15 @@ static int rkvdec_h264_run(struct rkvdec_ctx *ctx) =20 rkvdec_run_postamble(ctx, &run.base); =20 - schedule_delayed_work(&rkvdec->watchdog_work, msecs_to_jiffies(2000)); + schedule_delayed_work(&core->watchdog_work, msecs_to_jiffies(2000)); =20 - writel(1, rkvdec->regs + RKVDEC_REG_PREF_LUMA_CACHE_COMMAND); - writel(1, rkvdec->regs + RKVDEC_REG_PREF_CHR_CACHE_COMMAND); + writel(1, core->regs + RKVDEC_REG_PREF_LUMA_CACHE_COMMAND); + writel(1, core->regs + RKVDEC_REG_PREF_CHR_CACHE_COMMAND); =20 /* Start decoding! */ writel(RKVDEC_INTERRUPT_DEC_E | RKVDEC_CONFIG_DEC_CLK_GATE_E | RKVDEC_TIMEOUT_E | RKVDEC_BUF_EMPTY_E, - rkvdec->regs + RKVDEC_REG_INTERRUPT); + core->regs + RKVDEC_REG_INTERRUPT); =20 return 0; } diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec-hevc.c b/drivers= /media/platform/rockchip/rkvdec/rkvdec-hevc.c index 87abf93dfd5e..c9d0913e90ee 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec-hevc.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec-hevc.c @@ -381,6 +381,7 @@ static void assemble_sw_rps(struct rkvdec_ctx *ctx, static void config_registers(struct rkvdec_ctx *ctx, struct rkvdec_hevc_run *run) { + struct rkvdec_core *core =3D ctx->core; struct rkvdec_dev *rkvdec =3D ctx->dev; const struct v4l2_ctrl_hevc_decode_params *decode_params =3D run->decode_= params; const struct v4l2_ctrl_hevc_sps *sps =3D run->sps; @@ -477,7 +478,7 @@ static void config_registers(struct rkvdec_ctx *ctx, offset =3D offsetof(struct rkvdec_hevc_priv_tbl, rps); regs->h26x.rps_base =3D priv_start_addr + offset; =20 - rkvdec_memcpy_toio(rkvdec->regs, regs, + rkvdec_memcpy_toio(core->regs, regs, MIN(sizeof(*regs), sizeof(u32) * rkvdec->variant->num_regs)); } =20 @@ -511,7 +512,7 @@ static int rkvdec_hevc_start(struct rkvdec_ctx *ctx) if (!hevc_ctx) return -ENOMEM; =20 - priv_tbl =3D dma_alloc_coherent(rkvdec->dev, sizeof(*priv_tbl), + priv_tbl =3D dma_alloc_coherent(rkvdec->main_core->dev, sizeof(*priv_tbl), &hevc_ctx->priv_tbl.dma, GFP_KERNEL); if (!priv_tbl) { kfree(hevc_ctx); @@ -532,13 +533,14 @@ static void rkvdec_hevc_stop(struct rkvdec_ctx *ctx) struct rkvdec_hevc_ctx *hevc_ctx =3D ctx->priv; struct rkvdec_dev *rkvdec =3D ctx->dev; =20 - dma_free_coherent(rkvdec->dev, hevc_ctx->priv_tbl.size, + dma_free_coherent(rkvdec->main_core->dev, hevc_ctx->priv_tbl.size, hevc_ctx->priv_tbl.cpu, hevc_ctx->priv_tbl.dma); kfree(hevc_ctx); } =20 static int rkvdec_hevc_run(struct rkvdec_ctx *ctx) { + struct rkvdec_core *core =3D ctx->core; struct rkvdec_dev *rkvdec =3D ctx->dev; struct rkvdec_hevc_run run; struct rkvdec_hevc_ctx *hevc_ctx =3D ctx->priv; @@ -555,10 +557,10 @@ static int rkvdec_hevc_run(struct rkvdec_ctx *ctx) =20 rkvdec_run_postamble(ctx, &run.base); =20 - schedule_delayed_work(&rkvdec->watchdog_work, msecs_to_jiffies(2000)); + schedule_delayed_work(&core->watchdog_work, msecs_to_jiffies(2000)); =20 - writel(1, rkvdec->regs + RKVDEC_REG_PREF_LUMA_CACHE_COMMAND); - writel(1, rkvdec->regs + RKVDEC_REG_PREF_CHR_CACHE_COMMAND); + writel(1, core->regs + RKVDEC_REG_PREF_LUMA_CACHE_COMMAND); + writel(1, core->regs + RKVDEC_REG_PREF_CHR_CACHE_COMMAND); =20 if (rkvdec->variant->quirks & RKVDEC_QUIRK_DISABLE_QOS) rkvdec_quirks_disable_qos(ctx); @@ -568,7 +570,7 @@ static int rkvdec_hevc_run(struct rkvdec_ctx *ctx) 0 : RKVDEC_WR_DDR_ALIGN_EN; writel(RKVDEC_INTERRUPT_DEC_E | RKVDEC_CONFIG_DEC_CLK_GATE_E | RKVDEC_TIMEOUT_E | RKVDEC_BUF_EMPTY_E | reg, - rkvdec->regs + RKVDEC_REG_INTERRUPT); + core->regs + RKVDEC_REG_INTERRUPT); =20 return 0; } diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.c b/drivers/= media/platform/rockchip/rkvdec/rkvdec-rcb.c index 191f78278c01..44df5b6df80c 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.c @@ -29,38 +29,37 @@ static size_t rkvdec_rcb_size(const struct rcb_size_inf= o *size_info, =20 dma_addr_t rkvdec_rcb_buf_dma_addr(struct rkvdec_ctx *ctx, int id) { - return ctx->rcb_config->rcb_bufs[id].dma; + return ctx->core->rcb_config->rcb_bufs[id].dma; } =20 size_t rkvdec_rcb_buf_size(struct rkvdec_ctx *ctx, int id) { - return ctx->rcb_config->rcb_bufs[id].size; + return ctx->core->rcb_config->rcb_bufs[id].size; } =20 int rkvdec_rcb_buf_count(struct rkvdec_ctx *ctx) { - return ctx->rcb_config->rcb_count; + return ctx->core->rcb_config->rcb_count; } =20 bool rkvdec_rcb_buf_validate_size(struct rkvdec_ctx *ctx) { - struct rkvdec_rcb_config *cfg =3D ctx->rcb_config; + struct rkvdec_rcb_config *cfg =3D ctx->core->rcb_config; =20 bool ret =3D cfg && cfg->height >=3D ctx->decoded_fmt.fmt.pix_mp.height && cfg->width >=3D ctx->decoded_fmt.fmt.pix_mp.width; =20 if (!ret && cfg) { - dev_dbg(ctx->dev->dev, "RCB size %ux%u -> %ux%u\n", cfg->width, cfg->hei= ght, + dev_dbg(ctx->core->dev, "RCB size %ux%u -> %ux%u\n", cfg->width, cfg->he= ight, ctx->decoded_fmt.fmt.pix_mp.width, ctx->decoded_fmt.fmt.pix_mp.height); } =20 return ret; } =20 -void rkvdec_free_rcb(struct rkvdec_ctx *ctx) +void rkvdec_free_rcb(struct rkvdec_dev *rkvdec, struct rkvdec_core *core) { - struct rkvdec_dev *dev =3D ctx->dev; - struct rkvdec_rcb_config *cfg =3D ctx->rcb_config; + struct rkvdec_rcb_config *cfg =3D core->rcb_config; unsigned long virt_addr; int i; =20 @@ -77,12 +76,13 @@ void rkvdec_free_rcb(struct rkvdec_ctx *ctx) case RKVDEC_ALLOC_SRAM: virt_addr =3D (unsigned long)cfg->rcb_bufs[i].cpu; =20 - if (dev->iommu_domain) - iommu_unmap(dev->iommu_domain, virt_addr, rcb_size); - gen_pool_free(dev->sram_pool, virt_addr, rcb_size); + if (iommu_get_domain_for_dev(core->dev)) + iommu_unmap(iommu_get_domain_for_dev(core->dev), + virt_addr, rcb_size); + gen_pool_free(core->sram_pool, virt_addr, rcb_size); break; case RKVDEC_ALLOC_DMA: - dma_free_coherent(dev->dev, + dma_free_coherent(rkvdec->main_core->dev, rcb_size, cfg->rcb_bufs[i].cpu, cfg->rcb_bufs[i].dma); @@ -91,33 +91,33 @@ void rkvdec_free_rcb(struct rkvdec_ctx *ctx) } =20 if (cfg->rcb_bufs) - devm_kfree(dev->dev, cfg->rcb_bufs); + devm_kfree(core->dev, cfg->rcb_bufs); =20 - devm_kfree(dev->dev, cfg); + devm_kfree(core->dev, cfg); =20 - ctx->rcb_config =3D NULL; + core->rcb_config =3D NULL; } =20 -int rkvdec_allocate_rcb(struct rkvdec_ctx *ctx, u32 width, u32 height, +int rkvdec_allocate_rcb(struct rkvdec_dev *rkvdec, struct rkvdec_core *cor= e, + u32 width, u32 height, const struct rcb_size_info *size_info, size_t rcb_count) { int ret, i; - struct rkvdec_dev *rkvdec =3D ctx->dev; struct rkvdec_rcb_config *cfg; =20 if (!size_info || !rcb_count) { - ctx->rcb_config =3D NULL; + core->rcb_config =3D NULL; return 0; } =20 - ctx->rcb_config =3D devm_kzalloc(rkvdec->dev, sizeof(*ctx->rcb_config), G= FP_KERNEL); - if (!ctx->rcb_config) + core->rcb_config =3D devm_kzalloc(core->dev, sizeof(*core->rcb_config), G= FP_KERNEL); + if (!core->rcb_config) return -ENOMEM; =20 - cfg =3D ctx->rcb_config; + cfg =3D core->rcb_config; =20 - cfg->rcb_bufs =3D devm_kzalloc(rkvdec->dev, sizeof(*cfg->rcb_bufs) * rcb_= count, GFP_KERNEL); + cfg->rcb_bufs =3D devm_kzalloc(core->dev, sizeof(*cfg->rcb_bufs) * rcb_co= unt, GFP_KERNEL); if (!cfg->rcb_bufs) { ret =3D -ENOMEM; goto err_alloc; @@ -133,25 +133,26 @@ int rkvdec_allocate_rcb(struct rkvdec_ctx *ctx, u32 w= idth, u32 height, enum rkvdec_alloc_type alloc_type =3D RKVDEC_ALLOC_SRAM; =20 /* Try allocating an SRAM buffer */ - if (ctx->dev->sram_pool) { - if (rkvdec->iommu_domain) + if (core->sram_pool) { + if (iommu_get_domain_for_dev(core->dev)) rcb_size =3D ALIGN(rcb_size, SZ_4K); =20 - cpu =3D gen_pool_dma_zalloc_align(ctx->dev->sram_pool, + cpu =3D gen_pool_dma_zalloc_align(core->sram_pool, rcb_size, &dma, SZ_4K); } =20 /* If an IOMMU is used, map the SRAM address through it */ - if (cpu && rkvdec->iommu_domain) { + if (cpu && iommu_get_domain_for_dev(core->dev)) { unsigned long virt_addr =3D (unsigned long)cpu; phys_addr_t phys_addr =3D dma; =20 - ret =3D iommu_map(rkvdec->iommu_domain, virt_addr, phys_addr, + ret =3D iommu_map(iommu_get_domain_for_dev(core->dev), + virt_addr, phys_addr, rcb_size, IOMMU_READ | IOMMU_WRITE, 0); if (ret) { - gen_pool_free(ctx->dev->sram_pool, + gen_pool_free(core->sram_pool, (unsigned long)cpu, rcb_size); cpu =3D NULL; @@ -168,7 +169,7 @@ int rkvdec_allocate_rcb(struct rkvdec_ctx *ctx, u32 wid= th, u32 height, ram_fallback: /* Fallback to RAM */ if (!cpu) { - cpu =3D dma_alloc_coherent(ctx->dev->dev, + cpu =3D dma_alloc_coherent(rkvdec->main_core->dev, rcb_size, &dma, GFP_KERNEL); @@ -191,7 +192,7 @@ int rkvdec_allocate_rcb(struct rkvdec_ctx *ctx, u32 wid= th, u32 height, return 0; =20 err_alloc: - rkvdec_free_rcb(ctx); + rkvdec_free_rcb(rkvdec, core); =20 return ret; } diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.h b/drivers/= media/platform/rockchip/rkvdec/rkvdec-rcb.h index 0662a4359bdf..d1149afe7fda 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.h +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.h @@ -8,7 +8,9 @@ =20 #include =20 +struct rkvdec_dev; struct rkvdec_ctx; +struct rkvdec_core; =20 enum rcb_axis { PIC_WIDTH =3D 0, @@ -20,11 +22,12 @@ struct rcb_size_info { enum rcb_axis axis; }; =20 -int rkvdec_allocate_rcb(struct rkvdec_ctx *ctx, u32 width, u32 height, +int rkvdec_allocate_rcb(struct rkvdec_dev *rkvdec, struct rkvdec_core *cor= e, + u32 width, u32 height, const struct rcb_size_info *size_info, size_t rcb_count); dma_addr_t rkvdec_rcb_buf_dma_addr(struct rkvdec_ctx *ctx, int id); size_t rkvdec_rcb_buf_size(struct rkvdec_ctx *ctx, int id); int rkvdec_rcb_buf_count(struct rkvdec_ctx *ctx); bool rkvdec_rcb_buf_validate_size(struct rkvdec_ctx *ctx); -void rkvdec_free_rcb(struct rkvdec_ctx *ctx); +void rkvdec_free_rcb(struct rkvdec_dev *rkvdec, struct rkvdec_core *core); diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu381-h264.c b= /drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu381-h264.c index b961fddc8583..667c5d36f3ea 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu381-h264.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu381-h264.c @@ -185,22 +185,22 @@ static void assemble_hw_pps(struct rkvdec_ctx *ctx, =20 static void rkvdec_write_regs(struct rkvdec_ctx *ctx) { - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; struct rkvdec_h264_ctx *h264_ctx =3D ctx->priv; =20 - rkvdec_memcpy_toio(rkvdec->regs + OFFSET_COMMON_REGS, + rkvdec_memcpy_toio(core->regs + OFFSET_COMMON_REGS, &h264_ctx->regs.common, sizeof(h264_ctx->regs.common)); - rkvdec_memcpy_toio(rkvdec->regs + OFFSET_CODEC_PARAMS_REGS, + rkvdec_memcpy_toio(core->regs + OFFSET_CODEC_PARAMS_REGS, &h264_ctx->regs.h264_param, sizeof(h264_ctx->regs.h264_param)); - rkvdec_memcpy_toio(rkvdec->regs + OFFSET_COMMON_ADDR_REGS, + rkvdec_memcpy_toio(core->regs + OFFSET_COMMON_ADDR_REGS, &h264_ctx->regs.common_addr, sizeof(h264_ctx->regs.common_addr)); - rkvdec_memcpy_toio(rkvdec->regs + OFFSET_CODEC_ADDR_REGS, + rkvdec_memcpy_toio(core->regs + OFFSET_CODEC_ADDR_REGS, &h264_ctx->regs.h264_addr, sizeof(h264_ctx->regs.h264_addr)); - rkvdec_memcpy_toio(rkvdec->regs + OFFSET_POC_HIGHBIT_REGS, + rkvdec_memcpy_toio(core->regs + OFFSET_POC_HIGHBIT_REGS, &h264_ctx->regs.h264_highpoc, sizeof(h264_ctx->regs.h264_highpoc)); } @@ -368,7 +368,6 @@ static void config_registers(struct rkvdec_ctx *ctx, =20 static int rkvdec_h264_start(struct rkvdec_ctx *ctx) { - struct rkvdec_dev *rkvdec =3D ctx->dev; struct rkvdec_h264_priv_tbl *priv_tbl; struct rkvdec_h264_ctx *h264_ctx; struct v4l2_ctrl *ctrl; @@ -387,7 +386,7 @@ static int rkvdec_h264_start(struct rkvdec_ctx *ctx) if (!h264_ctx) return -ENOMEM; =20 - priv_tbl =3D dma_alloc_coherent(rkvdec->dev, sizeof(*priv_tbl), + priv_tbl =3D dma_alloc_coherent(ctx->dev->main_core->dev, sizeof(*priv_tb= l), &h264_ctx->priv_tbl.dma, GFP_KERNEL); if (!priv_tbl) { ret =3D -ENOMEM; @@ -410,9 +409,8 @@ static int rkvdec_h264_start(struct rkvdec_ctx *ctx) static void rkvdec_h264_stop(struct rkvdec_ctx *ctx) { struct rkvdec_h264_ctx *h264_ctx =3D ctx->priv; - struct rkvdec_dev *rkvdec =3D ctx->dev; =20 - dma_free_coherent(rkvdec->dev, h264_ctx->priv_tbl.size, + dma_free_coherent(ctx->dev->main_core->dev, h264_ctx->priv_tbl.size, h264_ctx->priv_tbl.cpu, h264_ctx->priv_tbl.dma); kfree(h264_ctx); } @@ -420,7 +418,7 @@ static void rkvdec_h264_stop(struct rkvdec_ctx *ctx) static int rkvdec_h264_run(struct rkvdec_ctx *ctx) { struct v4l2_h264_reflist_builder reflist_builder; - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; struct rkvdec_h264_ctx *h264_ctx =3D ctx->priv; struct rkvdec_h264_priv_tbl *tbl =3D h264_ctx->priv_tbl.cpu; struct rkvdec_h264_run run; @@ -443,10 +441,10 @@ static int rkvdec_h264_run(struct rkvdec_ctx *ctx) =20 rkvdec_run_postamble(ctx, &run.base); =20 - rkvdec_schedule_watchdog(rkvdec, h264_ctx->regs.common.reg032_timeout_thr= eshold); + rkvdec_schedule_watchdog(core, h264_ctx->regs.common.reg032_timeout_thres= hold); =20 /* Start decoding! */ - writel(VDPU381_DEC_E_BIT, rkvdec->regs + VDPU381_REG_DEC_E); + writel(VDPU381_DEC_E_BIT, core->regs + VDPU381_REG_DEC_E); =20 return 0; } diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu381-hevc.c b= /drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu381-hevc.c index fe6414a17551..bd68120b74c6 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu381-hevc.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu381-hevc.c @@ -356,22 +356,22 @@ static void set_ref_valid(struct rkvdec_vdpu381_regs_= hevc *regs, int id, u32 val =20 static void rkvdec_write_regs(struct rkvdec_ctx *ctx) { - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; struct rkvdec_hevc_ctx *hevc_ctx =3D ctx->priv; =20 - rkvdec_memcpy_toio(rkvdec->regs + OFFSET_COMMON_REGS, + rkvdec_memcpy_toio(core->regs + OFFSET_COMMON_REGS, &hevc_ctx->regs.common, sizeof(hevc_ctx->regs.common)); - rkvdec_memcpy_toio(rkvdec->regs + OFFSET_CODEC_PARAMS_REGS, + rkvdec_memcpy_toio(core->regs + OFFSET_CODEC_PARAMS_REGS, &hevc_ctx->regs.hevc_param, sizeof(hevc_ctx->regs.hevc_param)); - rkvdec_memcpy_toio(rkvdec->regs + OFFSET_COMMON_ADDR_REGS, + rkvdec_memcpy_toio(core->regs + OFFSET_COMMON_ADDR_REGS, &hevc_ctx->regs.common_addr, sizeof(hevc_ctx->regs.common_addr)); - rkvdec_memcpy_toio(rkvdec->regs + OFFSET_CODEC_ADDR_REGS, + rkvdec_memcpy_toio(core->regs + OFFSET_CODEC_ADDR_REGS, &hevc_ctx->regs.hevc_addr, sizeof(hevc_ctx->regs.hevc_addr)); - rkvdec_memcpy_toio(rkvdec->regs + OFFSET_POC_HIGHBIT_REGS, + rkvdec_memcpy_toio(core->regs + OFFSET_POC_HIGHBIT_REGS, &hevc_ctx->regs.hevc_highpoc, sizeof(hevc_ctx->regs.hevc_highpoc)); } @@ -555,7 +555,7 @@ static int rkvdec_hevc_start(struct rkvdec_ctx *ctx) if (!hevc_ctx) return -ENOMEM; =20 - priv_tbl =3D dma_alloc_coherent(rkvdec->dev, sizeof(*priv_tbl), + priv_tbl =3D dma_alloc_coherent(rkvdec->main_core->dev, sizeof(*priv_tbl), &hevc_ctx->priv_tbl.dma, GFP_KERNEL); if (!priv_tbl) { ret =3D -ENOMEM; @@ -580,14 +580,14 @@ static void rkvdec_hevc_stop(struct rkvdec_ctx *ctx) struct rkvdec_hevc_ctx *hevc_ctx =3D ctx->priv; struct rkvdec_dev *rkvdec =3D ctx->dev; =20 - dma_free_coherent(rkvdec->dev, hevc_ctx->priv_tbl.size, + dma_free_coherent(rkvdec->main_core->dev, hevc_ctx->priv_tbl.size, hevc_ctx->priv_tbl.cpu, hevc_ctx->priv_tbl.dma); kfree(hevc_ctx); } =20 static int rkvdec_hevc_run(struct rkvdec_ctx *ctx) { - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; struct rkvdec_hevc_run run; struct rkvdec_hevc_ctx *hevc_ctx =3D ctx->priv; struct rkvdec_hevc_priv_tbl *tbl =3D hevc_ctx->priv_tbl.cpu; @@ -604,7 +604,7 @@ static int rkvdec_hevc_run(struct rkvdec_ctx *ctx) */ if ((!ctx->has_sps_lt_rps && run.sps->num_long_term_ref_pics_sps) || (!ctx->has_sps_st_rps && run.sps->num_short_term_ref_pic_sets)) { - dev_warn_ratelimited(rkvdec->dev, "Long and short term RPS not set\n"); + dev_warn_ratelimited(core->dev, "Long and short term RPS not set\n"); } else { rkvdec_hevc_assemble_hw_rps(&run, &tbl->rps, &hevc_ctx->st_cache); } @@ -613,10 +613,10 @@ static int rkvdec_hevc_run(struct rkvdec_ctx *ctx) =20 rkvdec_run_postamble(ctx, &run.base); =20 - rkvdec_schedule_watchdog(rkvdec, hevc_ctx->regs.common.reg032_timeout_thr= eshold); + rkvdec_schedule_watchdog(core, hevc_ctx->regs.common.reg032_timeout_thres= hold); =20 /* Start decoding! */ - writel(VDPU381_DEC_E_BIT, rkvdec->regs + VDPU381_REG_DEC_E); + writel(VDPU381_DEC_E_BIT, ctx->core->regs + VDPU381_REG_DEC_E); =20 return 0; } diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu383-h264.c b= /drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu383-h264.c index 5ec755733916..a737a7799b71 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu383-h264.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu383-h264.c @@ -216,19 +216,19 @@ static void assemble_hw_pps(struct rkvdec_ctx *ctx, =20 static void rkvdec_write_regs(struct rkvdec_ctx *ctx) { - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; struct rkvdec_h264_ctx *h264_ctx =3D ctx->priv; =20 - rkvdec_memcpy_toio(rkvdec->regs + VDPU383_OFFSET_COMMON_REGS, + rkvdec_memcpy_toio(core->regs + VDPU383_OFFSET_COMMON_REGS, &h264_ctx->regs.common, sizeof(h264_ctx->regs.common)); - rkvdec_memcpy_toio(rkvdec->regs + VDPU383_OFFSET_COMMON_ADDR_REGS, + rkvdec_memcpy_toio(core->regs + VDPU383_OFFSET_COMMON_ADDR_REGS, &h264_ctx->regs.common_addr, sizeof(h264_ctx->regs.common_addr)); - rkvdec_memcpy_toio(rkvdec->regs + VDPU383_OFFSET_CODEC_PARAMS_REGS, + rkvdec_memcpy_toio(core->regs + VDPU383_OFFSET_CODEC_PARAMS_REGS, &h264_ctx->regs.h26x_params, sizeof(h264_ctx->regs.h26x_params)); - rkvdec_memcpy_toio(rkvdec->regs + VDPU383_OFFSET_CODEC_ADDR_REGS, + rkvdec_memcpy_toio(core->regs + VDPU383_OFFSET_CODEC_ADDR_REGS, &h264_ctx->regs.h26x_addr, sizeof(h264_ctx->regs.h26x_addr)); } @@ -380,7 +380,7 @@ static int rkvdec_h264_start(struct rkvdec_ctx *ctx) if (!h264_ctx) return -ENOMEM; =20 - priv_tbl =3D dma_alloc_coherent(rkvdec->dev, sizeof(*priv_tbl), + priv_tbl =3D dma_alloc_coherent(rkvdec->main_core->dev, sizeof(*priv_tbl), &h264_ctx->priv_tbl.dma, GFP_KERNEL); if (!priv_tbl) { ret =3D -ENOMEM; @@ -406,7 +406,7 @@ static void rkvdec_h264_stop(struct rkvdec_ctx *ctx) struct rkvdec_h264_ctx *h264_ctx =3D ctx->priv; struct rkvdec_dev *rkvdec =3D ctx->dev; =20 - dma_free_coherent(rkvdec->dev, h264_ctx->priv_tbl.size, + dma_free_coherent(rkvdec->main_core->dev, h264_ctx->priv_tbl.size, h264_ctx->priv_tbl.cpu, h264_ctx->priv_tbl.dma); kfree(h264_ctx); } @@ -414,7 +414,7 @@ static void rkvdec_h264_stop(struct rkvdec_ctx *ctx) static int rkvdec_h264_run(struct rkvdec_ctx *ctx) { struct v4l2_h264_reflist_builder reflist_builder; - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; struct rkvdec_h264_ctx *h264_ctx =3D ctx->priv; struct rkvdec_h264_run run; struct rkvdec_h264_priv_tbl *tbl =3D h264_ctx->priv_tbl.cpu; @@ -439,12 +439,12 @@ static int rkvdec_h264_run(struct rkvdec_ctx *ctx) rkvdec_run_postamble(ctx, &run.base); =20 timeout_threshold =3D h264_ctx->regs.common.reg013_core_timeout_threshold; - rkvdec_schedule_watchdog(rkvdec, timeout_threshold); + rkvdec_schedule_watchdog(core, timeout_threshold); =20 /* Start decoding! */ - writel(timeout_threshold, rkvdec->link + VDPU383_LINK_TIMEOUT_THRESHOLD); - writel(0, rkvdec->link + VDPU383_LINK_IP_ENABLE); - writel(VDPU383_DEC_E_BIT, rkvdec->link + VDPU383_LINK_DEC_ENABLE); + writel(timeout_threshold, core->link + VDPU383_LINK_TIMEOUT_THRESHOLD); + writel(0, core->link + VDPU383_LINK_IP_ENABLE); + writel(VDPU383_DEC_E_BIT, core->link + VDPU383_LINK_DEC_ENABLE); =20 return 0; } diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu383-hevc.c b= /drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu383-hevc.c index 3575338a531a..2862231b17f2 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu383-hevc.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec-vdpu383-hevc.c @@ -323,19 +323,19 @@ static void assemble_hw_pps(struct rkvdec_ctx *ctx, =20 static void rkvdec_write_regs(struct rkvdec_ctx *ctx) { - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; struct rkvdec_hevc_ctx *h265_ctx =3D ctx->priv; =20 - rkvdec_memcpy_toio(rkvdec->regs + VDPU383_OFFSET_COMMON_REGS, + rkvdec_memcpy_toio(core->regs + VDPU383_OFFSET_COMMON_REGS, &h265_ctx->regs.common, sizeof(h265_ctx->regs.common)); - rkvdec_memcpy_toio(rkvdec->regs + VDPU383_OFFSET_COMMON_ADDR_REGS, + rkvdec_memcpy_toio(core->regs + VDPU383_OFFSET_COMMON_ADDR_REGS, &h265_ctx->regs.common_addr, sizeof(h265_ctx->regs.common_addr)); - rkvdec_memcpy_toio(rkvdec->regs + VDPU383_OFFSET_CODEC_PARAMS_REGS, + rkvdec_memcpy_toio(core->regs + VDPU383_OFFSET_CODEC_PARAMS_REGS, &h265_ctx->regs.h26x_params, sizeof(h265_ctx->regs.h26x_params)); - rkvdec_memcpy_toio(rkvdec->regs + VDPU383_OFFSET_CODEC_ADDR_REGS, + rkvdec_memcpy_toio(core->regs + VDPU383_OFFSET_CODEC_ADDR_REGS, &h265_ctx->regs.h26x_addr, sizeof(h265_ctx->regs.h26x_addr)); } @@ -505,7 +505,7 @@ static int rkvdec_hevc_start(struct rkvdec_ctx *ctx) if (!hevc_ctx) return -ENOMEM; =20 - priv_tbl =3D dma_alloc_coherent(rkvdec->dev, sizeof(*priv_tbl), + priv_tbl =3D dma_alloc_coherent(rkvdec->main_core->dev, sizeof(*priv_tbl), &hevc_ctx->priv_tbl.dma, GFP_KERNEL); if (!priv_tbl) { ret =3D -ENOMEM; @@ -530,14 +530,14 @@ static void rkvdec_hevc_stop(struct rkvdec_ctx *ctx) struct rkvdec_hevc_ctx *hevc_ctx =3D ctx->priv; struct rkvdec_dev *rkvdec =3D ctx->dev; =20 - dma_free_coherent(rkvdec->dev, hevc_ctx->priv_tbl.size, + dma_free_coherent(rkvdec->main_core->dev, hevc_ctx->priv_tbl.size, hevc_ctx->priv_tbl.cpu, hevc_ctx->priv_tbl.dma); kfree(hevc_ctx); } =20 static int rkvdec_hevc_run(struct rkvdec_ctx *ctx) { - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; struct rkvdec_hevc_run run; struct rkvdec_hevc_ctx *hevc_ctx =3D ctx->priv; struct rkvdec_hevc_priv_tbl *tbl =3D hevc_ctx->priv_tbl.cpu; @@ -552,7 +552,7 @@ static int rkvdec_hevc_run(struct rkvdec_ctx *ctx) */ if ((!ctx->has_sps_lt_rps && run.sps->num_long_term_ref_pics_sps) || (!ctx->has_sps_st_rps && run.sps->num_short_term_ref_pic_sets)) { - dev_err_ratelimited(rkvdec->dev, "Long and short term RPS not set\n"); + dev_err_ratelimited(core->dev, "Long and short term RPS not set\n"); return -EINVAL; } =20 @@ -566,12 +566,12 @@ static int rkvdec_hevc_run(struct rkvdec_ctx *ctx) rkvdec_run_postamble(ctx, &run.base); =20 timeout_threshold =3D hevc_ctx->regs.common.reg013_core_timeout_threshold; - rkvdec_schedule_watchdog(rkvdec, timeout_threshold); + rkvdec_schedule_watchdog(core, timeout_threshold); =20 /* Start decoding! */ - writel(timeout_threshold, rkvdec->link + VDPU383_LINK_TIMEOUT_THRESHOLD); - writel(VDPU383_IP_CRU_MODE, rkvdec->link + VDPU383_LINK_IP_ENABLE); - writel(VDPU383_DEC_E_BIT, rkvdec->link + VDPU383_LINK_DEC_ENABLE); + writel(timeout_threshold, core->link + VDPU383_LINK_TIMEOUT_THRESHOLD); + writel(VDPU383_IP_CRU_MODE, core->link + VDPU383_LINK_IP_ENABLE); + writel(VDPU383_DEC_E_BIT, core->link + VDPU383_LINK_DEC_ENABLE); =20 return 0; } diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec-vp9.c b/drivers/= media/platform/rockchip/rkvdec/rkvdec-vp9.c index 2751f5396ee8..0b7d6b29bcfa 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec-vp9.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec-vp9.c @@ -482,6 +482,7 @@ static void config_registers(struct rkvdec_ctx *ctx, struct rkvdec_vp9_ctx *vp9_ctx =3D ctx->priv; struct rkvdec_regs *regs =3D &vp9_ctx->regs; const struct v4l2_vp9_segmentation *seg; + struct rkvdec_core *core =3D ctx->core; struct rkvdec_dev *rkvdec =3D ctx->dev; dma_addr_t addr; bool intra_only; @@ -657,18 +658,19 @@ static void config_registers(struct rkvdec_ctx *ctx, =20 regs->vp9.reg44.strmd_error_e =3D 0xe; =20 - rkvdec_memcpy_toio(rkvdec->regs, regs, + rkvdec_memcpy_toio(core->regs, regs, MIN(sizeof(*regs), sizeof(u32) * rkvdec->variant->num_regs)); } =20 static int validate_dec_params(struct rkvdec_ctx *ctx, const struct v4l2_ctrl_vp9_frame *dec_params) { + struct rkvdec_core *core =3D ctx->core; unsigned int aligned_width, aligned_height; =20 /* We only support profile 0. */ if (dec_params->profile !=3D 0) { - dev_err(ctx->dev->dev, "unsupported profile %d\n", + dev_err(core->dev, "unsupported profile %d\n", dec_params->profile); return -EINVAL; } @@ -682,7 +684,7 @@ static int validate_dec_params(struct rkvdec_ctx *ctx, */ if (aligned_width !=3D ctx->decoded_fmt.fmt.pix_mp.width || aligned_height !=3D ctx->decoded_fmt.fmt.pix_mp.height) { - dev_err(ctx->dev->dev, + dev_err(core->dev, "unexpected bitstream resolution %dx%d\n", dec_params->frame_width_minus_1 + 1, dec_params->frame_height_minus_1 + 1); @@ -768,6 +770,7 @@ static int rkvdec_vp9_run_preamble(struct rkvdec_ctx *c= tx, =20 static int rkvdec_vp9_run(struct rkvdec_ctx *ctx) { + struct rkvdec_core *core =3D ctx->core; struct rkvdec_dev *rkvdec =3D ctx->dev; struct rkvdec_vp9_run run =3D { }; int ret; @@ -786,10 +789,10 @@ static int rkvdec_vp9_run(struct rkvdec_ctx *ctx) =20 rkvdec_run_postamble(ctx, &run.base); =20 - schedule_delayed_work(&rkvdec->watchdog_work, msecs_to_jiffies(2000)); + schedule_delayed_work(&core->watchdog_work, msecs_to_jiffies(2000)); =20 - writel(1, rkvdec->regs + RKVDEC_REG_PREF_LUMA_CACHE_COMMAND); - writel(1, rkvdec->regs + RKVDEC_REG_PREF_CHR_CACHE_COMMAND); + writel(1, core->regs + RKVDEC_REG_PREF_LUMA_CACHE_COMMAND); + writel(1, core->regs + RKVDEC_REG_PREF_CHR_CACHE_COMMAND); =20 if (rkvdec->variant->quirks & RKVDEC_QUIRK_DISABLE_QOS) rkvdec_quirks_disable_qos(ctx); @@ -797,7 +800,7 @@ static int rkvdec_vp9_run(struct rkvdec_ctx *ctx) /* Start decoding! */ writel(RKVDEC_INTERRUPT_DEC_E | RKVDEC_CONFIG_DEC_CLK_GATE_E | RKVDEC_TIMEOUT_E | RKVDEC_BUF_EMPTY_E, - rkvdec->regs + RKVDEC_REG_INTERRUPT); + core->regs + RKVDEC_REG_INTERRUPT); =20 return 0; } @@ -979,7 +982,7 @@ static int rkvdec_vp9_start(struct rkvdec_ctx *ctx) ctx->priv =3D vp9_ctx; =20 BUILD_BUG_ON(sizeof(priv_tbl->probs) % 16); /* ensure probs size is 128-b= it aligned */ - priv_tbl =3D dma_alloc_coherent(rkvdec->dev, sizeof(*priv_tbl), + priv_tbl =3D dma_alloc_coherent(rkvdec->main_core->dev, sizeof(*priv_tbl), &vp9_ctx->priv_tbl.dma, GFP_KERNEL); if (!priv_tbl) { ret =3D -ENOMEM; @@ -989,7 +992,7 @@ static int rkvdec_vp9_start(struct rkvdec_ctx *ctx) vp9_ctx->priv_tbl.size =3D sizeof(*priv_tbl); vp9_ctx->priv_tbl.cpu =3D priv_tbl; =20 - count_tbl =3D dma_alloc_coherent(rkvdec->dev, RKVDEC_VP9_COUNT_SIZE, + count_tbl =3D dma_alloc_coherent(rkvdec->main_core->dev, RKVDEC_VP9_COUNT= _SIZE, &vp9_ctx->count_tbl.dma, GFP_KERNEL); if (!count_tbl) { ret =3D -ENOMEM; @@ -1003,7 +1006,7 @@ static int rkvdec_vp9_start(struct rkvdec_ctx *ctx) return 0; =20 err_free_priv_tbl: - dma_free_coherent(rkvdec->dev, vp9_ctx->priv_tbl.size, + dma_free_coherent(rkvdec->main_core->dev, vp9_ctx->priv_tbl.size, vp9_ctx->priv_tbl.cpu, vp9_ctx->priv_tbl.dma); =20 err_free_ctx: @@ -1016,9 +1019,9 @@ static void rkvdec_vp9_stop(struct rkvdec_ctx *ctx) struct rkvdec_vp9_ctx *vp9_ctx =3D ctx->priv; struct rkvdec_dev *rkvdec =3D ctx->dev; =20 - dma_free_coherent(rkvdec->dev, vp9_ctx->count_tbl.size, + dma_free_coherent(rkvdec->main_core->dev, vp9_ctx->count_tbl.size, vp9_ctx->count_tbl.cpu, vp9_ctx->count_tbl.dma); - dma_free_coherent(rkvdec->dev, vp9_ctx->priv_tbl.size, + dma_free_coherent(rkvdec->main_core->dev, vp9_ctx->priv_tbl.size, vp9_ctx->priv_tbl.cpu, vp9_ctx->priv_tbl.dma); kfree(vp9_ctx); } diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec.c b/drivers/medi= a/platform/rockchip/rkvdec/rkvdec.c index db2731af06cf..d3b13132b751 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec.c @@ -11,12 +11,14 @@ =20 #include #include +#include #include #include #include #include #include #include +#include #include #include #include @@ -652,14 +654,11 @@ static int rkvdec_enum_framesizes(struct file *file, = void *priv, static int rkvdec_querycap(struct file *file, void *priv, struct v4l2_capability *cap) { - struct rkvdec_dev *rkvdec =3D video_drvdata(file); struct video_device *vdev =3D video_devdata(file); =20 - strscpy(cap->driver, rkvdec->dev->driver->name, - sizeof(cap->driver)); + strscpy(cap->driver, "rkvdec", sizeof(cap->driver)); strscpy(cap->card, vdev->name, sizeof(cap->card)); - snprintf(cap->bus_info, sizeof(cap->bus_info), "platform:%s", - rkvdec->dev->driver->name); + snprintf(cap->bus_info, sizeof(cap->bus_info), "platform:rkvdec"); return 0; } =20 @@ -1026,8 +1025,6 @@ static void rkvdec_stop_streaming(struct vb2_queue *q) =20 if (desc->ops->stop) desc->ops->stop(ctx); - - rkvdec_free_rcb(ctx); } =20 rkvdec_queue_cleanup(q, VB2_BUF_STATE_ERROR); @@ -1062,26 +1059,28 @@ static const struct media_device_ops rkvdec_media_o= ps =3D { }; =20 static void rkvdec_job_finish_no_pm(struct rkvdec_ctx *ctx, - enum vb2_buffer_state result) + enum vb2_buffer_state result) { + struct v4l2_m2m_ctx *m2m_ctx =3D ctx->fh.m2m_ctx; + struct v4l2_m2m_dev *m2m_dev =3D m2m_ctx->m2m_dev; + if (ctx->coded_fmt_desc->ops->done) { struct vb2_v4l2_buffer *src_buf, *dst_buf; =20 - src_buf =3D v4l2_m2m_next_src_buf(ctx->fh.m2m_ctx); - dst_buf =3D v4l2_m2m_next_dst_buf(ctx->fh.m2m_ctx); + src_buf =3D v4l2_m2m_next_src_buf(m2m_ctx); + dst_buf =3D v4l2_m2m_next_dst_buf(m2m_ctx); ctx->coded_fmt_desc->ops->done(ctx, src_buf, dst_buf, result); } =20 - v4l2_m2m_buf_done_and_job_finish(ctx->dev->m2m_dev, ctx->fh.m2m_ctx, - result); + v4l2_m2m_buf_done_and_job_finish(m2m_dev, m2m_ctx, result); } =20 static void rkvdec_job_finish(struct rkvdec_ctx *ctx, - enum vb2_buffer_state result) + enum vb2_buffer_state result) { - struct rkvdec_dev *rkvdec =3D ctx->dev; + pm_runtime_mark_last_busy(ctx->core->dev); + pm_runtime_put_autosuspend(ctx->core->dev); =20 - pm_runtime_put_autosuspend(rkvdec->dev); rkvdec_job_finish_no_pm(ctx, result); } =20 @@ -1112,14 +1111,14 @@ void rkvdec_run_postamble(struct rkvdec_ctx *ctx, s= truct rkvdec_run *run) =20 void rkvdec_quirks_disable_qos(struct rkvdec_ctx *ctx) { - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; u32 reg; =20 /* Set undocumented swreg_block_gating_e field */ - reg =3D readl(rkvdec->regs + RKVDEC_REG_QOS_CTRL); + reg =3D readl(core->regs + RKVDEC_REG_QOS_CTRL); reg &=3D GENMASK(31, 16); reg |=3D 0xEFFF; - writel(reg, rkvdec->regs + RKVDEC_REG_QOS_CTRL); + writel(reg, core->regs + RKVDEC_REG_QOS_CTRL); } =20 void rkvdec_memcpy_toio(void __iomem *dst, void *src, size_t len) @@ -1131,40 +1130,42 @@ void rkvdec_memcpy_toio(void __iomem *dst, void *sr= c, size_t len) #endif } =20 -void rkvdec_schedule_watchdog(struct rkvdec_dev *rkvdec, u32 timeout_thres= hold) +void rkvdec_schedule_watchdog(struct rkvdec_core *core, u32 timeout_thresh= old) { /* Set watchdog at 2 times the hardware timeout threshold */ u32 watchdog_time; - unsigned long axi_rate =3D clk_get_rate(rkvdec->axi_clk); + unsigned long axi_rate =3D clk_get_rate(core->axi_clk); =20 if (axi_rate) watchdog_time =3D 2 * div_u64(1000 * (u64)timeout_threshold, axi_rate); else watchdog_time =3D 2000; =20 - schedule_delayed_work(&rkvdec->watchdog_work, msecs_to_jiffies(watchdog_t= ime)); + schedule_delayed_work(&core->watchdog_work, msecs_to_jiffies(watchdog_tim= e)); } =20 static void rkvdec_device_run(void *priv) { struct rkvdec_ctx *ctx =3D priv; - struct rkvdec_dev *rkvdec =3D ctx->dev; const struct rkvdec_coded_fmt_desc *desc =3D ctx->coded_fmt_desc; int ret; =20 if (WARN_ON(!desc)) return; =20 - ret =3D pm_runtime_resume_and_get(rkvdec->dev); + ctx->core =3D ctx->dev->main_core; + ctx->core->curr_ctx =3D ctx; + + ret =3D pm_runtime_resume_and_get(ctx->core->dev); if (ret < 0) { rkvdec_job_finish_no_pm(ctx, VB2_BUF_STATE_ERROR); return; } =20 if (!rkvdec_rcb_buf_validate_size(ctx)) { - rkvdec_free_rcb(ctx); + rkvdec_free_rcb(ctx->dev, ctx->core); =20 - ret =3D rkvdec_allocate_rcb(ctx, + ret =3D rkvdec_allocate_rcb(ctx->dev, ctx->core, ctx->decoded_fmt.fmt.pix_mp.width, ctx->decoded_fmt.fmt.pix_mp.height, ctx->dev->variant->rcb_sizes, @@ -1340,10 +1341,11 @@ static const struct v4l2_file_operations rkvdec_fop= s =3D { static int rkvdec_v4l2_init(struct rkvdec_dev *rkvdec) { int ret; + struct device *dev =3D rkvdec->main_core->dev; =20 - ret =3D v4l2_device_register(rkvdec->dev, &rkvdec->v4l2_dev); + ret =3D v4l2_device_register(dev, &rkvdec->v4l2_dev); if (ret) { - dev_err(rkvdec->dev, "Failed to register V4L2 device\n"); + dev_err(dev, "Failed to register V4L2 device\n"); return ret; } =20 @@ -1354,7 +1356,7 @@ static int rkvdec_v4l2_init(struct rkvdec_dev *rkvdec) goto err_unregister_v4l2; } =20 - rkvdec->mdev.dev =3D rkvdec->dev; + rkvdec->mdev.dev =3D dev; strscpy(rkvdec->mdev.model, "rkvdec", sizeof(rkvdec->mdev.model)); strscpy(rkvdec->mdev.bus_info, "platform:rkvdec", sizeof(rkvdec->mdev.bus_info)); @@ -1420,9 +1422,9 @@ static void rkvdec_v4l2_cleanup(struct rkvdec_dev *rk= vdec) v4l2_device_unregister(&rkvdec->v4l2_dev); } =20 -static void rkvdec_iommu_restore(struct rkvdec_dev *rkvdec) +static void rkvdec_iommu_restore(struct rkvdec_core *core) { - if (rkvdec->empty_domain) { + if (core->empty_domain) { /* * To rewrite mapping into the attached IOMMU core, attach a new empty d= omain that * will program an empty table, then detach it to restore the default do= main and @@ -1430,29 +1432,29 @@ static void rkvdec_iommu_restore(struct rkvdec_dev = *rkvdec) * This is safely done in this interrupt handler to make sure no memory = get mapped * through the IOMMU while the empty domain is attached. */ - iommu_attach_device(rkvdec->empty_domain, rkvdec->dev); - iommu_detach_device(rkvdec->empty_domain, rkvdec->dev); + iommu_attach_device(core->empty_domain, core->dev); + iommu_detach_device(core->empty_domain, core->dev); } } =20 static irqreturn_t rk3399_irq_handler(struct rkvdec_ctx *ctx) { - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; enum vb2_buffer_state state; u32 status; =20 - status =3D readl(rkvdec->regs + RKVDEC_REG_INTERRUPT); - writel(0, rkvdec->regs + RKVDEC_REG_INTERRUPT); + status =3D readl(core->regs + RKVDEC_REG_INTERRUPT); + writel(0, core->regs + RKVDEC_REG_INTERRUPT); =20 if (status & RKVDEC_RDY_STA) { state =3D VB2_BUF_STATE_DONE; } else { state =3D VB2_BUF_STATE_ERROR; if (status & RKVDEC_SOFTRESET_RDY) - rkvdec_iommu_restore(rkvdec); + rkvdec_iommu_restore(core); } =20 - if (cancel_delayed_work(&rkvdec->watchdog_work)) + if (cancel_delayed_work(&core->watchdog_work)) rkvdec_job_finish(ctx, state); =20 return IRQ_HANDLED; @@ -1460,12 +1462,12 @@ static irqreturn_t rk3399_irq_handler(struct rkvdec= _ctx *ctx) =20 static irqreturn_t vdpu381_irq_handler(struct rkvdec_ctx *ctx) { - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; enum vb2_buffer_state state; u32 status; =20 - status =3D readl(rkvdec->regs + VDPU381_REG_STA_INT); - writel(0, rkvdec->regs + VDPU381_REG_STA_INT); + status =3D readl(core->regs + VDPU381_REG_STA_INT); + writel(0, core->regs + VDPU381_REG_STA_INT); =20 if (status & VDPU381_STA_INT_DEC_RDY_STA) { state =3D VB2_BUF_STATE_DONE; @@ -1474,10 +1476,10 @@ static irqreturn_t vdpu381_irq_handler(struct rkvde= c_ctx *ctx) if (status & (VDPU381_STA_INT_SOFTRESET_RDY | VDPU381_STA_INT_TIMEOUT | VDPU381_STA_INT_ERROR)) - rkvdec_iommu_restore(rkvdec); + rkvdec_iommu_restore(core); } =20 - if (cancel_delayed_work(&rkvdec->watchdog_work)) + if (cancel_delayed_work(&core->watchdog_work)) rkvdec_job_finish(ctx, state); =20 return IRQ_HANDLED; @@ -1485,24 +1487,24 @@ static irqreturn_t vdpu381_irq_handler(struct rkvde= c_ctx *ctx) =20 static irqreturn_t vdpu383_irq_handler(struct rkvdec_ctx *ctx) { - struct rkvdec_dev *rkvdec =3D ctx->dev; + struct rkvdec_core *core =3D ctx->core; enum vb2_buffer_state state; u32 status; =20 - status =3D readl(rkvdec->link + VDPU383_LINK_STA_INT); - writel(FIELD_PREP_WM16(VDPU383_STA_INT_ALL, 0), rkvdec->link + VDPU383_LI= NK_STA_INT); + status =3D readl(core->link + VDPU383_LINK_STA_INT); + writel(FIELD_PREP_WM16(VDPU383_STA_INT_ALL, 0), core->link + VDPU383_LINK= _STA_INT); /* On vdpu383, the interrupts must be disabled */ writel(FIELD_PREP_WM16(VDPU383_INT_EN_IRQ | VDPU383_INT_EN_LINE_IRQ, 0), - rkvdec->link + VDPU383_LINK_INT_EN); + core->link + VDPU383_LINK_INT_EN); =20 if (status & VDPU383_STA_INT_DEC_RDY_STA) { state =3D VB2_BUF_STATE_DONE; } else { state =3D VB2_BUF_STATE_ERROR; - rkvdec_iommu_restore(rkvdec); + rkvdec_iommu_restore(core); } =20 - if (cancel_delayed_work(&rkvdec->watchdog_work)) + if (cancel_delayed_work(&core->watchdog_work)) rkvdec_job_finish(ctx, state); =20 return IRQ_HANDLED; @@ -1510,11 +1512,14 @@ static irqreturn_t vdpu383_irq_handler(struct rkvde= c_ctx *ctx) =20 static irqreturn_t rkvdec_irq_handler(int irq, void *priv) { - struct rkvdec_dev *rkvdec =3D priv; - struct rkvdec_ctx *ctx =3D v4l2_m2m_get_curr_priv(rkvdec->m2m_dev); - const struct rkvdec_variant *variant =3D rkvdec->variant; + irqreturn_t ret; + struct rkvdec_core *core =3D priv; + struct rkvdec_ctx *ctx =3D core->curr_ctx; + const struct rkvdec_variant *variant =3D ctx->dev->variant; + + ret =3D variant->ops->irq_handler(ctx); =20 - return variant->ops->irq_handler(ctx); + return ret; } =20 /* @@ -1591,62 +1596,19 @@ static void vdpu383_flatten_matrices(u8 *output, co= nst u8 *input, int matrices, =20 static void rkvdec_watchdog_func(struct work_struct *work) { - struct rkvdec_dev *rkvdec; + struct rkvdec_core *core; struct rkvdec_ctx *ctx; =20 - rkvdec =3D container_of(to_delayed_work(work), struct rkvdec_dev, + core =3D container_of(to_delayed_work(work), struct rkvdec_core, watchdog_work); - ctx =3D v4l2_m2m_get_curr_priv(rkvdec->m2m_dev); + ctx =3D core->curr_ctx; if (ctx) { - dev_err(rkvdec->dev, "Frame processing timed out!\n"); - writel(RKVDEC_IRQ_DIS, rkvdec->regs + RKVDEC_REG_INTERRUPT); + dev_err(core->dev, "Frame processing timed out!\n"); + writel(RKVDEC_IRQ_DIS, core->regs + RKVDEC_REG_INTERRUPT); rkvdec_job_finish(ctx, VB2_BUF_STATE_ERROR); } } =20 -/* - * Some SoCs, like RK3588 have multiple identical VDPU cores, but the - * kernel is currently missing support for multi-core handling. Exposing - * separate devices for each core to userspace is bad, since that does - * not allow scheduling tasks properly (and creates ABI). With this workar= ound - * the driver will only probe for the first core and early exit for the ot= her - * cores. Once the driver gains multi-core support, the same technique - * for detecting the first core can be used to cluster all cores together. - */ -static int rkvdec_disable_multicore(struct rkvdec_dev *rkvdec) -{ - struct device_node *node =3D NULL; - const char *compatible; - bool is_first_core; - int ret; - - /* Intentionally ignores the fallback strings */ - ret =3D of_property_read_string(rkvdec->dev->of_node, "compatible", &comp= atible); - if (ret) - return ret; - - /* The first compatible and available node found is considered the main c= ore */ - do { - node =3D of_find_compatible_node(node, NULL, compatible); - if (of_device_is_available(node)) - break; - } while (node); - - if (!node) - return -EINVAL; - - is_first_core =3D (rkvdec->dev->of_node =3D=3D node); - - of_node_put(node); - - if (!is_first_core) { - dev_info(rkvdec->dev, "missing multi-core support, ignoring this instanc= e\n"); - return -ENODEV; - } - - return 0; -} - static const struct rkvdec_variant_ops rk3399_variant_ops =3D { .irq_handler =3D rk3399_irq_handler, .colmv_size =3D rkvdec_colmv_size, @@ -1757,49 +1719,75 @@ static const struct of_device_id of_rkvdec_match[] = =3D { }; MODULE_DEVICE_TABLE(of, of_rkvdec_match); =20 -static int rkvdec_probe(struct platform_device *pdev) +static int rkvdec_core_bind(struct device *dev, struct device *master, voi= d *data) +{ + struct platform_device *pdev =3D to_platform_device(dev); + struct rkvdec_core *core =3D platform_get_drvdata(pdev); + struct rkvdec_dev *rkvdec =3D data; + + if (rkvdec->main_core) + return dev_err_probe(dev, -EBUSY, + "rkvdec already has a bound core\n"); + + rkvdec->main_core =3D core; + + dev_info(dev, "Registered core\n"); + + return 0; +} + +static const struct component_ops rkvdec_core_ops =3D { + .bind =3D rkvdec_core_bind, +}; + +static int rkvdec_core_probe(struct platform_device *pdev) { const struct rkvdec_variant *variant; - struct rkvdec_dev *rkvdec; + struct rkvdec_core *core; int ret, irq; =20 + if (!pdev->dev.of_node) + return -ENODEV; + variant =3D of_device_get_match_data(&pdev->dev); if (!variant) - return -EINVAL; + return dev_err_probe(&pdev->dev, -ENODEV, "failed to get match data\n"); =20 - rkvdec =3D devm_kzalloc(&pdev->dev, sizeof(*rkvdec), GFP_KERNEL); - if (!rkvdec) + core =3D devm_kzalloc(&pdev->dev, sizeof(*core), GFP_KERNEL); + if (!core) return -ENOMEM; =20 - platform_set_drvdata(pdev, rkvdec); - rkvdec->dev =3D &pdev->dev; - rkvdec->variant =3D variant; - mutex_init(&rkvdec->vdev_lock); - INIT_DELAYED_WORK(&rkvdec->watchdog_work, rkvdec_watchdog_func); - - ret =3D rkvdec_disable_multicore(rkvdec); - if (ret) - return ret; + core->dev =3D &pdev->dev; + INIT_DELAYED_WORK(&core->watchdog_work, rkvdec_watchdog_func); =20 - ret =3D devm_clk_bulk_get_all_enabled(&pdev->dev, &rkvdec->clocks); + ret =3D devm_clk_bulk_get_all_enabled(&pdev->dev, &core->clocks); if (ret < 0) return ret; + core->num_clocks =3D ret; =20 - rkvdec->num_clocks =3D ret; - rkvdec->axi_clk =3D devm_clk_get(&pdev->dev, "axi"); + core->axi_clk =3D devm_clk_get(&pdev->dev, "axi"); =20 - if (rkvdec->variant->has_single_reg_region) { - rkvdec->regs =3D devm_platform_ioremap_resource(pdev, 0); - if (IS_ERR(rkvdec->regs)) - return PTR_ERR(rkvdec->regs); + if (variant->has_single_reg_region) { + core->regs =3D devm_platform_ioremap_resource(pdev, 0); + if (IS_ERR(core->regs)) + return PTR_ERR(core->regs); } else { - rkvdec->regs =3D devm_platform_ioremap_resource_byname(pdev, "function"); - if (IS_ERR(rkvdec->regs)) - return PTR_ERR(rkvdec->regs); + core->regs =3D devm_platform_ioremap_resource_byname(pdev, "function"); + if (IS_ERR(core->regs)) + return PTR_ERR(core->regs); + + core->link =3D devm_platform_ioremap_resource_byname(pdev, "link"); + if (IS_ERR(core->link)) + return PTR_ERR(core->link); + } + + if (iommu_get_domain_for_dev(&pdev->dev)) { + core->empty_domain =3D iommu_paging_domain_alloc(core->dev); =20 - rkvdec->link =3D devm_platform_ioremap_resource_byname(pdev, "link"); - if (IS_ERR(rkvdec->link)) - return PTR_ERR(rkvdec->link); + if (IS_ERR(core->empty_domain)) { + dev_warn(core->dev, "cannot alloc new empty domain\n"); + core->empty_domain =3D NULL; + } } =20 ret =3D dma_set_coherent_mask(&pdev->dev, DMA_BIT_MASK(32)); @@ -1816,32 +1804,26 @@ static int rkvdec_probe(struct platform_device *pde= v) =20 ret =3D devm_request_threaded_irq(&pdev->dev, irq, NULL, rkvdec_irq_handler, IRQF_ONESHOT, - dev_name(&pdev->dev), rkvdec); + dev_name(&pdev->dev), core); if (ret) { - dev_err(&pdev->dev, "Could not request vdec IRQ\n"); + dev_err(&pdev->dev, "Could not request core IRQ\n"); return ret; } =20 - rkvdec->sram_pool =3D of_gen_pool_get(pdev->dev.of_node, "sram", 0); - if (!rkvdec->sram_pool && rkvdec->variant->num_rcb_sizes > 0) + core->sram_pool =3D of_gen_pool_get(pdev->dev.of_node, "sram", 0); + if (!core->sram_pool && variant->num_rcb_sizes > 0) dev_info(&pdev->dev, "No sram node, RCB will be stored in RAM\n"); =20 pm_runtime_set_autosuspend_delay(&pdev->dev, 100); pm_runtime_use_autosuspend(&pdev->dev); pm_runtime_enable(&pdev->dev); =20 - ret =3D rkvdec_v4l2_init(rkvdec); - if (ret) - goto err_disable_runtime_pm; + platform_set_drvdata(pdev, core); =20 - rkvdec->iommu_domain =3D iommu_get_domain_for_dev(&pdev->dev); - if (rkvdec->iommu_domain) { - rkvdec->empty_domain =3D iommu_paging_domain_alloc(rkvdec->dev); - - if (IS_ERR(rkvdec->empty_domain)) { - rkvdec->empty_domain =3D NULL; - dev_warn(rkvdec->dev, "cannot alloc new empty domain\n"); - } + ret =3D component_add(&pdev->dev, &rkvdec_core_ops); + if (ret < 0) { + dev_err(&pdev->dev, "failed to register component: %d\n", ret); + goto err_disable_runtime_pm; } =20 return 0; @@ -1849,60 +1831,254 @@ static int rkvdec_probe(struct platform_device *pd= ev) err_disable_runtime_pm: pm_runtime_dont_use_autosuspend(&pdev->dev); pm_runtime_disable(&pdev->dev); - - if (rkvdec->sram_pool) - gen_pool_destroy(rkvdec->sram_pool); + if (core->empty_domain) + iommu_domain_free(core->empty_domain); =20 return ret; } =20 -static void rkvdec_remove(struct platform_device *pdev) +static void rkvdec_core_remove(struct platform_device *pdev) { - struct rkvdec_dev *rkvdec =3D platform_get_drvdata(pdev); + struct rkvdec_core *core =3D platform_get_drvdata(pdev); =20 - cancel_delayed_work_sync(&rkvdec->watchdog_work); + component_del(&pdev->dev, &rkvdec_core_ops); =20 - rkvdec_v4l2_cleanup(rkvdec); - pm_runtime_disable(&pdev->dev); pm_runtime_dont_use_autosuspend(&pdev->dev); + pm_runtime_disable(&pdev->dev); =20 - if (rkvdec->empty_domain) - iommu_domain_free(rkvdec->empty_domain); + if (core->empty_domain) + iommu_domain_free(core->empty_domain); } =20 #ifdef CONFIG_PM -static int rkvdec_runtime_resume(struct device *dev) +static int rkvdec_core_runtime_resume(struct device *dev) { - struct rkvdec_dev *rkvdec =3D dev_get_drvdata(dev); + struct rkvdec_core *core =3D dev_get_drvdata(dev); =20 - return clk_bulk_prepare_enable(rkvdec->num_clocks, rkvdec->clocks); + return clk_bulk_prepare_enable(core->num_clocks, core->clocks); } =20 -static int rkvdec_runtime_suspend(struct device *dev) +static int rkvdec_core_runtime_suspend(struct device *dev) { - struct rkvdec_dev *rkvdec =3D dev_get_drvdata(dev); + struct rkvdec_core *core =3D dev_get_drvdata(dev); + + clk_bulk_disable_unprepare(core->num_clocks, core->clocks); =20 - clk_bulk_disable_unprepare(rkvdec->num_clocks, rkvdec->clocks); return 0; } #endif =20 -static const struct dev_pm_ops rkvdec_pm_ops =3D { +static const struct dev_pm_ops rkvdec_core_pm_ops =3D { SET_SYSTEM_SLEEP_PM_OPS(pm_runtime_force_suspend, pm_runtime_force_resume) - SET_RUNTIME_PM_OPS(rkvdec_runtime_suspend, rkvdec_runtime_resume, NULL) + SET_RUNTIME_PM_OPS(rkvdec_core_runtime_suspend, + rkvdec_core_runtime_resume, NULL) +}; + +static struct platform_driver rkvdec_core_pdrv =3D { + .probe =3D rkvdec_core_probe, + .remove =3D rkvdec_core_remove, + .driver =3D { + .name =3D "rkvdec-core", + .of_match_table =3D of_rkvdec_match, + .pm =3D &rkvdec_core_pm_ops, + }, +}; + +static int rkvdec_bind(struct device *dev) +{ + struct rkvdec_dev *rkvdec =3D dev_get_drvdata(dev); + int ret; + + ret =3D component_bind_all(dev, rkvdec); + if (ret) { + dev_err(dev, "component bind failed\n"); + return ret; + } + + ret =3D rkvdec_v4l2_init(rkvdec); + if (ret) + goto err_unbind; + + return 0; + +err_unbind: + component_unbind_all(dev, NULL); + return ret; +} + +static void rkvdec_unbind(struct device *dev) +{ + struct rkvdec_dev *rkvdec =3D dev_get_drvdata(dev); + + cancel_delayed_work_sync(&rkvdec->main_core->watchdog_work); + + rkvdec_v4l2_cleanup(rkvdec); + + rkvdec_free_rcb(rkvdec, rkvdec->main_core); + + component_unbind_all(dev, NULL); +} + +static const struct component_master_ops rkvdec_master_ops =3D { + .bind =3D rkvdec_bind, + .unbind =3D rkvdec_unbind, }; =20 -static struct platform_driver rkvdec_driver =3D { +static int rkvdec_probe(struct platform_device *pdev) +{ + const struct of_device_id *match_desc =3D pdev->dev.platform_data; + struct device *dev =3D &pdev->dev; + struct component_match *match =3D NULL; + struct device_node *core_node; + struct rkvdec_dev *rkvdec; + + if (!match_desc) + return dev_err_probe(dev, -ENODEV, "missing platform data\n"); + + for_each_compatible_node(core_node, NULL, match_desc->compatible) { + if (!of_device_is_available(core_node)) + continue; + + of_node_get(core_node); + component_match_add_release(dev, &match, component_release_of, + component_compare_of, core_node); + } + + if (!match) + return dev_err_probe(dev, -ENODEV, + "no matching available component devices found\n"); + + rkvdec =3D devm_kzalloc(dev, sizeof(*rkvdec), GFP_KERNEL); + if (!rkvdec) + return -ENOMEM; + + rkvdec->variant =3D match_desc->data; + if (!rkvdec->variant) + return dev_err_probe(dev, -ENODEV, "failed to get match data\n"); + + mutex_init(&rkvdec->vdev_lock); + + dev_set_drvdata(dev, rkvdec); + + return component_master_add_with_match(dev, &rkvdec_master_ops, match); +} + +static void rkvdec_remove(struct platform_device *pdev) +{ + component_master_del(&pdev->dev, &rkvdec_master_ops); +} + +static struct platform_driver rkvdec_pdrv =3D { .probe =3D rkvdec_probe, .remove =3D rkvdec_remove, .driver =3D { - .name =3D "rkvdec", - .of_match_table =3D of_rkvdec_match, - .pm =3D &rkvdec_pm_ops, + .name =3D "rkvdec", }, }; -module_platform_driver(rkvdec_driver); + +static bool rkvdec_of_has_available_node(const char *compat) +{ + struct device_node *node; + + for_each_compatible_node(node, NULL, compat) { + if (of_device_is_available(node)) { + of_node_put(node); + return true; + } + } + + return false; +} + +static int rkvdec_create_platform_device(struct platform_device **ppdev, + const struct of_device_id *match) +{ + struct platform_device *pdev; + int ret; + + pdev =3D platform_device_alloc(match->compatible, PLATFORM_DEVID_NONE); + if (!pdev) + return -ENOMEM; + + ret =3D platform_device_add_data(pdev, match, sizeof(*match)); + if (ret) + goto free_platform_device; + + ret =3D platform_device_add(pdev); + if (ret) + goto free_platform_device; + + ret =3D device_driver_attach(&rkvdec_pdrv.driver, &pdev->dev); + if (ret) + goto del_platform_device; + + *ppdev =3D pdev; + + return 0; + +del_platform_device: + platform_device_del(pdev); +free_platform_device: + platform_device_put(pdev); + return ret; +} + +static struct platform_device *master_pdevs[ARRAY_SIZE(of_rkvdec_match) - = 1]; + +static int __init rkvdec_init(void) +{ + unsigned int i; + int ret; + + ret =3D platform_driver_register(&rkvdec_core_pdrv); + if (ret) + return ret; + + ret =3D platform_driver_register(&rkvdec_pdrv); + if (ret) + goto unregister_core_driver; + + for (i =3D 0; i < ARRAY_SIZE(master_pdevs); i++) { + if (!rkvdec_of_has_available_node(of_rkvdec_match[i].compatible)) + continue; + + ret =3D rkvdec_create_platform_device(&master_pdevs[i], + &of_rkvdec_match[i]); + if (ret) + goto unregister_platform_devices; + } + + return 0; + +unregister_platform_devices: + for (i =3D 0; i < ARRAY_SIZE(master_pdevs); i++) { + if (master_pdevs[i]) { + platform_device_unregister(master_pdevs[i]); + master_pdevs[i] =3D NULL; + } + } + platform_driver_unregister(&rkvdec_pdrv); +unregister_core_driver: + platform_driver_unregister(&rkvdec_core_pdrv); + return ret; +} +module_init(rkvdec_init); + +static void __exit rkvdec_exit(void) +{ + unsigned int i; + + for (i =3D 0; i < ARRAY_SIZE(master_pdevs); i++) { + if (master_pdevs[i]) { + platform_device_unregister(master_pdevs[i]); + master_pdevs[i] =3D NULL; + } + } + platform_driver_unregister(&rkvdec_pdrv); + platform_driver_unregister(&rkvdec_core_pdrv); +} +module_exit(rkvdec_exit); =20 MODULE_AUTHOR("Boris Brezillon "); MODULE_DESCRIPTION("Rockchip Video Decoder driver"); diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec.h b/drivers/medi= a/platform/rockchip/rkvdec/rkvdec.h index a24be6638b6b..36eadcfcabdb 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec.h +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec.h @@ -125,23 +125,28 @@ struct rkvdec_coded_fmt_desc { u32 subsystem_flags; }; =20 -struct rkvdec_dev { - struct v4l2_device v4l2_dev; - struct media_device mdev; - struct video_device vdev; - struct v4l2_m2m_dev *m2m_dev; +struct rkvdec_core { struct device *dev; struct clk_bulk_data *clocks; unsigned int num_clocks; struct clk *axi_clk; void __iomem *regs; void __iomem *link; - struct mutex vdev_lock; /* serializes ioctls */ struct delayed_work watchdog_work; struct gen_pool *sram_pool; - struct iommu_domain *iommu_domain; struct iommu_domain *empty_domain; + struct rkvdec_rcb_config *rcb_config; + struct rkvdec_ctx *curr_ctx; +}; + +struct rkvdec_dev { + struct v4l2_device v4l2_dev; + struct media_device mdev; + struct video_device vdev; + struct v4l2_m2m_dev *m2m_dev; + struct mutex vdev_lock; /* serializes ioctls */ const struct rkvdec_variant *variant; + struct rkvdec_core *main_core; }; =20 struct rkvdec_ctx { @@ -152,8 +157,8 @@ struct rkvdec_ctx { struct v4l2_ctrl_handler ctrl_hdl; struct rkvdec_dev *dev; enum rkvdec_image_fmt image_fmt; - struct rkvdec_rcb_config *rcb_config; u32 colmv_offset; + struct rkvdec_core *core; void *priv; u8 has_sps_st_rps: 1; u8 has_sps_lt_rps: 1; @@ -179,7 +184,7 @@ struct rkvdec_aux_buf { void rkvdec_run_preamble(struct rkvdec_ctx *ctx, struct rkvdec_run *run); void rkvdec_run_postamble(struct rkvdec_ctx *ctx, struct rkvdec_run *run); void rkvdec_memcpy_toio(void __iomem *dst, void *src, size_t len); -void rkvdec_schedule_watchdog(struct rkvdec_dev *rkvdec, u32 timeout_thres= hold); +void rkvdec_schedule_watchdog(struct rkvdec_core *core, u32 timeout_thresh= old); =20 void rkvdec_quirks_disable_qos(struct rkvdec_ctx *ctx); =20 --=20 2.55.0 From nobody Tue Sep 29 08:22:56 2026 Received: from bali.collaboradmins.com (bali.collaboradmins.com [148.251.105.195]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 49D8F41F5F5; Mon, 10 Aug 2026 15:22:32 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=148.251.105.195 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786375354; cv=none; b=UK6rXvZsHWjIdheFaWSVfabYxeyLICFweOtku1rEsMtk9ap9HqiBRw5Khyhg31R+bICCw108KZyn9R3VyF2M02Dv7IDi52GhqYqzSxpYwKrfAfaQ+GycWNU6icHyRA/bmjbbW6wNDEUL53SEYunMAlr7L6REGpOEL3AXSi0JYUs= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786375354; c=relaxed/simple; bh=cszoaVjwiWPkOJRXCl88yPw8VTJ9RaZ3SgXce/rSJ/U=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=oiOTbG4GAiaFULbkC2al261ouQZuBDmA+WoNL7mfHGEClrzHX3qMHYjqw3+9lxVwwOyoE3F9vAFp61wGTXNWIg3ZJ/lTwAh94ipu73J9lRD5GK6HUHEwnJXv0kQA66YFGOSfYu3C4cauMmhk1Rq7hEm7jvZsfjFBEsKOJtai4is= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=collabora.com; spf=pass smtp.mailfrom=collabora.com; dkim=pass (2048-bit key) header.d=collabora.com header.i=@collabora.com header.b=VDETZCyP; arc=none smtp.client-ip=148.251.105.195 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=collabora.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=collabora.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=collabora.com header.i=@collabora.com header.b="VDETZCyP" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=collabora.com; s=mail; t=1786375350; bh=cszoaVjwiWPkOJRXCl88yPw8VTJ9RaZ3SgXce/rSJ/U=; h=From:Date:Subject:References:In-Reply-To:To:Cc:From; b=VDETZCyPHbe8B2zGlsAUwHlEVp9+Cey/AYndat5DsIXDeSvraiDQBSa7IUZaSKAAJ 6nS/kCx+ur9ReBTEHMhdQlVA84aV8n+/0fHmezIN7l+MnJxeL9XOxGxvM4N+OUBt9o StRItddDPYSSuRlAZw+EXSq2HpI/MmOVgjmo6vn9TyZTUr3ID/j15dTZM22aXHp/wG uyIJzyS3kszuC0/Dr0t+pYuIe/f2o34QXNzbF2S5RPSi4jQD5ial7EGdg3OHiAdhJ1 lqGrzK9gb2DMmvqJgOHN6zm4q1SeaeezPBcNK8SxPXRaimWoT+/72y1//G/W+ynRcw qb5ks62V6jf1g== Received: from [192.168.0.15] (unknown [100.64.0.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: detlev) by bali.collaboradmins.com (Postfix) with ESMTPSA id 1A5ED17E0E64; Mon, 10 Aug 2026 17:22:28 +0200 (CEST) From: Detlev Casanova Date: Mon, 10 Aug 2026 11:22:15 -0400 Subject: [PATCH v2 5/5] media: rkvdec: Add multicore support Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <20260810-rkvdec-multicore-v2-5-986f89d22cdc@collabora.com> References: <20260810-rkvdec-multicore-v2-0-986f89d22cdc@collabora.com> In-Reply-To: <20260810-rkvdec-multicore-v2-0-986f89d22cdc@collabora.com> To: Mauro Carvalho Chehab , Ezequiel Garcia , Heiko Stuebner , Nicolas Dufresne , Hans Verkuil , Jonas Karlman Cc: =?utf-8?q?Sven_P=C3=BCschel?= , kernel@collabora.com, linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-rockchip@lists.infradead.org, linux-arm-kernel@lists.infradead.org, Detlev Casanova X-Mailer: b4 0.15.2 Rockchip SoCs like the RK3588 have multiple independent decoder cores defined in the device tree as separate nodes sharing the same compatible. Extend the component-based driver to actually drive all of them from the same v4l2 device. It uses the v4l2_m2m_set_max_parallel_jobs() function to set the number of available cores, making sure that only 1 job per m2m context is running at a given time. This is crucial for a stateless decoder as each job may depend on the completion of previous jobs. This avoids adding a complex scheduler that iwould have to ensure that all needed reference frames are fully decoded before decoding a frame. Instead, cores will work in parallel on different streams. As each core has its own IOMMU core, buffers must be mapped in each core's IOMMU so that any run() call can use any core without having to remap everything. To do that, we use rockchip iommu domain's iommu devices list. With that, one IOMMU domain can be mapped on multiple devices, meaning that each call to iommu_map() will flush the new mapping on all devices in the list. The IOMMU domain that will have all devices in its list is the first core's default domain. Another domain cannot be used because VB2 allocates buffers through the DMA engine, which uses iommu_get_dma_domain() to find the domain to map buffers through. The IOMMU restore function can still work as before, but needs to be more explicit in what domain to attach the device to. That is because detaching the empty domain will reattach the core's default domain, which is wrong (except for the first "main" core). The RCB temporary buffers are allocated in a dedicated SRAM, and each core has its own SRAM, so the mapping for each core's SRAM is added in the global domain. Everything else is mapped through the first core's default domain, making the driver write the mappings on both IOMMU cores. Signed-off-by: Detlev Casanova --- .../media/platform/rockchip/rkvdec/rkvdec-rcb.c | 12 +-- drivers/media/platform/rockchip/rkvdec/rkvdec.c | 104 +++++++++++++++++= ++-- drivers/media/platform/rockchip/rkvdec/rkvdec.h | 8 ++ 3 files changed, 107 insertions(+), 17 deletions(-) diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.c b/drivers/= media/platform/rockchip/rkvdec/rkvdec-rcb.c index 44df5b6df80c..977e37cf209b 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec-rcb.c @@ -76,9 +76,8 @@ void rkvdec_free_rcb(struct rkvdec_dev *rkvdec, struct rk= vdec_core *core) case RKVDEC_ALLOC_SRAM: virt_addr =3D (unsigned long)cfg->rcb_bufs[i].cpu; =20 - if (iommu_get_domain_for_dev(core->dev)) - iommu_unmap(iommu_get_domain_for_dev(core->dev), - virt_addr, rcb_size); + if (rkvdec->iommu_global_domain) + iommu_unmap(rkvdec->iommu_global_domain, virt_addr, rcb_size); gen_pool_free(core->sram_pool, virt_addr, rcb_size); break; case RKVDEC_ALLOC_DMA: @@ -134,7 +133,7 @@ int rkvdec_allocate_rcb(struct rkvdec_dev *rkvdec, stru= ct rkvdec_core *core, =20 /* Try allocating an SRAM buffer */ if (core->sram_pool) { - if (iommu_get_domain_for_dev(core->dev)) + if (rkvdec->iommu_global_domain) rcb_size =3D ALIGN(rcb_size, SZ_4K); =20 cpu =3D gen_pool_dma_zalloc_align(core->sram_pool, @@ -144,12 +143,11 @@ int rkvdec_allocate_rcb(struct rkvdec_dev *rkvdec, st= ruct rkvdec_core *core, } =20 /* If an IOMMU is used, map the SRAM address through it */ - if (cpu && iommu_get_domain_for_dev(core->dev)) { + if (cpu && rkvdec->iommu_global_domain) { unsigned long virt_addr =3D (unsigned long)cpu; phys_addr_t phys_addr =3D dma; =20 - ret =3D iommu_map(iommu_get_domain_for_dev(core->dev), - virt_addr, phys_addr, + ret =3D iommu_map(rkvdec->iommu_global_domain, virt_addr, phys_addr, rcb_size, IOMMU_READ | IOMMU_WRITE, 0); if (ret) { gen_pool_free(core->sram_pool, diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec.c b/drivers/medi= a/platform/rockchip/rkvdec/rkvdec.c index d3b13132b751..35850231922e 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec.c +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec.c @@ -1058,6 +1058,37 @@ static const struct media_device_ops rkvdec_media_op= s =3D { .req_queue =3D v4l2_m2m_request_queue, }; =20 +/** + * Return a core that is available for decoding or null if no core is foun= d. + * The caller should make sure to call release_core() when the core is no = longer needed. + */ +static struct rkvdec_core *acquire_core(struct rkvdec_dev *rkvdec, struct = rkvdec_ctx *ctx) +{ + struct rkvdec_core *core =3D NULL; + + guard(spinlock_irqsave)(&rkvdec->cores_lock); + + if (rkvdec->available_core_count) { + core =3D rkvdec->available_cores[--rkvdec->available_core_count]; + + // Set the current core's ctx to this ctx + core->curr_ctx =3D ctx; + } + + return core; +} + +/** + * Release the core to make it available for a next job. + */ +static void release_core(struct rkvdec_dev *rkvdec, struct rkvdec_core *co= re) +{ + guard(spinlock_irqsave)(&rkvdec->cores_lock); + + core->curr_ctx =3D NULL; + rkvdec->available_cores[rkvdec->available_core_count++] =3D core; +} + static void rkvdec_job_finish_no_pm(struct rkvdec_ctx *ctx, enum vb2_buffer_state result) { @@ -1072,6 +1103,11 @@ static void rkvdec_job_finish_no_pm(struct rkvdec_ct= x *ctx, ctx->coded_fmt_desc->ops->done(ctx, src_buf, dst_buf, result); } =20 + if (ctx->core) { + release_core(ctx->dev, ctx->core); + ctx->core =3D NULL; + } + v4l2_m2m_buf_done_and_job_finish(m2m_dev, m2m_ctx, result); } =20 @@ -1153,8 +1189,9 @@ static void rkvdec_device_run(void *priv) if (WARN_ON(!desc)) return; =20 - ctx->core =3D ctx->dev->main_core; - ctx->core->curr_ctx =3D ctx; + ctx->core =3D acquire_core(ctx->dev, ctx); + if (WARN_ON(!ctx->core)) + return; =20 ret =3D pm_runtime_resume_and_get(ctx->core->dev); if (ret < 0) { @@ -1424,6 +1461,7 @@ static void rkvdec_v4l2_cleanup(struct rkvdec_dev *rk= vdec) =20 static void rkvdec_iommu_restore(struct rkvdec_core *core) { + int ret; if (core->empty_domain) { /* * To rewrite mapping into the attached IOMMU core, attach a new empty d= omain that @@ -1432,8 +1470,14 @@ static void rkvdec_iommu_restore(struct rkvdec_core = *core) * This is safely done in this interrupt handler to make sure no memory = get mapped * through the IOMMU while the empty domain is attached. */ - iommu_attach_device(core->empty_domain, core->dev); + iommu_detach_device(core->curr_ctx->dev->iommu_global_domain, core->dev); + ret =3D iommu_attach_device(core->empty_domain, core->dev); + if (ret) + dev_warn(core->dev, "Cannot attach empty domain: %d\n", ret); iommu_detach_device(core->empty_domain, core->dev); + ret =3D iommu_attach_device(core->curr_ctx->dev->iommu_global_domain, co= re->dev); + if (ret) + dev_warn(core->dev, "Cannot attach global domain: %d\n", ret); } } =20 @@ -1724,14 +1768,35 @@ static int rkvdec_core_bind(struct device *dev, str= uct device *master, void *dat struct platform_device *pdev =3D to_platform_device(dev); struct rkvdec_core *core =3D platform_get_drvdata(pdev); struct rkvdec_dev *rkvdec =3D data; + int id, ret; + + id =3D rkvdec->core_count; + core->id =3D id; + rkvdec->cores[id] =3D core; + + if (id =3D=3D 0) + rkvdec->main_core =3D core; + + if (iommu_get_domain_for_dev(dev)) { + if (!rkvdec->iommu_global_domain) { + rkvdec->iommu_global_domain =3D iommu_get_domain_for_dev(dev); + if (IS_ERR(rkvdec->iommu_global_domain)) { + rkvdec->iommu_global_domain =3D NULL; + dev_warn_once(dev, "cannot get global domain\n"); + } + } =20 - if (rkvdec->main_core) - return dev_err_probe(dev, -EBUSY, - "rkvdec already has a bound core\n"); + if (rkvdec->iommu_global_domain) { + ret =3D iommu_attach_device(rkvdec->iommu_global_domain, dev); + if (ret) + dev_warn(dev, "cannot attach global domain to core %d\n", id); + } + } =20 - rkvdec->main_core =3D core; + release_core(rkvdec, core); + rkvdec->core_count++; =20 - dev_info(dev, "Registered core\n"); + dev_info(dev, "Registered core %d\n", id); =20 return 0; } @@ -1900,6 +1965,8 @@ static int rkvdec_bind(struct device *dev) if (ret) goto err_unbind; =20 + v4l2_m2m_set_max_parallel_jobs(rkvdec->m2m_dev, rkvdec->core_count); + return 0; =20 err_unbind: @@ -1910,12 +1977,15 @@ static int rkvdec_bind(struct device *dev) static void rkvdec_unbind(struct device *dev) { struct rkvdec_dev *rkvdec =3D dev_get_drvdata(dev); + int i; =20 - cancel_delayed_work_sync(&rkvdec->main_core->watchdog_work); + for (i =3D 0; i < rkvdec->core_count; i++) + cancel_delayed_work_sync(&rkvdec->cores[i]->watchdog_work); =20 rkvdec_v4l2_cleanup(rkvdec); =20 - rkvdec_free_rcb(rkvdec, rkvdec->main_core); + for (i =3D 0; i < rkvdec->core_count; i++) + rkvdec_free_rcb(rkvdec, rkvdec->cores[i]); =20 component_unbind_all(dev, NULL); } @@ -1932,6 +2002,7 @@ static int rkvdec_probe(struct platform_device *pdev) struct component_match *match =3D NULL; struct device_node *core_node; struct rkvdec_dev *rkvdec; + unsigned int num_cores =3D 0; =20 if (!match_desc) return dev_err_probe(dev, -ENODEV, "missing platform data\n"); @@ -1943,6 +2014,7 @@ static int rkvdec_probe(struct platform_device *pdev) of_node_get(core_node); component_match_add_release(dev, &match, component_release_of, component_compare_of, core_node); + num_cores++; } =20 if (!match) @@ -1953,11 +2025,23 @@ static int rkvdec_probe(struct platform_device *pde= v) if (!rkvdec) return -ENOMEM; =20 + rkvdec->cores =3D devm_kcalloc(dev, num_cores, sizeof(*rkvdec->cores), + GFP_KERNEL); + if (!rkvdec->cores) + return -ENOMEM; + + rkvdec->available_cores =3D devm_kcalloc(dev, num_cores, + sizeof(*rkvdec->available_cores), + GFP_KERNEL); + if (!rkvdec->available_cores) + return -ENOMEM; + rkvdec->variant =3D match_desc->data; if (!rkvdec->variant) return dev_err_probe(dev, -ENODEV, "failed to get match data\n"); =20 mutex_init(&rkvdec->vdev_lock); + spin_lock_init(&rkvdec->cores_lock); =20 dev_set_drvdata(dev, rkvdec); =20 diff --git a/drivers/media/platform/rockchip/rkvdec/rkvdec.h b/drivers/medi= a/platform/rockchip/rkvdec/rkvdec.h index 36eadcfcabdb..d5977cef6df7 100644 --- a/drivers/media/platform/rockchip/rkvdec/rkvdec.h +++ b/drivers/media/platform/rockchip/rkvdec/rkvdec.h @@ -15,6 +15,7 @@ #include #include #include +#include =20 #include #include @@ -137,6 +138,7 @@ struct rkvdec_core { struct iommu_domain *empty_domain; struct rkvdec_rcb_config *rcb_config; struct rkvdec_ctx *curr_ctx; + int id; }; =20 struct rkvdec_dev { @@ -146,7 +148,13 @@ struct rkvdec_dev { struct v4l2_m2m_dev *m2m_dev; struct mutex vdev_lock; /* serializes ioctls */ const struct rkvdec_variant *variant; + struct rkvdec_core **cores; + int core_count; + struct rkvdec_core **available_cores; + unsigned int available_core_count; + spinlock_t cores_lock; /* serializes core list access */ struct rkvdec_core *main_core; + struct iommu_domain *iommu_global_domain; }; =20 struct rkvdec_ctx { --=20 2.55.0