From nobody Tue Feb 10 02:48:09 2026 Received: from metis.whiteo.stw.pengutronix.de (metis.whiteo.stw.pengutronix.de [185.203.201.7]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 64590339B30 for ; Wed, 3 Dec 2025 15:54:19 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=185.203.201.7 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1764777262; cv=none; b=Axo4+KscAL7woNS2hfwr7qoNX4dRn+nYGbtubmQOWtVnCkqyB5VwOW4VR20MEAbfHPLm3nshslKQJ1Tsp4qCfWFGN0XmZEaIcN+Bykjvaq0FOOUZN/+Ckpry/cJoaSTl2lNfKRI54GMbR8i4MeFvbi8TL+XxH+GGgEikbj7N7vQ= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1764777262; c=relaxed/simple; bh=9HzTHn5gf13iYqMGQmwCqPcqOCTeW1bMs7Bc/KZhHQs=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=O1psS/L/iGfmdcm+wPv7fnSjannvsIV/yZyUk8GKZ5zbYoq7+d65MVu6ltuLfzLjWeTRcJQfD63GfOhQ+0Re73IIO7XJucMAQr+PTzs7gNcSh1ARFTrJqdDSQl4WmdFuuAjXS+AbPcgngnKWfsZVhN8ywT2AzOQ4v5d2PaBUeSQ= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=pengutronix.de; spf=pass smtp.mailfrom=pengutronix.de; arc=none smtp.client-ip=185.203.201.7 Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=pengutronix.de Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=pengutronix.de Received: from ptz.office.stw.pengutronix.de ([2a0a:edc0:0:900:1d::77] helo=peter.mobile.pengutronix.de) by metis.whiteo.stw.pengutronix.de with esmtp (Exim 4.92) (envelope-from ) id 1vQpAd-0007dW-K6; Wed, 03 Dec 2025 16:53:35 +0100 From: =?utf-8?q?Sven_P=C3=BCschel?= Date: Wed, 03 Dec 2025 16:52:33 +0100 Subject: [PATCH v2 11/22] media: rockchip: rga: check scaling factor Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <20251203-spu-rga3-v2-11-989a67947f71@pengutronix.de> References: <20251203-spu-rga3-v2-0-989a67947f71@pengutronix.de> In-Reply-To: <20251203-spu-rga3-v2-0-989a67947f71@pengutronix.de> To: Jacob Chen , Ezequiel Garcia , Mauro Carvalho Chehab , Heiko Stuebner , Rob Herring , Krzysztof Kozlowski , Conor Dooley Cc: linux-media@vger.kernel.org, linux-rockchip@lists.infradead.org, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, devicetree@vger.kernel.org, kernel@pengutronix.de, =?utf-8?q?Sven_P=C3=BCschel?= X-Mailer: b4 0.14.3 X-SA-Exim-Connect-IP: 2a0a:edc0:0:900:1d::77 X-SA-Exim-Mail-From: s.pueschel@pengutronix.de X-SA-Exim-Scanned: No (on metis.whiteo.stw.pengutronix.de); SAEximRunCond expanded to false X-PTX-Original-Recipient: linux-kernel@vger.kernel.org Check the scaling factor to avoid potential problems. This is relevant for the upcoming RGA3 support, as it can hang when the scaling factor is exceeded. There are two relevant scenarios that have to be considered to protect against invalid scaling values: When the output or capture is already streaming, setting the format on the other side should consider the max scaling factor and clamp it accordingly. This is only done in the streaming case, as it otherwise may unintentionally clamp the value when the application sets the first format (due to a default format on the other side). When the format is set on both sides first, then the format won't be corrected by above means. Therefore the second streamon call has to check the scaling factor and fail otherwise. Signed-off-by: Sven P=C3=BCschel --- drivers/media/platform/rockchip/rga/rga-hw.c | 1 + drivers/media/platform/rockchip/rga/rga-hw.h | 1 + drivers/media/platform/rockchip/rga/rga.c | 60 ++++++++++++++++++++++++= +--- drivers/media/platform/rockchip/rga/rga.h | 1 + 4 files changed, 58 insertions(+), 5 deletions(-) diff --git a/drivers/media/platform/rockchip/rga/rga-hw.c b/drivers/media/p= latform/rockchip/rga/rga-hw.c index 8cdfe089fd636..2ed4f22a999d5 100644 --- a/drivers/media/platform/rockchip/rga/rga-hw.c +++ b/drivers/media/platform/rockchip/rga/rga-hw.c @@ -624,6 +624,7 @@ const struct rga_hw rga2_hw =3D { .max_width =3D MAX_WIDTH, .min_height =3D MIN_HEIGHT, .max_height =3D MAX_HEIGHT, + .max_scaling_factor =3D MAX_SCALING_FACTOR, .stride_alignment =3D 4, =20 .setup_cmdbuf =3D rga_hw_setup_cmdbuf, diff --git a/drivers/media/platform/rockchip/rga/rga-hw.h b/drivers/media/p= latform/rockchip/rga/rga-hw.h index f4752aa823051..fffcab0131225 100644 --- a/drivers/media/platform/rockchip/rga/rga-hw.h +++ b/drivers/media/platform/rockchip/rga/rga-hw.h @@ -14,6 +14,7 @@ =20 #define MIN_WIDTH 34 #define MIN_HEIGHT 34 +#define MAX_SCALING_FACTOR 16 =20 #define RGA_TIMEOUT 500 =20 diff --git a/drivers/media/platform/rockchip/rga/rga.c b/drivers/media/plat= form/rockchip/rga/rga.c index f02ae02de26ca..46dc94db6f85e 100644 --- a/drivers/media/platform/rockchip/rga/rga.c +++ b/drivers/media/platform/rockchip/rga/rga.c @@ -346,18 +346,47 @@ static int vidioc_g_fmt(struct file *file, void *priv= , struct v4l2_format *f) static int vidioc_try_fmt(struct file *file, void *priv, struct v4l2_forma= t *f) { struct v4l2_pix_format_mplane *pix_fmt =3D &f->fmt.pix_mp; - struct rockchip_rga *rga =3D video_drvdata(file); + struct rga_ctx *ctx =3D file_to_rga_ctx(file); + struct rockchip_rga *rga =3D ctx->rga; const struct rga_hw *hw =3D rga->hw; struct rga_fmt *fmt; + u32 min_width =3D hw->min_width; + u32 max_width =3D hw->max_width; + u32 min_height =3D hw->min_height; + u32 max_height =3D hw->max_height; =20 fmt =3D rga_fmt_find(rga, pix_fmt->pixelformat); if (!fmt) fmt =3D &hw->formats[0]; =20 - pix_fmt->width =3D clamp(pix_fmt->width, - hw->min_width, hw->max_width); - pix_fmt->height =3D clamp(pix_fmt->height, - hw->min_height, hw->max_height); + if (V4L2_TYPE_IS_OUTPUT(f->type) && + v4l2_m2m_get_dst_vq(ctx->fh.m2m_ctx)->streaming) { + min_width =3D + MAX(min_width, DIV_ROUND_UP(ctx->out.pix.width, + hw->max_scaling_factor)); + max_width =3D MIN(max_width, + ctx->out.pix.width * hw->max_scaling_factor); + min_height =3D + MAX(min_height, DIV_ROUND_UP(ctx->out.pix.height, + hw->max_scaling_factor)); + max_height =3D MIN(max_height, + ctx->out.pix.height * hw->max_scaling_factor); + } else if (V4L2_TYPE_IS_CAPTURE(f->type) && + v4l2_m2m_get_src_vq(ctx->fh.m2m_ctx)->streaming) { + min_width =3D + MAX(min_width, DIV_ROUND_UP(ctx->in.pix.width, + hw->max_scaling_factor)); + max_width =3D MIN(max_width, + ctx->in.pix.width * hw->max_scaling_factor); + min_height =3D + MAX(min_height, DIV_ROUND_UP(ctx->in.pix.height, + hw->max_scaling_factor)); + max_height =3D MIN(max_height, + ctx->in.pix.height * hw->max_scaling_factor); + } + + pix_fmt->width =3D clamp(pix_fmt->width, min_width, max_width); + pix_fmt->height =3D clamp(pix_fmt->height, min_height, max_height); =20 v4l2_fill_pixfmt_mp_aligned(pix_fmt, pix_fmt->pixelformat, pix_fmt->width, pix_fmt->height, hw->stride_alignment); @@ -523,12 +552,33 @@ static int vidioc_s_selection(struct file *file, void= *priv, return ret; } =20 +static bool check_scaling(const struct rga_hw *hw, u32 src_size, u32 dst_s= ize) +{ + if (src_size < dst_size) + return src_size * hw->max_scaling_factor >=3D dst_size; + else + return dst_size * hw->max_scaling_factor >=3D src_size; +} + static int vidioc_streamon(struct file *file, void *priv, enum v4l2_buf_type type) { struct rga_ctx *ctx =3D file_to_rga_ctx(file); const struct rga_hw *hw =3D ctx->rga->hw; =20 + if ((V4L2_TYPE_IS_OUTPUT(type) && + v4l2_m2m_get_dst_vq(ctx->fh.m2m_ctx)->streaming) || + (V4L2_TYPE_IS_CAPTURE(type) && + v4l2_m2m_get_src_vq(ctx->fh.m2m_ctx)->streaming)) { + /* + * As the other side is already streaming, + * check that the max scaling factor isn't exceeded. + */ + if (!check_scaling(hw, ctx->in.pix.width, ctx->out.pix.width) || + !check_scaling(hw, ctx->in.pix.height, ctx->out.pix.height)) + return -EINVAL; + } + hw->setup_cmdbuf(ctx); =20 return v4l2_m2m_streamon(file, ctx->fh.m2m_ctx, type); diff --git a/drivers/media/platform/rockchip/rga/rga.h b/drivers/media/plat= form/rockchip/rga/rga.h index 93162b118d069..d02d5730b4e3b 100644 --- a/drivers/media/platform/rockchip/rga/rga.h +++ b/drivers/media/platform/rockchip/rga/rga.h @@ -152,6 +152,7 @@ struct rga_hw { size_t cmdbuf_size; u32 min_width, min_height; u32 max_width, max_height; + u8 max_scaling_factor; u8 stride_alignment; =20 void (*setup_cmdbuf)(struct rga_ctx *ctx); --=20 2.52.0