From nobody Thu Apr 2 20:27:01 2026 Received: from perceval.ideasonboard.com (perceval.ideasonboard.com [213.167.242.64]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 1F66F34EEF2; Wed, 4 Mar 2026 15:50:37 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=213.167.242.64 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1772639438; cv=none; b=L/xrprO+lZe5GVvKJq6saGmanZIwI9Hvu8JAeGcDxyQVQPDntqDC/Q0Y65RBT/KjUWj7PrUBHKazx2QWUFSfFYC+GA6KAi3FrZdT5o6Z7sbM3kDkROaOQthPiPnwQof6jg0H3nrazIj2wQOvU3SXo1gYvBx1CaQjRnUm0p6ZBbE= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1772639438; c=relaxed/simple; bh=CzRhEfOyUudbHke9KgdFAtAYtmG9TMIu7xK+0uvey80=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=iAr0/ZpALrFG4YeNHR3tO2gPwOhqIAopO8zJTXeibEIF5MwXuhUTVNDHdQpRTa8ZMK9EYI5GyXbFKaP4am7dXUKewlcuJAdYbcj56squu3aG7O6RKJV/FqZmYrY+I5U02V/40XmQ/B4/HYysuKXIxgkANTqRWTe0PV3Qe7ArjzE= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=ideasonboard.com; spf=pass smtp.mailfrom=ideasonboard.com; dkim=pass (1024-bit key) header.d=ideasonboard.com header.i=@ideasonboard.com header.b=icf6QAYA; arc=none smtp.client-ip=213.167.242.64 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=ideasonboard.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=ideasonboard.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=ideasonboard.com header.i=@ideasonboard.com header.b="icf6QAYA" Received: from ideasonboard.com (unknown [IPv6:2a00:6020:448c:6c00:404d:d4e8:ffdc:3995]) by perceval.ideasonboard.com (Postfix) with UTF8SMTPSA id 487EDC78; Wed, 4 Mar 2026 16:49:27 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ideasonboard.com; s=mail; t=1772639367; bh=CzRhEfOyUudbHke9KgdFAtAYtmG9TMIu7xK+0uvey80=; h=From:Date:Subject:References:In-Reply-To:To:Cc:From; b=icf6QAYA0shcrbD3JcIB77WYABr0jwOcwd1YtZaMS2CElYyaC+TB0SnTvA96rxVmk BnZSLs2RyjqoIzvK2i8LAS1T+OUHuCJUXbBfciQn+F66yOPuvfvss/IAB8NvIrWSGs C7QrYcJAXAGrucQvusjg7aWQXAuOSDFygXtdfNKk= From: Stefan Klug Date: Wed, 04 Mar 2026 16:50:22 +0100 Subject: [PATCH v5 1/4] media: dw100: Implement V4L2 requests support Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <20260304-sklug-v6-16-topic-dw100-v3-1-dev-v5-1-1a7e1f721b50@ideasonboard.com> References: <20260304-sklug-v6-16-topic-dw100-v3-1-dev-v5-0-1a7e1f721b50@ideasonboard.com> In-Reply-To: <20260304-sklug-v6-16-topic-dw100-v3-1-dev-v5-0-1a7e1f721b50@ideasonboard.com> To: Xavier Roumegue , Mauro Carvalho Chehab , Sebastian Andrzej Siewior , Clark Williams , Steven Rostedt , Laurent Pinchart Cc: linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-rt-devel@lists.linux.dev, Nicolas Dufresne , Stefan Klug X-Mailer: b4 0.14.2 The dw100 dewarper hardware present on the NXP i.MX8MP allows very flexible dewarping using a freely configurable vertex map. Aside from lens dewarping the vertex map can be used to implement things like arbitrary zoom, pan and rotation. The current driver supports setting that vertex map before calling VIDIOC_STREAMON. To control above mentioned features during streaming it is necessary to update the vertex map dynamically. To do that in a race free manner V4L2 requests support is required. Add V4L2 requests support to prepare for dynamic vertex map updates. Signed-off-by: Stefan Klug Reviewed-by: Laurent Pinchart --- Changes in v5: - Dropped the call to v4l2_m2m_job_finish() that was missed in v2 and lead to a race condition where jobs would be finished immediately after being queued. Changes in v4: - Improved commit message - Added comment above v4l2_ctrl_request_complete() - Collected tag Changes in v2: - Use v4l2_m2m_buf_done_and_job_finish() to mark the buffers as done in the correct order. Changes in v1: - Moved v4l2_ctrl_request_complete into dw100_device_run --- drivers/media/platform/nxp/dw100/dw100.c | 55 ++++++++++++++++++++++++----= ---- 1 file changed, 42 insertions(+), 13 deletions(-) diff --git a/drivers/media/platform/nxp/dw100/dw100.c b/drivers/media/platf= orm/nxp/dw100/dw100.c index 4aaf9c3fff5397f0441944ee926f2c8ba6fc864a..17c8aa87a162e5b199b8e9a2c00= d6cb346c5bf89 100644 --- a/drivers/media/platform/nxp/dw100/dw100.c +++ b/drivers/media/platform/nxp/dw100/dw100.c @@ -459,6 +459,15 @@ static int dw100_queue_setup(struct vb2_queue *vq, return 0; } =20 +static int dw100_buf_out_validate(struct vb2_buffer *vb) +{ + struct vb2_v4l2_buffer *vbuf =3D to_vb2_v4l2_buffer(vb); + + vbuf->field =3D V4L2_FIELD_NONE; + + return 0; +} + static int dw100_buf_prepare(struct vb2_buffer *vb) { unsigned int i; @@ -500,6 +509,13 @@ static void dw100_buf_queue(struct vb2_buffer *vb) v4l2_m2m_buf_queue(ctx->fh.m2m_ctx, vbuf); } =20 +static void dw100_buf_request_complete(struct vb2_buffer *vb) +{ + struct dw100_ctx *ctx =3D vb2_get_drv_priv(vb->vb2_queue); + + v4l2_ctrl_request_complete(vb->req_obj.req, &ctx->hdl); +} + static void dw100_return_all_buffers(struct vb2_queue *q, enum vb2_buffer_state state) { @@ -553,11 +569,13 @@ static void dw100_stop_streaming(struct vb2_queue *q) } =20 static const struct vb2_ops dw100_qops =3D { - .queue_setup =3D dw100_queue_setup, - .buf_prepare =3D dw100_buf_prepare, - .buf_queue =3D dw100_buf_queue, - .start_streaming =3D dw100_start_streaming, - .stop_streaming =3D dw100_stop_streaming, + .queue_setup =3D dw100_queue_setup, + .buf_out_validate =3D dw100_buf_out_validate, + .buf_prepare =3D dw100_buf_prepare, + .buf_queue =3D dw100_buf_queue, + .start_streaming =3D dw100_start_streaming, + .stop_streaming =3D dw100_stop_streaming, + .buf_request_complete =3D dw100_buf_request_complete, }; =20 static int dw100_m2m_queue_init(void *priv, struct vb2_queue *src_vq, @@ -575,6 +593,7 @@ static int dw100_m2m_queue_init(void *priv, struct vb2_= queue *src_vq, src_vq->timestamp_flags =3D V4L2_BUF_FLAG_TIMESTAMP_COPY; src_vq->lock =3D &ctx->vq_mutex; src_vq->dev =3D ctx->dw_dev->v4l2_dev.dev; + src_vq->supports_requests =3D true; =20 ret =3D vb2_queue_init(src_vq); if (ret) @@ -1058,7 +1077,6 @@ static const struct v4l2_ioctl_ops dw100_ioctl_ops = =3D { static void dw100_job_finish(struct dw100_device *dw_dev, bool with_error) { struct dw100_ctx *curr_ctx; - struct vb2_v4l2_buffer *src_vb, *dst_vb; enum vb2_buffer_state buf_state; =20 curr_ctx =3D v4l2_m2m_get_curr_priv(dw_dev->m2m_dev); @@ -1069,21 +1087,16 @@ static void dw100_job_finish(struct dw100_device *d= w_dev, bool with_error) return; } =20 - src_vb =3D v4l2_m2m_src_buf_remove(curr_ctx->fh.m2m_ctx); - dst_vb =3D v4l2_m2m_dst_buf_remove(curr_ctx->fh.m2m_ctx); - if (likely(!with_error)) buf_state =3D VB2_BUF_STATE_DONE; else buf_state =3D VB2_BUF_STATE_ERROR; =20 - v4l2_m2m_buf_done(src_vb, buf_state); - v4l2_m2m_buf_done(dst_vb, buf_state); - dev_dbg(&dw_dev->pdev->dev, "Finishing transaction with%s error(s)\n", with_error ? "" : "out"); =20 - v4l2_m2m_job_finish(dw_dev->m2m_dev, curr_ctx->fh.m2m_ctx); + v4l2_m2m_buf_done_and_job_finish(dw_dev->m2m_dev, curr_ctx->fh.m2m_ctx, + buf_state); } =20 static void dw100_hw_reset(struct dw100_device *dw_dev) @@ -1460,6 +1473,16 @@ static void dw100_device_run(void *priv) src_buf =3D v4l2_m2m_next_src_buf(ctx->fh.m2m_ctx); dst_buf =3D v4l2_m2m_next_dst_buf(ctx->fh.m2m_ctx); =20 + v4l2_ctrl_request_setup(src_buf->vb2_buf.req_obj.req, + &ctx->hdl); + + /* + * As the hardware does not update any volatile controls, we can + * complete control handling before starting the dewarper. + */ + v4l2_ctrl_request_complete(src_buf->vb2_buf.req_obj.req, + &ctx->hdl); + dw100_start(ctx, src_buf, dst_buf); } =20 @@ -1467,6 +1490,11 @@ static const struct v4l2_m2m_ops dw100_m2m_ops =3D { .device_run =3D dw100_device_run, }; =20 +static const struct media_device_ops dw100_m2m_media_ops =3D { + .req_validate =3D vb2_request_validate, + .req_queue =3D v4l2_m2m_request_queue, +}; + static struct video_device *dw100_init_video_device(struct dw100_device *d= w_dev) { struct video_device *vfd =3D &dw_dev->vfd; @@ -1578,6 +1606,7 @@ static int dw100_probe(struct platform_device *pdev) dw_dev->mdev.dev =3D &pdev->dev; strscpy(dw_dev->mdev.model, "dw100", sizeof(dw_dev->mdev.model)); media_device_init(&dw_dev->mdev); + dw_dev->mdev.ops =3D &dw100_m2m_media_ops; dw_dev->v4l2_dev.mdev =3D &dw_dev->mdev; =20 ret =3D video_register_device(vfd, VFL_TYPE_VIDEO, -1); --=20 2.51.0 From nobody Thu Apr 2 20:27:01 2026 Received: from perceval.ideasonboard.com (perceval.ideasonboard.com [213.167.242.64]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id B15A035B63A; Wed, 4 Mar 2026 15:50:38 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=213.167.242.64 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1772639440; cv=none; b=D+rIEKZrhz6eW4XhOGXLsRyg9SX3O2mOG4NLqPGBXfBcHLG/flvjrc1p4AhMUNKa/lRmw9JX4MUmQSun9e+UXUlTCpbhQZo0rXR+i0f+UC9q4+bYnbSjeNNuoljNkfK2wOmG3M6WioHzw/j0tCA39s+gNgXwLUnjdwrKM7ZzNuY= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1772639440; c=relaxed/simple; bh=8jOMhp1Rdfr4f4VsHXn5BTMwdklTWcTSp3nBz/NtR7w=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=aWGwHWz34c4+gxjxdF/jN35E7QZGYiZralGQsrT8yvgsBtDPWAJW0fHimitBVesMdxcT+cXqq/5rD+f3fbA2yd4ivUOZ4CeDklw1/cRlW+w6iI1h2F+btZP/4b8WVHfNTxqd7l/+x7W0/x5cnDOXFclOWvgbp3iaBL7FWyIs9Os= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=ideasonboard.com; spf=pass smtp.mailfrom=ideasonboard.com; dkim=pass (1024-bit key) header.d=ideasonboard.com header.i=@ideasonboard.com header.b=r2dT4Zv0; arc=none smtp.client-ip=213.167.242.64 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=ideasonboard.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=ideasonboard.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=ideasonboard.com header.i=@ideasonboard.com header.b="r2dT4Zv0" Received: from ideasonboard.com (unknown [IPv6:2a00:6020:448c:6c00:404d:d4e8:ffdc:3995]) by perceval.ideasonboard.com (Postfix) with UTF8SMTPSA id DF822DA4; Wed, 4 Mar 2026 16:49:29 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ideasonboard.com; s=mail; t=1772639370; bh=8jOMhp1Rdfr4f4VsHXn5BTMwdklTWcTSp3nBz/NtR7w=; h=From:Date:Subject:References:In-Reply-To:To:Cc:From; b=r2dT4Zv0mtsLOliUTzUdFIpe6TDUjXcveOk5Bz9FV/gaxN4Jk8r92pL/oxzrQu7d1 dqp9RMzSgUYy4LwKq2YjPJK8L1+6OU2e1EIJlNcAmm5YlE8G1H8BiuK3GzMXCIhU1n AIb/pm/Xv2UVcgbttcvVauaCFX0rl2iSYoDAdutE= From: Stefan Klug Date: Wed, 04 Mar 2026 16:50:23 +0100 Subject: [PATCH v5 2/4] media: dw100: Implement dynamic vertex map update Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <20260304-sklug-v6-16-topic-dw100-v3-1-dev-v5-2-1a7e1f721b50@ideasonboard.com> References: <20260304-sklug-v6-16-topic-dw100-v3-1-dev-v5-0-1a7e1f721b50@ideasonboard.com> In-Reply-To: <20260304-sklug-v6-16-topic-dw100-v3-1-dev-v5-0-1a7e1f721b50@ideasonboard.com> To: Xavier Roumegue , Mauro Carvalho Chehab , Sebastian Andrzej Siewior , Clark Williams , Steven Rostedt , Laurent Pinchart Cc: linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-rt-devel@lists.linux.dev, Nicolas Dufresne , Stefan Klug X-Mailer: b4 0.14.2 Implement dynamic vertex map updates by handling the V4L2_CID_DW100_DEWARPING_16x16_VERTEX_MAP control during streaming. This allows to implement features like dynamic zoom, pan, rotate and dewarp. To stay compatible with the old version, updates of V4L2_CID_DW100_DEWARPING_16x16_VERTEX_MAP are ignored during streaming when requests are not used. Print a corresponding warning once. Signed-off-by: Stefan Klug Reviewed-by: Laurent Pinchart --- Changes in v4: - Added missing newline at end of warning message - Fixed position of closing parenthesis - Collected tag Changes in v2: - Replaced the manual warn once by dev_warn_once(). This changes the frequency from once per context to once per boot which was agreed to be enough. - Renamed user_map_needs_update to user_map_is_dirty as it is more expressive and fits to user_map_is_set - Fixed indentation issue found by Media CI --- drivers/media/platform/nxp/dw100/dw100.c | 23 +++++++++++++++++------ 1 file changed, 17 insertions(+), 6 deletions(-) diff --git a/drivers/media/platform/nxp/dw100/dw100.c b/drivers/media/platf= orm/nxp/dw100/dw100.c index 17c8aa87a162e5b199b8e9a2c00d6cb346c5bf89..69d469944536f62af22d6fc532a= fdcf669afe4be 100644 --- a/drivers/media/platform/nxp/dw100/dw100.c +++ b/drivers/media/platform/nxp/dw100/dw100.c @@ -98,6 +98,7 @@ struct dw100_ctx { unsigned int map_width; unsigned int map_height; bool user_map_is_set; + bool user_map_is_dirty; =20 /* Source and destination queue data */ struct dw100_q_data q_data[2]; @@ -293,11 +294,15 @@ static u32 dw100_map_format_coordinates(u16 xq, u16 y= q) return (u32)((yq << 16) | xq); } =20 -static u32 *dw100_get_user_map(struct dw100_ctx *ctx) +static void dw100_update_mapping(struct dw100_ctx *ctx) { struct v4l2_ctrl *ctrl =3D ctx->ctrls[DW100_CTRL_DEWARPING_MAP]; =20 - return ctrl->p_cur.p_u32; + if (!ctx->user_map_is_dirty) + return; + + memcpy(ctx->map, ctrl->p_cur.p_u32, ctx->map_size); + ctx->user_map_is_dirty =3D false; } =20 /* @@ -306,8 +311,6 @@ static u32 *dw100_get_user_map(struct dw100_ctx *ctx) */ static int dw100_create_mapping(struct dw100_ctx *ctx) { - u32 *user_map; - if (ctx->map) dma_free_coherent(&ctx->dw_dev->pdev->dev, ctx->map_size, ctx->map, ctx->map_dma); @@ -318,8 +321,8 @@ static int dw100_create_mapping(struct dw100_ctx *ctx) if (!ctx->map) return -ENOMEM; =20 - user_map =3D dw100_get_user_map(ctx); - memcpy(ctx->map, user_map, ctx->map_size); + ctx->user_map_is_dirty =3D true; + dw100_update_mapping(ctx); =20 dev_dbg(&ctx->dw_dev->pdev->dev, "%ux%u %s mapping created (d:%pad-c:%p) for stream %ux%u->%ux%u\n", @@ -351,6 +354,7 @@ static int dw100_s_ctrl(struct v4l2_ctrl *ctrl) switch (ctrl->id) { case V4L2_CID_DW100_DEWARPING_16x16_VERTEX_MAP: ctx->user_map_is_set =3D true; + ctx->user_map_is_dirty =3D true; break; } =20 @@ -405,6 +409,7 @@ static void dw100_ctrl_dewarping_map_init(const struct = v4l2_ctrl *ctrl, } =20 ctx->user_map_is_set =3D false; + ctx->user_map_is_dirty =3D true; } =20 static const struct v4l2_ctrl_type_ops dw100_ctrl_type_ops =3D { @@ -1476,6 +1481,12 @@ static void dw100_device_run(void *priv) v4l2_ctrl_request_setup(src_buf->vb2_buf.req_obj.req, &ctx->hdl); =20 + if (src_buf->vb2_buf.req_obj.req) + dw100_update_mapping(ctx); + else if (ctx->user_map_is_dirty) + dev_warn_once(&ctx->dw_dev->pdev->dev, + "V4L2 requests are required to update the vertex map dynamically\= n"); + /* * As the hardware does not update any volatile controls, we can * complete control handling before starting the dewarper. --=20 2.51.0 From nobody Thu Apr 2 20:27:01 2026 Received: from perceval.ideasonboard.com (perceval.ideasonboard.com [213.167.242.64]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 219FF35BDAC; Wed, 4 Mar 2026 15:50:39 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=213.167.242.64 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1772639441; cv=none; b=JN+HwCVPnswOMzVtzlM9KgmS3ujg5fXsAVcKNnLwXaBHrpwySpljYsWmIzyTIN2A9NqPJHuoYZbGs+eT7NQYv7Rtq9dXqDY9pZwGOVchaxioQyfynX4FzgtBtXgOa125WJMf5Jq4cbF9JgGvITOYE9Lc74rV5vGRweARnCU9oqY= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1772639441; c=relaxed/simple; bh=/lNmnBJL/ScfCOaTNA8yDImhHy8UeD5PEVD6242bhzM=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=M1F47dd2jeg1YyjQclJ6tFacRZqBW+AxzE/VfdP67ohUFz4U9+JfIKQuVT9WIjthQlkwuBpqRMHe85n7e/sToAh+6/f27iaD8cfjwu6fURKAwE7yqEqD2ueNPw/LUDMhG3LUax49B5hcg7GUB1Wv9v3N1yYNYnX+zRgsZEUaPik= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=ideasonboard.com; spf=pass smtp.mailfrom=ideasonboard.com; dkim=pass (1024-bit key) header.d=ideasonboard.com header.i=@ideasonboard.com header.b=RhcRTdRp; arc=none smtp.client-ip=213.167.242.64 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=ideasonboard.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=ideasonboard.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=ideasonboard.com header.i=@ideasonboard.com header.b="RhcRTdRp" Received: from ideasonboard.com (unknown [IPv6:2a00:6020:448c:6c00:404d:d4e8:ffdc:3995]) by perceval.ideasonboard.com (Postfix) with UTF8SMTPSA id 144F7105C; Wed, 4 Mar 2026 16:49:33 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ideasonboard.com; s=mail; t=1772639373; bh=/lNmnBJL/ScfCOaTNA8yDImhHy8UeD5PEVD6242bhzM=; h=From:Date:Subject:References:In-Reply-To:To:Cc:From; b=RhcRTdRpHL38hu9ZWFQe1953rsqbtXnMqcXwqc4kB1xs/lyy2uCTgVYCkc2QusISu CJhw21ZVzHd5gpESxQoFc4aLcvzW+SiXOKGFoPBb1xThf5XEaueHtyNuoX5XyITnCR msGn9NM3tLRSex3IFXf8jFTlH7zdSyIK7WmNDhGk= From: Stefan Klug Date: Wed, 04 Mar 2026 16:50:24 +0100 Subject: [PATCH v5 3/4] media: dw100: Fix kernel oops with PREEMPT_RT enabled Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <20260304-sklug-v6-16-topic-dw100-v3-1-dev-v5-3-1a7e1f721b50@ideasonboard.com> References: <20260304-sklug-v6-16-topic-dw100-v3-1-dev-v5-0-1a7e1f721b50@ideasonboard.com> In-Reply-To: <20260304-sklug-v6-16-topic-dw100-v3-1-dev-v5-0-1a7e1f721b50@ideasonboard.com> To: Xavier Roumegue , Mauro Carvalho Chehab , Sebastian Andrzej Siewior , Clark Williams , Steven Rostedt , Laurent Pinchart Cc: linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-rt-devel@lists.linux.dev, Nicolas Dufresne , Stefan Klug X-Mailer: b4 0.14.2 On kernels with PREEMPT_RT enabled, a "BUG: scheduling while atomic" kernel oops occurs inside dw100_irq_handler -> vb2_buffer_done. This is because vb2_buffer_done takes a spinlock which is not allowed within interrupt context on PREEMPT_RT. The first attempt to fix this was to just drop the IRQF_ONESHOT so that the interrupt is handled threaded on PREEMPT_RT systems. This introduced a new issue. The dw100 has an internal timeout counter that is gated by the DW100_BUS_CTRL_AXI_MASTER_ENABLE bit. Depending on the time it takes for the threaded handler to run and the geometry of the data being processed it is possible to reach the timeout resulting in DW100_INTERRUPT_STATUS_INT_ERR_TIME_OUT being set and "dw100 32e30000.dwe: Interrupt error: 0x1" errors in dmesg. To properly fix that, split the interrupt into two halves, reset the DW100_BUS_CTRL_AXI_MASTER_ENABLE bit in the hard interrupt handler and do the v4l2 buffer handling in the threaded half. The IRQF_ONESHOT can still be dropped as the interrupt gets disabled in the hard handler and will only be reenabled on the next dw100_device_run which will not be called before the current job has finished. Signed-off-by: Stefan Klug Reviewed-by: Xavier Roumegue Reviewed-by: Laurent Pinchart --- Thank you Xavier for the technical support and further details on the interrupt bit. Changes in v4: - Collected tags - Fixed include order Changes in v3: - Split interrupt in two halves to prevent timeout error - Dropped rby tags, as the patch changed substantially Changes in v2: - Dropped the IRQF_ONESHOT instead of making the interrupt handler threaded to fix the issue. - I didn't keep the r-by tag from Nicolas as the solution is now a different one. --- drivers/media/platform/nxp/dw100/dw100.c | 21 ++++++++++++++++----- 1 file changed, 16 insertions(+), 5 deletions(-) diff --git a/drivers/media/platform/nxp/dw100/dw100.c b/drivers/media/platf= orm/nxp/dw100/dw100.c index 69d469944536f62af22d6fc532afdcf669afe4be..43c218fa31b47402120de3e7495= 9d2d38a6c3453 100644 --- a/drivers/media/platform/nxp/dw100/dw100.c +++ b/drivers/media/platform/nxp/dw100/dw100.c @@ -11,6 +11,7 @@ #include #include #include +#include #include #include #include @@ -74,6 +75,7 @@ struct dw100_device { struct clk_bulk_data *clks; int num_clks; struct dentry *debugfs_root; + bool frame_failed; }; =20 struct dw100_q_data { @@ -1404,7 +1406,8 @@ static irqreturn_t dw100_irq_handler(int irq, void *d= ev_id) { struct dw100_device *dw_dev =3D dev_id; u32 pending_irqs, err_irqs, frame_done_irq; - bool with_error =3D true; + + dw_dev->frame_failed =3D true; =20 pending_irqs =3D dw_hw_get_pending_irqs(dw_dev); frame_done_irq =3D pending_irqs & DW100_INTERRUPT_STATUS_INT_FRAME_DONE; @@ -1412,7 +1415,7 @@ static irqreturn_t dw100_irq_handler(int irq, void *d= ev_id) =20 if (frame_done_irq) { dev_dbg(&dw_dev->pdev->dev, "Frame done interrupt\n"); - with_error =3D false; + dw_dev->frame_failed =3D false; err_irqs &=3D ~DW100_INTERRUPT_STATUS_INT_ERR_STATUS (DW100_INTERRUPT_STATUS_INT_ERR_FRAME_DONE); } @@ -1425,7 +1428,14 @@ static irqreturn_t dw100_irq_handler(int irq, void *= dev_id) dw100_hw_clear_irq(dw_dev, pending_irqs | DW100_INTERRUPT_STATUS_INT_ERR_TIME_OUT); =20 - dw100_job_finish(dw_dev, with_error); + return IRQ_WAKE_THREAD; +} + +static irqreturn_t dw100_irq_thread_fn(int irq, void *dev_id) +{ + struct dw100_device *dw_dev =3D dev_id; + + dw100_job_finish(dw_dev, dw_dev->frame_failed); =20 return IRQ_HANDLED; } @@ -1594,8 +1604,9 @@ static int dw100_probe(struct platform_device *pdev) =20 pm_runtime_put_sync(&pdev->dev); =20 - ret =3D devm_request_irq(&pdev->dev, irq, dw100_irq_handler, IRQF_ONESHOT, - dev_name(&pdev->dev), dw_dev); + ret =3D devm_request_threaded_irq(&pdev->dev, irq, dw100_irq_handler, + dw100_irq_thread_fn, 0, + dev_name(&pdev->dev), dw_dev); if (ret < 0) { dev_err(&pdev->dev, "Failed to request irq: %d\n", ret); goto err_pm; --=20 2.51.0 From nobody Thu Apr 2 20:27:01 2026 Received: from perceval.ideasonboard.com (perceval.ideasonboard.com [213.167.242.64]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id B1B5735C1AF; Wed, 4 Mar 2026 15:50:41 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=213.167.242.64 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1772639443; cv=none; b=ayRpGO7Gl6Sraa9x4QJ0UVCPjwVk+pvcwY1tV+yrsFwh/thzkwl8Xr+1B026WV1vWeVRL1AZHnDmikXDbV6eueiOOxl+FwHdi5hoBkJe9v6jjZHaO/+hz0OrMQcH0HmY3tW7ficMbmDhTTyrBgGe7EHi8ZiVxQUQMwqpidl2ki0= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1772639443; c=relaxed/simple; bh=CligL5eiODQ5qooKmwR0FQSVQf6DUMvzCV/mukAsyyQ=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=EW4xEdB84Br5z+6CJ/G2iPaHdhPTVYP9f6QFIcxXUNxoBWYzWoC6uo8qcr1w6LAO3hGjciodgygixZ6DPFiFmcRb7XJ9GH7zu00X8PucAIPmfJWtfv0Vci8zi/5aZ0r/1oJXMsBwIBufZNRhXQvi2Vw1mIQx5ZXh87dxblMWEzw= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=ideasonboard.com; spf=pass smtp.mailfrom=ideasonboard.com; dkim=pass (1024-bit key) header.d=ideasonboard.com header.i=@ideasonboard.com header.b=FqK9vSxb; arc=none smtp.client-ip=213.167.242.64 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=ideasonboard.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=ideasonboard.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=ideasonboard.com header.i=@ideasonboard.com header.b="FqK9vSxb" Received: from ideasonboard.com (unknown [IPv6:2a00:6020:448c:6c00:404d:d4e8:ffdc:3995]) by perceval.ideasonboard.com (Postfix) with UTF8SMTPSA id CD65310B6; Wed, 4 Mar 2026 16:49:35 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ideasonboard.com; s=mail; t=1772639375; bh=CligL5eiODQ5qooKmwR0FQSVQf6DUMvzCV/mukAsyyQ=; h=From:Date:Subject:References:In-Reply-To:To:Cc:From; b=FqK9vSxbgMv7HBa1uPO096Lw/Ffy4BTlbjAXXzIPvvID564tA5Ka13YQ4MI0xRuBV ssgHF7y7r7gAmSjTtHu3Dn5dvt6794oM/AK8675vxdki3BYgZlZZoRx0GnnIVTqLR/ 8Pi06EAB3PrYsXHOe+zHt9BxMRHINIcsi1oEGpaQ= From: Stefan Klug Date: Wed, 04 Mar 2026 16:50:25 +0100 Subject: [PATCH v5 4/4] media: dw100: Merge dw100_device_run and dw100_start Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Message-Id: <20260304-sklug-v6-16-topic-dw100-v3-1-dev-v5-4-1a7e1f721b50@ideasonboard.com> References: <20260304-sklug-v6-16-topic-dw100-v3-1-dev-v5-0-1a7e1f721b50@ideasonboard.com> In-Reply-To: <20260304-sklug-v6-16-topic-dw100-v3-1-dev-v5-0-1a7e1f721b50@ideasonboard.com> To: Xavier Roumegue , Mauro Carvalho Chehab , Sebastian Andrzej Siewior , Clark Williams , Steven Rostedt , Laurent Pinchart Cc: linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-rt-devel@lists.linux.dev, Nicolas Dufresne , Stefan Klug X-Mailer: b4 0.14.2 The dw100_start() function is only called from dw100_device_run(). As both functions are not too big, move the code directly into dw100_device_run() and drop dw100_start() to improve readability. This patch contains no functional changes. Signed-off-by: Stefan Klug Reviewed-by: Xavier Roumegue Reviewed-by: Laurent Pinchart --- Changes in v4: - Collected tags Changes in v3: - Added this patch as proposed in the review of v1 --- drivers/media/platform/nxp/dw100/dw100.c | 77 +++++++++++++++-------------= ---- 1 file changed, 35 insertions(+), 42 deletions(-) diff --git a/drivers/media/platform/nxp/dw100/dw100.c b/drivers/media/platf= orm/nxp/dw100/dw100.c index 43c218fa31b47402120de3e74959d2d38a6c3453..06fa8d758083b47074b22b8edb4= 2af63cd9127ae 100644 --- a/drivers/media/platform/nxp/dw100/dw100.c +++ b/drivers/media/platform/nxp/dw100/dw100.c @@ -1440,49 +1440,10 @@ static irqreturn_t dw100_irq_thread_fn(int irq, voi= d *dev_id) return IRQ_HANDLED; } =20 -static void dw100_start(struct dw100_ctx *ctx, struct vb2_v4l2_buffer *in_= vb, - struct vb2_v4l2_buffer *out_vb) -{ - struct dw100_device *dw_dev =3D ctx->dw_dev; - - out_vb->sequence =3D - dw100_get_q_data(ctx, V4L2_BUF_TYPE_VIDEO_CAPTURE_MPLANE)->sequence++; - in_vb->sequence =3D - dw100_get_q_data(ctx, V4L2_BUF_TYPE_VIDEO_OUTPUT_MPLANE)->sequence++; - - dev_dbg(&ctx->dw_dev->pdev->dev, - "Starting queues %p->%p, sequence %u->%u\n", - v4l2_m2m_get_vq(ctx->fh.m2m_ctx, - V4L2_BUF_TYPE_VIDEO_OUTPUT_MPLANE), - v4l2_m2m_get_vq(ctx->fh.m2m_ctx, - V4L2_BUF_TYPE_VIDEO_CAPTURE_MPLANE), - in_vb->sequence, out_vb->sequence); - - v4l2_m2m_buf_copy_metadata(in_vb, out_vb); - - /* Now, let's deal with hardware ... */ - dw100_hw_master_bus_disable(dw_dev); - dw100_hw_init_ctrl(dw_dev); - dw100_hw_set_pixel_boundary(dw_dev); - dw100_hw_set_src_crop(dw_dev, &ctx->q_data[DW100_QUEUE_SRC], - &ctx->q_data[DW100_QUEUE_DST]); - dw100_hw_set_source(dw_dev, &ctx->q_data[DW100_QUEUE_SRC], - &in_vb->vb2_buf); - dw100_hw_set_destination(dw_dev, &ctx->q_data[DW100_QUEUE_DST], - ctx->q_data[DW100_QUEUE_SRC].fmt, - &out_vb->vb2_buf); - dw100_hw_set_mapping(dw_dev, ctx->map_dma, - ctx->map_width, ctx->map_height); - dw100_hw_enable_irq(dw_dev); - dw100_hw_dewarp_start(dw_dev); - - /* Enable Bus */ - dw100_hw_master_bus_enable(dw_dev); -} - static void dw100_device_run(void *priv) { struct dw100_ctx *ctx =3D priv; + struct dw100_device *dw_dev =3D ctx->dw_dev; struct vb2_v4l2_buffer *src_buf, *dst_buf; =20 src_buf =3D v4l2_m2m_next_src_buf(ctx->fh.m2m_ctx); @@ -1494,7 +1455,7 @@ static void dw100_device_run(void *priv) if (src_buf->vb2_buf.req_obj.req) dw100_update_mapping(ctx); else if (ctx->user_map_is_dirty) - dev_warn_once(&ctx->dw_dev->pdev->dev, + dev_warn_once(&dw_dev->pdev->dev, "V4L2 requests are required to update the vertex map dynamically\= n"); =20 /* @@ -1504,7 +1465,39 @@ static void dw100_device_run(void *priv) v4l2_ctrl_request_complete(src_buf->vb2_buf.req_obj.req, &ctx->hdl); =20 - dw100_start(ctx, src_buf, dst_buf); + src_buf->sequence =3D + dw100_get_q_data(ctx, V4L2_BUF_TYPE_VIDEO_OUTPUT_MPLANE)->sequence++; + dst_buf->sequence =3D + dw100_get_q_data(ctx, V4L2_BUF_TYPE_VIDEO_CAPTURE_MPLANE)->sequence++; + + dev_dbg(&dw_dev->pdev->dev, + "Starting queues %p->%p, sequence %u->%u\n", + v4l2_m2m_get_vq(ctx->fh.m2m_ctx, + V4L2_BUF_TYPE_VIDEO_OUTPUT_MPLANE), + v4l2_m2m_get_vq(ctx->fh.m2m_ctx, + V4L2_BUF_TYPE_VIDEO_CAPTURE_MPLANE), + src_buf->sequence, dst_buf->sequence); + + v4l2_m2m_buf_copy_metadata(src_buf, dst_buf); + + /* Now, let's deal with hardware ... */ + dw100_hw_master_bus_disable(dw_dev); + dw100_hw_init_ctrl(dw_dev); + dw100_hw_set_pixel_boundary(dw_dev); + dw100_hw_set_src_crop(dw_dev, &ctx->q_data[DW100_QUEUE_SRC], + &ctx->q_data[DW100_QUEUE_DST]); + dw100_hw_set_source(dw_dev, &ctx->q_data[DW100_QUEUE_SRC], + &src_buf->vb2_buf); + dw100_hw_set_destination(dw_dev, &ctx->q_data[DW100_QUEUE_DST], + ctx->q_data[DW100_QUEUE_SRC].fmt, + &dst_buf->vb2_buf); + dw100_hw_set_mapping(dw_dev, ctx->map_dma, + ctx->map_width, ctx->map_height); + dw100_hw_enable_irq(dw_dev); + dw100_hw_dewarp_start(dw_dev); + + /* Enable Bus */ + dw100_hw_master_bus_enable(dw_dev); } =20 static const struct v4l2_m2m_ops dw100_m2m_ops =3D { --=20 2.51.0