From nobody Fri May 10 08:40:48 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=pass(p=none dis=none) header.from=redhat.com ARC-Seal: i=1; a=rsa-sha256; t=1710415046; cv=none; d=zohomail.com; s=zohoarc; b=Doo50HKdlT33pFdYcCYKMBoGqBwwNaP1JZDE7rKPk+XFqVx0Cq3ruSmBtJ4wRIwXHO6LsdypNkobwl/LKSlPKj9sYwlSWFJRQ7FWce1YGqPqooZWfKlvC16O14s/NLqUDi0cG1TYsK5Clh/Qj+F9AotOxA8KC80IomQoTzLRjgg= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1710415046; h=Content-Transfer-Encoding:Cc:Cc:Date:Date:From:From:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:Sender:Subject:Subject:To:To:Message-Id:Reply-To; bh=cdX6ov4AtD+Ch6QCrlz5w4MVVmmUapIHlamKpnx3uuk=; b=KI75FEhe9CUoee5vBsz44OT3qYLp82lYtz7kVG0XfZYBRrB1bZM6zkdvpPbt2HNMIRPjrOjWmQKXkmP1GRwEapH7AA+Qm1f4GXftNU8V/tRYm5vJ7YAxYVYB79Ms6FJYNcNVkpF3q8ItSKu87bQIBBWOA18YWnspGIb/VmdGeHY= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=pass header.from= (p=none dis=none) Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1710415046823696.2554718972136; Thu, 14 Mar 2024 04:17:26 -0700 (PDT) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rkj4p-0004Vc-Vt; Thu, 14 Mar 2024 07:16:48 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rkj4k-0004Uv-Vm for qemu-devel@nongnu.org; Thu, 14 Mar 2024 07:16:43 -0400 Received: from us-smtp-delivery-124.mimecast.com ([170.10.129.124]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rkj4h-0003KU-L7 for qemu-devel@nongnu.org; Thu, 14 Mar 2024 07:16:42 -0400 Received: from mimecast-mx02.redhat.com (mimecast-mx02.redhat.com [66.187.233.88]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-301-rIqjPqmOOR6NkcT4-KWkqQ-1; Thu, 14 Mar 2024 07:16:36 -0400 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.rdu2.redhat.com [10.11.54.3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id 6F392800264; Thu, 14 Mar 2024 11:16:36 +0000 (UTC) Received: from kaapi.redhat.com (unknown [10.67.24.5]) by smtp.corp.redhat.com (Postfix) with ESMTPS id C5AEE111E3F3; Thu, 14 Mar 2024 11:16:33 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1710414998; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=cdX6ov4AtD+Ch6QCrlz5w4MVVmmUapIHlamKpnx3uuk=; b=clPcUmtxUWPwrtRxBwh2Oh/uUlBpskYUk0eR3OgnYcipSfy95eOkK2c5LG8N3eaJZ5Ne1V ucGAOunQUxZWkH3D8X8/zYbfnAqcs5spk7A5PSDBTrhpJmIn68cSsv34hcRPP1VEt0L2Ur jNhYkmi13TnqvwEpZdAb89ROsQLluXM= X-MC-Unique: rIqjPqmOOR6NkcT4-KWkqQ-1 From: Prasad Pandit To: stefanha@redhat.com Cc: qemu-block@nongnu.org, qemu-devel@nongnu.org, kwolf@redhat.com, mtosatti@redhat.com, Prasad Pandit Subject: [PATCH v4] linux-aio: add IO_CMD_FDSYNC command support Date: Thu, 14 Mar 2024 16:46:28 +0530 Message-ID: <20240314111628.1508636-1-ppandit@redhat.com> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-Scanned-By: MIMEDefang 3.4.1 on 10.11.54.3 Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=170.10.129.124; envelope-from=ppandit@redhat.com; helo=us-smtp-delivery-124.mimecast.com X-Spam_score_int: -30 X-Spam_score: -3.1 X-Spam_bar: --- X-Spam_report: (-3.1 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.987, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: qemu-devel-bounces+importer=patchew.org@nongnu.org X-ZohoMail-DKIM: pass (identity @redhat.com) X-ZM-MESSAGEID: 1710415047424100001 Content-Type: text/plain; charset="utf-8" From: Prasad Pandit Libaio defines IO_CMD_FDSYNC command to sync all outstanding asynchronous I/O operations, by flushing out file data to the disk storage. Enable linux-aio to submit such aio request. This helps to reduce latency induced via pthread_create calls by thread-pool (aio=3Dthreads). Signed-off-by: Prasad Pandit Reviewed-by: Stefan Hajnoczi --- block/file-posix.c | 7 +++++++ block/linux-aio.c | 21 ++++++++++++++++++++- include/block/raw-aio.h | 1 + 3 files changed, 28 insertions(+), 1 deletion(-) v4: New boolean field to indicate if aio_fdsync is available or not. It is set at file open time and checked before AIO_FLUSH call. - https://lists.nongnu.org/archive/html/qemu-devel/2024-03/msg03701.html diff --git a/block/file-posix.c b/block/file-posix.c index 35684f7e21..78a8cea03b 100644 --- a/block/file-posix.c +++ b/block/file-posix.c @@ -159,6 +159,7 @@ typedef struct BDRVRawState { bool has_discard:1; bool has_write_zeroes:1; bool use_linux_aio:1; + bool has_laio_fdsync:1; bool use_linux_io_uring:1; int page_cache_inconsistent; /* errno from fdatasync failure */ bool has_fallocate; @@ -718,6 +719,7 @@ static int raw_open_common(BlockDriverState *bs, QDict = *options, ret =3D -EINVAL; goto fail; } + s->has_laio_fdsync =3D laio_has_fdsync(s->fd); #else if (s->use_linux_aio) { error_setg(errp, "aio=3Dnative was specified, but is not supported= " @@ -2599,6 +2601,11 @@ static int coroutine_fn raw_co_flush_to_disk(BlockDr= iverState *bs) if (raw_check_linux_io_uring(s)) { return luring_co_submit(bs, s->fd, 0, NULL, QEMU_AIO_FLUSH); } +#endif +#ifdef CONFIG_LINUX_AIO + if (s->has_laio_fdsync && raw_check_linux_aio(s)) { + return laio_co_submit(s->fd, 0, NULL, QEMU_AIO_FLUSH, 0); + } #endif return raw_thread_pool_submit(handle_aiocb_flush, &acb); } diff --git a/block/linux-aio.c b/block/linux-aio.c index ec05d946f3..e3b5ec9aba 100644 --- a/block/linux-aio.c +++ b/block/linux-aio.c @@ -384,6 +384,9 @@ static int laio_do_submit(int fd, struct qemu_laiocb *l= aiocb, off_t offset, case QEMU_AIO_READ: io_prep_preadv(iocbs, fd, qiov->iov, qiov->niov, offset); break; + case QEMU_AIO_FLUSH: + io_prep_fdsync(iocbs, fd); + break; /* Currently Linux kernel does not support other operations */ default: fprintf(stderr, "%s: invalid AIO request type 0x%x.\n", @@ -412,7 +415,7 @@ int coroutine_fn laio_co_submit(int fd, uint64_t offset= , QEMUIOVector *qiov, AioContext *ctx =3D qemu_get_current_aio_context(); struct qemu_laiocb laiocb =3D { .co =3D qemu_coroutine_self(), - .nbytes =3D qiov->size, + .nbytes =3D qiov ? qiov->size : 0, .ctx =3D aio_get_linux_aio(ctx), .ret =3D -EINPROGRESS, .is_read =3D (type =3D=3D QEMU_AIO_READ), @@ -486,3 +489,19 @@ void laio_cleanup(LinuxAioState *s) } g_free(s); } + +bool laio_has_fdsync(int fd) +{ + struct iocb cb; + struct iocb *cbs[] =3D {&cb, NULL}; + + io_context_t ctx =3D 0; + io_setup(1, &ctx); + + /* check if host kernel supports IO_CMD_FDSYNC */ + io_prep_fdsync(&cb, fd); + int ret =3D io_submit(ctx, 1, cbs); + + io_destroy(ctx); + return (ret =3D=3D -EINVAL) ? false : true; +} diff --git a/include/block/raw-aio.h b/include/block/raw-aio.h index 20e000b8ef..626706827f 100644 --- a/include/block/raw-aio.h +++ b/include/block/raw-aio.h @@ -60,6 +60,7 @@ void laio_cleanup(LinuxAioState *s); int coroutine_fn laio_co_submit(int fd, uint64_t offset, QEMUIOVector *qio= v, int type, uint64_t dev_max_batch); =20 +bool laio_has_fdsync(int); void laio_detach_aio_context(LinuxAioState *s, AioContext *old_context); void laio_attach_aio_context(LinuxAioState *s, AioContext *new_context); #endif --=20 2.44.0