From nobody Mon Sep 15 18:12:01 2025 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id E3749C5479D for ; Wed, 11 Jan 2023 14:34:24 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S235719AbjAKOeX (ORCPT ); Wed, 11 Jan 2023 09:34:23 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:42982 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S234250AbjAKOck (ORCPT ); Wed, 11 Jan 2023 09:32:40 -0500 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id BD0AC1EECB for ; Wed, 11 Jan 2023 06:29:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1673447377; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7PY4ZE2tbRrQxMSR7RM4sgbFeGnPlGzJVBbitl3/Ejg=; b=JzbIr9KgtnUf9U2FmLV/Tj1NhSeaYio1ro75k/HtYXoKBQbZgmPrOEUzNLBtbM4HscFiU5 W61+W/D32X1PB4wYz7j30jh2CMlnAi1i1Uw1SYSxrKbpgZIjbMNzJc9LfAUhwx/K+y1XLN BkpBVi3QbHeF10z5pi0ylJQPPsL69mo= Received: from mimecast-mx02.redhat.com (mx3-rdu2.redhat.com [66.187.233.73]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-34-UShiB-QHM4SBsEeHLayTqQ-1; Wed, 11 Jan 2023 09:28:53 -0500 X-MC-Unique: UShiB-QHM4SBsEeHLayTqQ-1 Received: from smtp.corp.redhat.com (int-mx01.intmail.prod.int.rdu2.redhat.com [10.11.54.1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id 27C5E3C025BD; Wed, 11 Jan 2023 14:28:00 +0000 (UTC) Received: from warthog.procyon.org.uk (unknown [10.33.36.87]) by smtp.corp.redhat.com (Postfix) with ESMTP id B647240C2064; Wed, 11 Jan 2023 14:27:58 +0000 (UTC) Organization: Red Hat UK Ltd. Registered Address: Red Hat UK Ltd, Amberley Place, 107-111 Peascod Street, Windsor, Berkshire, SI4 1TE, United Kingdom. Registered in England and Wales under Company Registration No. 3798903 Subject: [PATCH v5 3/9] iov_iter: Use IOCB/IOMAP_WRITE if available rather than iterator direction From: David Howells To: Al Viro Cc: dhowells@redhat.com, Christoph Hellwig , Matthew Wilcox , Jens Axboe , Jan Kara , Jeff Layton , Logan Gunthorpe , linux-fsdevel@vger.kernel.org, linux-block@vger.kernel.org, linux-kernel@vger.kernel.org Date: Wed, 11 Jan 2023 14:27:58 +0000 Message-ID: <167344727810.2425628.4715663653893036683.stgit@warthog.procyon.org.uk> In-Reply-To: <167344725490.2425628.13771289553670112965.stgit@warthog.procyon.org.uk> References: <167344725490.2425628.13771289553670112965.stgit@warthog.procyon.org.uk> User-Agent: StGit/1.5 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Scanned-By: MIMEDefang 3.1 on 10.11.54.1 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org If a kiocb or iomap_iter is available, then use the IOCB_WRITE flag or the IOMAP_WRITE flag to determine whether we're writing rather than the iterator direction flag. This allows all but three of the users of iov_iter_rw() to be got rid of: a consistency check and a warning statement in cifs and one user in the block layer that has neither available. Signed-off-by: David Howells cc: Al Viro Link: https://lore.kernel.org/r/167305163159.1521586.9460968250704377087.st= git@warthog.procyon.org.uk/ # v4 --- block/fops.c | 8 ++++---- fs/9p/vfs_addr.c | 2 +- fs/affs/file.c | 4 ++-- fs/ceph/file.c | 2 +- fs/dax.c | 6 +++--- fs/direct-io.c | 22 +++++++++++----------- fs/exfat/inode.c | 6 +++--- fs/ext2/inode.c | 2 +- fs/f2fs/file.c | 10 +++++----- fs/fat/inode.c | 4 ++-- fs/fuse/dax.c | 2 +- fs/fuse/file.c | 8 ++++---- fs/hfs/inode.c | 2 +- fs/hfsplus/inode.c | 2 +- fs/iomap/direct-io.c | 6 +++--- fs/jfs/inode.c | 2 +- fs/nfs/direct.c | 2 +- fs/nilfs2/inode.c | 2 +- fs/ntfs3/inode.c | 2 +- fs/ocfs2/aops.c | 2 +- fs/orangefs/inode.c | 2 +- fs/reiserfs/inode.c | 2 +- fs/udf/inode.c | 2 +- 23 files changed, 51 insertions(+), 51 deletions(-) diff --git a/block/fops.c b/block/fops.c index 50d245e8c913..29c6de67c39e 100644 --- a/block/fops.c +++ b/block/fops.c @@ -73,7 +73,7 @@ static ssize_t __blkdev_direct_IO_simple(struct kiocb *io= cb, return -ENOMEM; } =20 - if (iov_iter_rw(iter) =3D=3D READ) { + if (!(iocb->ki_flags & IOCB_WRITE)) { bio_init(&bio, bdev, vecs, nr_pages, REQ_OP_READ); if (user_backed_iter(iter)) should_dirty =3D true; @@ -88,7 +88,7 @@ static ssize_t __blkdev_direct_IO_simple(struct kiocb *io= cb, goto out; ret =3D bio.bi_iter.bi_size; =20 - if (iov_iter_rw(iter) =3D=3D WRITE) + if (iocb->ki_flags & IOCB_WRITE) task_io_account_write(ret); =20 if (iocb->ki_flags & IOCB_NOWAIT) @@ -174,7 +174,7 @@ static ssize_t __blkdev_direct_IO(struct kiocb *iocb, s= truct iov_iter *iter, struct blk_plug plug; struct blkdev_dio *dio; struct bio *bio; - bool is_read =3D (iov_iter_rw(iter) =3D=3D READ), is_sync; + bool is_read =3D !(iocb->ki_flags & IOCB_WRITE), is_sync; blk_opf_t opf =3D is_read ? REQ_OP_READ : dio_bio_write_op(iocb); loff_t pos =3D iocb->ki_pos; int ret =3D 0; @@ -296,7 +296,7 @@ static ssize_t __blkdev_direct_IO_async(struct kiocb *i= ocb, unsigned int nr_pages) { struct block_device *bdev =3D iocb->ki_filp->private_data; - bool is_read =3D iov_iter_rw(iter) =3D=3D READ; + bool is_read =3D !(iocb->ki_flags & IOCB_WRITE); blk_opf_t opf =3D is_read ? REQ_OP_READ : dio_bio_write_op(iocb); struct blkdev_dio *dio; struct bio *bio; diff --git a/fs/9p/vfs_addr.c b/fs/9p/vfs_addr.c index 97599edbc300..383d62fc3e18 100644 --- a/fs/9p/vfs_addr.c +++ b/fs/9p/vfs_addr.c @@ -254,7 +254,7 @@ v9fs_direct_IO(struct kiocb *iocb, struct iov_iter *ite= r) ssize_t n; int err =3D 0; =20 - if (iov_iter_rw(iter) =3D=3D WRITE) { + if (iocb->ki_flags & IOCB_WRITE) { n =3D p9_client_write(file->private_data, pos, iter, &err); if (n) { struct inode *inode =3D file_inode(file); diff --git a/fs/affs/file.c b/fs/affs/file.c index cefa222f7881..1c0e80a8aab9 100644 --- a/fs/affs/file.c +++ b/fs/affs/file.c @@ -400,7 +400,7 @@ affs_direct_IO(struct kiocb *iocb, struct iov_iter *ite= r) loff_t offset =3D iocb->ki_pos; ssize_t ret; =20 - if (iov_iter_rw(iter) =3D=3D WRITE) { + if (iocb->ki_flags & IOCB_WRITE) { loff_t size =3D offset + count; =20 if (AFFS_I(inode)->mmu_private < size) @@ -408,7 +408,7 @@ affs_direct_IO(struct kiocb *iocb, struct iov_iter *ite= r) } =20 ret =3D blockdev_direct_IO(iocb, inode, iter, affs_get_block); - if (ret < 0 && iov_iter_rw(iter) =3D=3D WRITE) + if (ret < 0 && (iocb->ki_flags & IOCB_WRITE)) affs_write_failed(mapping, offset + count); return ret; } diff --git a/fs/ceph/file.c b/fs/ceph/file.c index 764598e1efd9..8bdc5b52c271 100644 --- a/fs/ceph/file.c +++ b/fs/ceph/file.c @@ -1284,7 +1284,7 @@ ceph_direct_read_write(struct kiocb *iocb, struct iov= _iter *iter, struct timespec64 mtime =3D current_time(inode); size_t count =3D iov_iter_count(iter); loff_t pos =3D iocb->ki_pos; - bool write =3D iov_iter_rw(iter) =3D=3D WRITE; + bool write =3D iocb->ki_flags & IOCB_WRITE; bool should_dirty =3D !write && user_backed_iter(iter); =20 if (write && ceph_snap(file_inode(file)) !=3D CEPH_NOSNAP) diff --git a/fs/dax.c b/fs/dax.c index c48a3a93ab29..7f4c3789907b 100644 --- a/fs/dax.c +++ b/fs/dax.c @@ -1405,7 +1405,7 @@ static loff_t dax_iomap_iter(const struct iomap_iter = *iomi, loff_t pos =3D iomi->pos; struct dax_device *dax_dev =3D iomap->dax_dev; loff_t end =3D pos + length, done =3D 0; - bool write =3D iov_iter_rw(iter) =3D=3D WRITE; + bool write =3D iomi->flags & IOMAP_WRITE; bool cow =3D write && iomap->flags & IOMAP_F_SHARED; ssize_t ret =3D 0; size_t xfer; @@ -1455,7 +1455,7 @@ static loff_t dax_iomap_iter(const struct iomap_iter = *iomi, =20 map_len =3D dax_direct_access(dax_dev, pgoff, PHYS_PFN(size), DAX_ACCESS, &kaddr, NULL); - if (map_len =3D=3D -EIO && iov_iter_rw(iter) =3D=3D WRITE) { + if (map_len =3D=3D -EIO && write) { map_len =3D dax_direct_access(dax_dev, pgoff, PHYS_PFN(size), DAX_RECOVERY_WRITE, &kaddr, NULL); @@ -1530,7 +1530,7 @@ dax_iomap_rw(struct kiocb *iocb, struct iov_iter *ite= r, if (!iomi.len) return 0; =20 - if (iov_iter_rw(iter) =3D=3D WRITE) { + if (iocb->ki_flags & IOCB_WRITE) { lockdep_assert_held_write(&iomi.inode->i_rwsem); iomi.flags |=3D IOMAP_WRITE; } else { diff --git a/fs/direct-io.c b/fs/direct-io.c index 03d381377ae1..e2d5c757a27a 100644 --- a/fs/direct-io.c +++ b/fs/direct-io.c @@ -1143,7 +1143,7 @@ ssize_t __blockdev_direct_IO(struct kiocb *iocb, stru= ct inode *inode, */ =20 /* watch out for a 0 len io from a tricksy fs */ - if (iov_iter_rw(iter) =3D=3D READ && !count) + if (!(iocb->ki_flags & IOCB_WRITE) && !count) return 0; =20 dio =3D kmem_cache_alloc(dio_cache, GFP_KERNEL); @@ -1157,14 +1157,14 @@ ssize_t __blockdev_direct_IO(struct kiocb *iocb, st= ruct inode *inode, memset(dio, 0, offsetof(struct dio, pages)); =20 dio->flags =3D flags; - if (dio->flags & DIO_LOCKING && iov_iter_rw(iter) =3D=3D READ) { + if (dio->flags & DIO_LOCKING && !(iocb->ki_flags & IOCB_WRITE)) { /* will be released by direct_io_worker */ inode_lock(inode); } =20 /* Once we sampled i_size check for reads beyond EOF */ dio->i_size =3D i_size_read(inode); - if (iov_iter_rw(iter) =3D=3D READ && offset >=3D dio->i_size) { + if (!(iocb->ki_flags & IOCB_WRITE) && offset >=3D dio->i_size) { retval =3D 0; goto fail_dio; } @@ -1177,7 +1177,7 @@ ssize_t __blockdev_direct_IO(struct kiocb *iocb, stru= ct inode *inode, goto fail_dio; } =20 - if (dio->flags & DIO_LOCKING && iov_iter_rw(iter) =3D=3D READ) { + if (dio->flags & DIO_LOCKING && !(iocb->ki_flags & IOCB_WRITE)) { struct address_space *mapping =3D iocb->ki_filp->f_mapping; =20 retval =3D filemap_write_and_wait_range(mapping, offset, end - 1); @@ -1193,13 +1193,13 @@ ssize_t __blockdev_direct_IO(struct kiocb *iocb, st= ruct inode *inode, */ if (is_sync_kiocb(iocb)) dio->is_async =3D false; - else if (iov_iter_rw(iter) =3D=3D WRITE && end > i_size_read(inode)) + else if ((iocb->ki_flags & IOCB_WRITE) && end > i_size_read(inode)) dio->is_async =3D false; else dio->is_async =3D true; =20 dio->inode =3D inode; - if (iov_iter_rw(iter) =3D=3D WRITE) { + if (iocb->ki_flags & IOCB_WRITE) { dio->opf =3D REQ_OP_WRITE | REQ_SYNC | REQ_IDLE; if (iocb->ki_flags & IOCB_NOWAIT) dio->opf |=3D REQ_NOWAIT; @@ -1211,7 +1211,7 @@ ssize_t __blockdev_direct_IO(struct kiocb *iocb, stru= ct inode *inode, * For AIO O_(D)SYNC writes we need to defer completions to a workqueue * so that we can call ->fsync. */ - if (dio->is_async && iov_iter_rw(iter) =3D=3D WRITE) { + if (dio->is_async && (iocb->ki_flags & IOCB_WRITE)) { retval =3D 0; if (iocb_is_dsync(iocb)) retval =3D dio_set_defer_completion(dio); @@ -1248,7 +1248,7 @@ ssize_t __blockdev_direct_IO(struct kiocb *iocb, stru= ct inode *inode, spin_lock_init(&dio->bio_lock); dio->refcount =3D 1; =20 - dio->should_dirty =3D user_backed_iter(iter) && iov_iter_rw(iter) =3D=3D = READ; + dio->should_dirty =3D user_backed_iter(iter) && !(iocb->ki_flags & IOCB_W= RITE); sdio.iter =3D iter; sdio.final_block_in_request =3D end >> blkbits; =20 @@ -1305,7 +1305,7 @@ ssize_t __blockdev_direct_IO(struct kiocb *iocb, stru= ct inode *inode, * we can let i_mutex go now that its achieved its purpose * of protecting us from looking up uninitialized blocks. */ - if (iov_iter_rw(iter) =3D=3D READ && (dio->flags & DIO_LOCKING)) + if (!(iocb->ki_flags & IOCB_WRITE) && (dio->flags & DIO_LOCKING)) inode_unlock(dio->inode); =20 /* @@ -1317,7 +1317,7 @@ ssize_t __blockdev_direct_IO(struct kiocb *iocb, stru= ct inode *inode, */ BUG_ON(retval =3D=3D -EIOCBQUEUED); if (dio->is_async && retval =3D=3D 0 && dio->result && - (iov_iter_rw(iter) =3D=3D READ || dio->result =3D=3D count)) + (!(iocb->ki_flags & IOCB_WRITE) || dio->result =3D=3D count)) retval =3D -EIOCBQUEUED; else dio_await_completion(dio); @@ -1330,7 +1330,7 @@ ssize_t __blockdev_direct_IO(struct kiocb *iocb, stru= ct inode *inode, return retval; =20 fail_dio: - if (dio->flags & DIO_LOCKING && iov_iter_rw(iter) =3D=3D READ) + if (dio->flags & DIO_LOCKING && !(iocb->ki_flags & IOCB_WRITE)) inode_unlock(inode); =20 kmem_cache_free(dio_cache, dio); diff --git a/fs/exfat/inode.c b/fs/exfat/inode.c index 5b644cb057fa..26c2cff71878 100644 --- a/fs/exfat/inode.c +++ b/fs/exfat/inode.c @@ -412,10 +412,10 @@ static ssize_t exfat_direct_IO(struct kiocb *iocb, st= ruct iov_iter *iter) struct address_space *mapping =3D iocb->ki_filp->f_mapping; struct inode *inode =3D mapping->host; loff_t size =3D iocb->ki_pos + iov_iter_count(iter); - int rw =3D iov_iter_rw(iter); + bool writing =3D iocb->ki_flags & IOCB_WRITE; ssize_t ret; =20 - if (rw =3D=3D WRITE) { + if (writing) { /* * FIXME: blockdev_direct_IO() doesn't use ->write_begin(), * so we need to update the ->i_size_aligned to block boundary. @@ -434,7 +434,7 @@ static ssize_t exfat_direct_IO(struct kiocb *iocb, stru= ct iov_iter *iter) * condition of exfat_get_block() and ->truncate(). */ ret =3D blockdev_direct_IO(iocb, inode, iter, exfat_get_block); - if (ret < 0 && (rw & WRITE)) + if (ret < 0 && writing) exfat_write_failed(mapping, size); return ret; } diff --git a/fs/ext2/inode.c b/fs/ext2/inode.c index 69aed9e2359e..9ed588d70722 100644 --- a/fs/ext2/inode.c +++ b/fs/ext2/inode.c @@ -919,7 +919,7 @@ ext2_direct_IO(struct kiocb *iocb, struct iov_iter *ite= r) ssize_t ret; =20 ret =3D blockdev_direct_IO(iocb, inode, iter, ext2_get_block); - if (ret < 0 && iov_iter_rw(iter) =3D=3D WRITE) + if (ret < 0 && (iocb->ki_flags & IOCB_WRITE)) ext2_write_failed(mapping, offset + count); return ret; } diff --git a/fs/f2fs/file.c b/fs/f2fs/file.c index ecbc8c135b49..7a7cfa39b327 100644 --- a/fs/f2fs/file.c +++ b/fs/f2fs/file.c @@ -809,7 +809,7 @@ int f2fs_truncate(struct inode *inode) return 0; } =20 -static bool f2fs_force_buffered_io(struct inode *inode, int rw) +static bool f2fs_force_buffered_io(struct inode *inode, bool writing) { struct f2fs_sb_info *sbi =3D F2FS_I_SB(inode); =20 @@ -827,9 +827,9 @@ static bool f2fs_force_buffered_io(struct inode *inode,= int rw) * for blkzoned device, fallback direct IO to buffered IO, so * all IOs can be serialized by log-structured write. */ - if (f2fs_sb_has_blkzoned(sbi) && (rw =3D=3D WRITE)) + if (f2fs_sb_has_blkzoned(sbi) && writing) return true; - if (f2fs_lfs_mode(sbi) && rw =3D=3D WRITE && F2FS_IO_ALIGNED(sbi)) + if (f2fs_lfs_mode(sbi) && writing && F2FS_IO_ALIGNED(sbi)) return true; if (is_sbi_flag_set(sbi, SBI_CP_DISABLED)) return true; @@ -865,7 +865,7 @@ int f2fs_getattr(struct user_namespace *mnt_userns, con= st struct path *path, unsigned int bsize =3D i_blocksize(inode); =20 stat->result_mask |=3D STATX_DIOALIGN; - if (!f2fs_force_buffered_io(inode, WRITE)) { + if (!f2fs_force_buffered_io(inode, true)) { stat->dio_mem_align =3D bsize; stat->dio_offset_align =3D bsize; } @@ -4254,7 +4254,7 @@ static bool f2fs_should_use_dio(struct inode *inode, = struct kiocb *iocb, if (!(iocb->ki_flags & IOCB_DIRECT)) return false; =20 - if (f2fs_force_buffered_io(inode, iov_iter_rw(iter))) + if (f2fs_force_buffered_io(inode, iocb->ki_flags & IOCB_WRITE)) return false; =20 /* diff --git a/fs/fat/inode.c b/fs/fat/inode.c index d99b8549ec8f..d7ffc30ce0e5 100644 --- a/fs/fat/inode.c +++ b/fs/fat/inode.c @@ -261,7 +261,7 @@ static ssize_t fat_direct_IO(struct kiocb *iocb, struct= iov_iter *iter) loff_t offset =3D iocb->ki_pos; ssize_t ret; =20 - if (iov_iter_rw(iter) =3D=3D WRITE) { + if (iocb->ki_flags & IOCB_WRITE) { /* * FIXME: blockdev_direct_IO() doesn't use ->write_begin(), * so we need to update the ->mmu_private to block boundary. @@ -281,7 +281,7 @@ static ssize_t fat_direct_IO(struct kiocb *iocb, struct= iov_iter *iter) * condition of fat_get_block() and ->truncate(). */ ret =3D blockdev_direct_IO(iocb, inode, iter, fat_get_block); - if (ret < 0 && iov_iter_rw(iter) =3D=3D WRITE) + if (ret < 0 && (iocb->ki_flags & IOCB_WRITE)) fat_write_failed(mapping, offset + count); =20 return ret; diff --git a/fs/fuse/dax.c b/fs/fuse/dax.c index e23e802a8013..fddd0b8de27e 100644 --- a/fs/fuse/dax.c +++ b/fs/fuse/dax.c @@ -720,7 +720,7 @@ static bool file_extending_write(struct kiocb *iocb, st= ruct iov_iter *from) { struct inode *inode =3D file_inode(iocb->ki_filp); =20 - return (iov_iter_rw(from) =3D=3D WRITE && + return ((iocb->ki_flags & IOCB_WRITE) && ((iocb->ki_pos) >=3D i_size_read(inode) || (iocb->ki_pos + iov_iter_count(from) > i_size_read(inode)))); } diff --git a/fs/fuse/file.c b/fs/fuse/file.c index 875314ee6f59..9575c4ca0667 100644 --- a/fs/fuse/file.c +++ b/fs/fuse/file.c @@ -2897,7 +2897,7 @@ fuse_direct_IO(struct kiocb *iocb, struct iov_iter *i= ter) inode =3D file->f_mapping->host; i_size =3D i_size_read(inode); =20 - if ((iov_iter_rw(iter) =3D=3D READ) && (offset >=3D i_size)) + if (!(iocb->ki_flags & IOCB_WRITE) && (offset >=3D i_size)) return 0; =20 io =3D kmalloc(sizeof(struct fuse_io_priv), GFP_KERNEL); @@ -2909,7 +2909,7 @@ fuse_direct_IO(struct kiocb *iocb, struct iov_iter *i= ter) io->bytes =3D -1; io->size =3D 0; io->offset =3D offset; - io->write =3D (iov_iter_rw(iter) =3D=3D WRITE); + io->write =3D (iocb->ki_flags & IOCB_WRITE); io->err =3D 0; /* * By default, we want to optimize all I/Os with async request @@ -2942,7 +2942,7 @@ fuse_direct_IO(struct kiocb *iocb, struct iov_iter *i= ter) io->done =3D &wait; } =20 - if (iov_iter_rw(iter) =3D=3D WRITE) { + if ((iocb->ki_flags & IOCB_WRITE)) { ret =3D fuse_direct_io(io, iter, &pos, FUSE_DIO_WRITE); fuse_invalidate_attr_mask(inode, FUSE_STATX_MODSIZE); } else { @@ -2965,7 +2965,7 @@ fuse_direct_IO(struct kiocb *iocb, struct iov_iter *i= ter) =20 kref_put(&io->refcnt, fuse_io_release); =20 - if (iov_iter_rw(iter) =3D=3D WRITE) { + if ((iocb->ki_flags & IOCB_WRITE)) { fuse_write_update_attr(inode, pos, ret); /* For extending writes we already hold exclusive lock */ if (ret < 0 && offset + count > i_size) diff --git a/fs/hfs/inode.c b/fs/hfs/inode.c index 9c329a365e75..638c87afd96f 100644 --- a/fs/hfs/inode.c +++ b/fs/hfs/inode.c @@ -141,7 +141,7 @@ static ssize_t hfs_direct_IO(struct kiocb *iocb, struct= iov_iter *iter) * In case of error extending write may have instantiated a few * blocks outside i_size. Trim these off again. */ - if (unlikely(iov_iter_rw(iter) =3D=3D WRITE && ret < 0)) { + if (unlikely((iocb->ki_flags & IOCB_WRITE) && ret < 0)) { loff_t isize =3D i_size_read(inode); loff_t end =3D iocb->ki_pos + count; =20 diff --git a/fs/hfsplus/inode.c b/fs/hfsplus/inode.c index 840577a0c1e7..843e6f1ced25 100644 --- a/fs/hfsplus/inode.c +++ b/fs/hfsplus/inode.c @@ -138,7 +138,7 @@ static ssize_t hfsplus_direct_IO(struct kiocb *iocb, st= ruct iov_iter *iter) * In case of error extending write may have instantiated a few * blocks outside i_size. Trim these off again. */ - if (unlikely(iov_iter_rw(iter) =3D=3D WRITE && ret < 0)) { + if (unlikely((iocb->ki_flags & IOCB_WRITE) && ret < 0)) { loff_t isize =3D i_size_read(inode); loff_t end =3D iocb->ki_pos + count; =20 diff --git a/fs/iomap/direct-io.c b/fs/iomap/direct-io.c index 9804714b1751..d045b0c54d04 100644 --- a/fs/iomap/direct-io.c +++ b/fs/iomap/direct-io.c @@ -519,7 +519,7 @@ __iomap_dio_rw(struct kiocb *iocb, struct iov_iter *ite= r, dio->submit.waiter =3D current; dio->submit.poll_bio =3D NULL; =20 - if (iov_iter_rw(iter) =3D=3D READ) { + if (!(iocb->ki_flags & IOCB_WRITE)) { if (iomi.pos >=3D dio->i_size) goto out_free_dio; =20 @@ -573,7 +573,7 @@ __iomap_dio_rw(struct kiocb *iocb, struct iov_iter *ite= r, if (ret) goto out_free_dio; =20 - if (iov_iter_rw(iter) =3D=3D WRITE) { + if (iomi.flags & IOMAP_WRITE) { /* * Try to invalidate cache pages for the range we are writing. * If this invalidation fails, let the caller fall back to @@ -613,7 +613,7 @@ __iomap_dio_rw(struct kiocb *iocb, struct iov_iter *ite= r, * Revert iter to a state corresponding to that as some callers (such * as the splice code) rely on it. */ - if (iov_iter_rw(iter) =3D=3D READ && iomi.pos >=3D dio->i_size) + if (!(iomi.flags & IOMAP_WRITE) && iomi.pos >=3D dio->i_size) iov_iter_revert(iter, iomi.pos - dio->i_size); =20 if (ret =3D=3D -EFAULT && dio->size && (dio_flags & IOMAP_DIO_PARTIAL)) { diff --git a/fs/jfs/inode.c b/fs/jfs/inode.c index 8ac10e396050..f403d2f2bfe6 100644 --- a/fs/jfs/inode.c +++ b/fs/jfs/inode.c @@ -334,7 +334,7 @@ static ssize_t jfs_direct_IO(struct kiocb *iocb, struct= iov_iter *iter) * In case of error extending write may have instantiated a few * blocks outside i_size. Trim these off again. */ - if (unlikely(iov_iter_rw(iter) =3D=3D WRITE && ret < 0)) { + if (unlikely((iocb->ki_flags & IOCB_WRITE) && ret < 0)) { loff_t isize =3D i_size_read(inode); loff_t end =3D iocb->ki_pos + count; =20 diff --git a/fs/nfs/direct.c b/fs/nfs/direct.c index 1707f46b1335..e94ce42f93a8 100644 --- a/fs/nfs/direct.c +++ b/fs/nfs/direct.c @@ -133,7 +133,7 @@ int nfs_swap_rw(struct kiocb *iocb, struct iov_iter *it= er) =20 VM_BUG_ON(iov_iter_count(iter) !=3D PAGE_SIZE); =20 - if (iov_iter_rw(iter) =3D=3D READ) + if (!(iocb->ki_flags & IOCB_WRITE)) ret =3D nfs_file_direct_read(iocb, iter, true); else ret =3D nfs_file_direct_write(iocb, iter, true); diff --git a/fs/nilfs2/inode.c b/fs/nilfs2/inode.c index 232dd7b6cca1..59df5707d30f 100644 --- a/fs/nilfs2/inode.c +++ b/fs/nilfs2/inode.c @@ -289,7 +289,7 @@ nilfs_direct_IO(struct kiocb *iocb, struct iov_iter *it= er) { struct inode *inode =3D file_inode(iocb->ki_filp); =20 - if (iov_iter_rw(iter) =3D=3D WRITE) + if (iocb->ki_flags & IOCB_WRITE) return 0; =20 /* Needs synchronization with the cleaner */ diff --git a/fs/ntfs3/inode.c b/fs/ntfs3/inode.c index 20b953871574..f0881d0522f8 100644 --- a/fs/ntfs3/inode.c +++ b/fs/ntfs3/inode.c @@ -761,7 +761,7 @@ static ssize_t ntfs_direct_IO(struct kiocb *iocb, struc= t iov_iter *iter) struct ntfs_inode *ni =3D ntfs_i(inode); loff_t vbo =3D iocb->ki_pos; loff_t end; - int wr =3D iov_iter_rw(iter) & WRITE; + bool wr =3D iocb->ki_flags & IOCB_WRITE; size_t iter_count =3D iov_iter_count(iter); loff_t valid; ssize_t ret; diff --git a/fs/ocfs2/aops.c b/fs/ocfs2/aops.c index 1d65f6ef00ca..3f41c6b403c2 100644 --- a/fs/ocfs2/aops.c +++ b/fs/ocfs2/aops.c @@ -2441,7 +2441,7 @@ static ssize_t ocfs2_direct_IO(struct kiocb *iocb, st= ruct iov_iter *iter) !ocfs2_supports_append_dio(osb)) return 0; =20 - if (iov_iter_rw(iter) =3D=3D READ) + if (!(iocb->ki_flags & IOCB_WRITE)) get_block =3D ocfs2_lock_get_block; else get_block =3D ocfs2_dio_wr_get_block; diff --git a/fs/orangefs/inode.c b/fs/orangefs/inode.c index 4df560894386..fbecca379e91 100644 --- a/fs/orangefs/inode.c +++ b/fs/orangefs/inode.c @@ -521,7 +521,7 @@ static ssize_t orangefs_direct_IO(struct kiocb *iocb, */ struct file *file =3D iocb->ki_filp; loff_t pos =3D iocb->ki_pos; - enum ORANGEFS_io_type type =3D iov_iter_rw(iter) =3D=3D WRITE ? + enum ORANGEFS_io_type type =3D (iocb->ki_flags & IOCB_WRITE) ? ORANGEFS_IO_WRITE : ORANGEFS_IO_READ; loff_t *offset =3D &pos; struct inode *inode =3D file->f_mapping->host; diff --git a/fs/reiserfs/inode.c b/fs/reiserfs/inode.c index c7d1fa526dea..1fc94fd5c371 100644 --- a/fs/reiserfs/inode.c +++ b/fs/reiserfs/inode.c @@ -3249,7 +3249,7 @@ static ssize_t reiserfs_direct_IO(struct kiocb *iocb,= struct iov_iter *iter) * In case of error extending write may have instantiated a few * blocks outside i_size. Trim these off again. */ - if (unlikely(iov_iter_rw(iter) =3D=3D WRITE && ret < 0)) { + if (unlikely((iocb->ki_flags & IOCB_WRITE) && ret < 0)) { loff_t isize =3D i_size_read(inode); loff_t end =3D iocb->ki_pos + count; =20 diff --git a/fs/udf/inode.c b/fs/udf/inode.c index 1d7c2a812fc1..6d2ce0e512f4 100644 --- a/fs/udf/inode.c +++ b/fs/udf/inode.c @@ -219,7 +219,7 @@ static ssize_t udf_direct_IO(struct kiocb *iocb, struct= iov_iter *iter) ssize_t ret; =20 ret =3D blockdev_direct_IO(iocb, inode, iter, udf_get_block); - if (unlikely(ret < 0 && iov_iter_rw(iter) =3D=3D WRITE)) + if (unlikely(ret < 0 && (iocb->ki_flags & IOCB_WRITE))) udf_write_failed(mapping, iocb->ki_pos + count); return ret; }