Jeff Moyer 273593f53e io_uring: ensure local task_work is run on wait timeout ...

JIRA: https://issues.redhat.com/browse/RHEL-21391

commit 6ff1407e24e6fdfa4a16ba9ba551e3d253a26391
Author: Jens Axboe <axboe@kernel.dk>
Date:   Thu Jan 4 12:21:08 2024 -0700

    io_uring: ensure local task_work is run on wait timeout
    
    A previous commit added an earlier break condition here, which is fine if
    we're using non-local task_work as it'll be run on return to userspace.
    However, if DEFER_TASKRUN is used, then we could be leaving local
    task_work that is ready to process in the ctx list until next time that
    we enter the kernel to wait for events.
    
    Move the break condition to _after_ we have run task_work.
    
    Cc: stable@vger.kernel.org
    Fixes: 846072f16eed ("io_uring: mimimise io_cqring_wait_schedule")
    Signed-off-by: Jens Axboe <axboe@kernel.dk>

Signed-off-by: Jeff Moyer <jmoyer@redhat.com>

2024-02-05 16:34:25 -05:00

..

advise.c

io_uring: always go async for unsupported fadvise flags

2023-11-02 15:31:10 -04:00

advise.h

io_uring: split out fadvise/madvise operations

2023-04-29 05:19:02 -04:00

alloc_cache.h

io_uring/rsrc: consolidate node caching

2023-11-02 15:31:32 -04:00

cancel.c

io_uring: use fget/fput consistently

2024-02-05 16:34:24 -05:00

cancel.h

io_uring/cancel: support opcode based lookup and cancelation

2023-11-02 15:32:15 -04:00

epoll.c

io_uring: undeprecate epoll_ctl support

2023-07-31 16:24:20 -04:00

epoll.h

io_uring: move epoll handler to its own file

2023-04-29 05:24:02 -04:00

fdinfo.c

io_uring/fdinfo: remove need for sqpoll lock for thread/pid retrieval

2024-02-01 12:04:14 -05:00

fdinfo.h

io_uring: move fdinfo helpers to its own file

2023-04-29 05:32:02 -04:00

filetable.c

io_uring: add helpers to decode the fixed file file_ptr

2023-11-02 15:31:55 -04:00

filetable.h

io_uring: add helpers to decode the fixed file file_ptr

2023-11-02 15:31:55 -04:00

fs.c

io_uring/fs: consider link->flags when getting path for LINKAT

2024-02-01 12:05:14 -05:00

fs.h

io_uring: split out filesystem related operations

2023-04-29 05:16:02 -04:00

io_uring.c

io_uring: ensure local task_work is run on wait timeout

2024-02-05 16:34:25 -05:00

io_uring.h

io_uring: enable io_mem_alloc/free to be used in other parts

2024-02-01 12:08:14 -05:00

io-wq.c

io-wq: fully initialize wqe before calling cpuhp_state_add_instance_nocalls()

2023-11-03 15:39:13 -04:00

io-wq.h

io_uring: break out of iowq iopoll on teardown

2023-11-02 17:26:27 -04:00

kbuf.c

io_uring/kbuf: Fix an NULL vs IS_ERR() bug in io_alloc_pbuf_ring()

2024-02-05 16:34:25 -05:00

kbuf.h

io_uring: free io_buffer_list entries via RCU

2024-02-05 16:34:24 -05:00

Makefile

io_uring: add zc notification infrastructure

2023-04-29 08:16:02 -04:00

msg_ring.c

io_uring: use io_file_from_index in io_msg_grab_file

2023-11-02 15:31:55 -04:00

msg_ring.h

io_uring: get rid of double locking

2023-05-05 15:25:21 -04:00

net.c

io_uring/net: ensure socket is marked connected on connect retry

2024-02-01 12:03:14 -05:00

net.h

io_uring: Add KASAN support for alloc_caches

2023-11-02 15:31:28 -04:00

nop.c

io_uring: kill extra io_uring_types.h includes

2023-04-29 06:19:02 -04:00

nop.h

io_uring: move nop into its own file

2023-04-29 05:15:02 -04:00

notif.c

io_uring/notif: add constant for ubuf_info flags

2023-11-02 15:31:32 -04:00

notif.h

io_uring/notif: add constant for ubuf_info flags

2023-11-02 15:31:32 -04:00

opdef.c

io_uring: Pass whole sqe to commands

2023-11-02 15:31:34 -04:00

opdef.h

io_uring: Split io_issue_def struct

2023-11-02 15:31:09 -04:00

openclose.c

io_uring: correct check for O_TMPFILE

2023-11-02 15:31:57 -04:00

openclose.h

io_uring: split out fixed file installation and removal

2023-04-29 07:06:02 -04:00

poll.c

io_uring: never overflow io_aux_cqe

2023-11-02 17:26:25 -04:00

poll.h

io_uring: avoid indirect function calls for the hottest task_work

2023-11-02 15:31:54 -04:00

refs.h

io_uring: make io_uring_types.h public

2023-04-29 06:20:02 -04:00

rsrc.c

io_uring: fix off-by one bvec index

2024-01-03 10:02:11 +08:00

rsrc.h

io_uring/af_unix: disable sending io_uring over sockets

2024-02-05 16:34:25 -05:00

rw.c

io_uring/rw: ensure io->bytes_done is always initialized

2024-02-05 16:34:25 -05:00

rw.h

io_uring: avoid indirect function calls for the hottest task_work

2023-11-02 15:31:54 -04:00

slist.h

io_uring: silence variable ‘prev’ set but not used warning

2023-11-02 15:31:12 -04:00

splice.c

io_uring/splice: use fput() directly

2023-11-02 17:26:24 -04:00

splice.h

io_uring: split out splice related operations

2023-04-29 05:17:02 -04:00

sqpoll.c

io_uring/fdinfo: remove need for sqpoll lock for thread/pid retrieval

2024-02-01 12:04:14 -05:00

sqpoll.h

io_uring/sqpoll: fix io-wq affinity when IORING_SETUP_SQPOLL is used

2023-11-02 17:26:25 -04:00

statx.c

io_uring: for requests that require async, force it

2023-11-02 15:31:10 -04:00

statx.h

io_uring: move statx handling to its own file

2023-04-29 05:25:02 -04:00

sync.c

io_uring: for requests that require async, force it

2023-11-02 15:31:10 -04:00

sync.h

io_uring: split out fs related sync/fallocate functions

2023-04-29 05:18:02 -04:00

tctx.c

io_uring: Add io_uring_setup flag to pre-register ring fd and never install it

2023-11-02 15:31:53 -04:00

tctx.h

io_uring: simplify __io_uring_add_tctx_node

2023-05-05 15:24:05 -04:00

timeout.c

io_uring: never overflow io_aux_cqe

2023-11-02 17:26:25 -04:00

timeout.h

io_uring: remove unused return from io_disarm_next

2023-05-05 15:23:54 -04:00

uring_cmd.c

io_uring/cmd: fix breakage in SOCKET_URING_OP_SIOC* implementation

2024-02-05 16:34:25 -05:00

uring_cmd.h

io_uring: Remove unnecessary BUILD_BUG_ON

2023-11-02 15:31:35 -04:00

xattr.c

io_uring: for requests that require async, force it

2023-11-02 15:31:10 -04:00

xattr.h

io_uring: move xattr related opcodes to its own file

2023-04-29 05:14:02 -04:00