• Hao Xu's avatar
    io_uring: implement multishot mode for accept · 4e86a2c9
    Hao Xu authored
    Refactor io_accept() to support multishot mode.
    
    theoretical analysis:
      1) when connections come in fast
        - singleshot:
                  add accept sqe(userspace) --> accept inline
                                  ^                 |
                                  |-----------------|
        - multishot:
                 add accept sqe(userspace) --> accept inline
                                                  ^     |
                                                  |--*--|
    
        we do accept repeatedly in * place until get EAGAIN
    
      2) when connections come in at a low pressure
        similar thing like 1), we reduce a lot of userspace-kernel context
        switch and useless vfs_poll()
    
    tests:
    Did some tests, which goes in this way:
    
      server    client(multiple)
      accept    connect
      read      write
      write     read
      close     close
    
    Basically, raise up a number of clients(on same machine with server) to
    connect to the server, and then write some data to it, the server will
    write those data back to the client after it receives them, and then
    close the connection after write return. Then the client will read the
    data and then close the connection. Here I test 10000 clients connect
    one server, data size 128 bytes. And each client has a go routine for
    it, so they come to the server in short time.
    test 20 times before/after this patchset, time spent:(unit cycle, which
    is the return value of clock())
    before:
      1930136+1940725+1907981+1947601+1923812+1928226+1911087+1905897+1941075
      +1934374+1906614+1912504+1949110+1908790+1909951+1941672+1969525+1934984
      +1934226+1914385)/20.0 = 1927633.75
    after:
      1858905+1917104+1895455+1963963+1892706+1889208+1874175+1904753+1874112
      +1874985+1882706+1884642+1864694+1906508+1916150+1924250+1869060+1889506
      +1871324+1940803)/20.0 = 1894750.45
    
    (1927633.75 - 1894750.45) / 1927633.75 = 1.65%
    Signed-off-by: default avatarHao Xu <howeyxu@tencent.com>
    Link: https://lore.kernel.org/r/20220514142046.58072-5-haoxu.linux@gmail.comSigned-off-by: default avatarJens Axboe <axboe@kernel.dk>
    4e86a2c9
io_uring.c 301 KB