• John Garry's avatar
    block: Add core atomic write support · 9da3d1e9
    John Garry authored
    Add atomic write support, as follows:
    - add helper functions to get request_queue atomic write limits
    - report request_queue atomic write support limits to sysfs and update Doc
    - support to safely merge atomic writes
    - deal with splitting atomic writes
    - misc helper functions
    - add a per-request atomic write flag
    
    New request_queue limits are added, as follows:
    - atomic_write_hw_max is set by the block driver and is the maximum length
      of an atomic write which the device may support. It is not
      necessarily a power-of-2.
    - atomic_write_max_sectors is derived from atomic_write_hw_max_sectors and
      max_hw_sectors. It is always a power-of-2. Atomic writes may be merged,
      and atomic_write_max_sectors would be the limit on a merged atomic write
      request size. This value is not capped at max_sectors, as the value in
      max_sectors can be controlled from userspace, and it would only cause
      trouble if userspace could limit atomic_write_unit_max_bytes and the
      other atomic write limits.
    - atomic_write_hw_unit_{min,max} are set by the block driver and are the
      min/max length of an atomic write unit which the device may support. They
      both must be a power-of-2. Typically atomic_write_hw_unit_max will hold
      the same value as atomic_write_hw_max.
    - atomic_write_unit_{min,max} are derived from
      atomic_write_hw_unit_{min,max}, max_hw_sectors, and block core limits.
      Both min and max values must be a power-of-2.
    - atomic_write_hw_boundary is set by the block driver. If non-zero, it
      indicates an LBA space boundary at which an atomic write straddles no
      longer is atomically executed by the disk. The value must be a
      power-of-2. Note that it would be acceptable to enforce a rule that
      atomic_write_hw_boundary_sectors is a multiple of
      atomic_write_hw_unit_max, but the resultant code would be more
      complicated.
    
    All atomic writes limits are by default set 0 to indicate no atomic write
    support. Even though it is assumed by Linux that a logical block can always
    be atomically written, we ignore this as it is not of particular interest.
    Stacked devices are just not supported either for now.
    
    An atomic write must always be submitted to the block driver as part of a
    single request. As such, only a single BIO must be submitted to the block
    layer for an atomic write. When a single atomic write BIO is submitted, it
    cannot be split. As such, atomic_write_unit_{max, min}_bytes are limited
    by the maximum guaranteed BIO size which will not be required to be split.
    This max size is calculated by request_queue max segments and the number
    of bvecs a BIO can fit, BIO_MAX_VECS. Currently we rely on userspace
    issuing a write with iovcnt=1 for pwritev2() - as such, we can rely on each
    segment containing PAGE_SIZE of data, apart from the first+last, which each
    can fit logical block size of data. The first+last will be LBS
    length/aligned as we rely on direct IO alignment rules also.
    
    New sysfs files are added to report the following atomic write limits:
    - atomic_write_unit_max_bytes - same as atomic_write_unit_max_sectors in
    				bytes
    - atomic_write_unit_min_bytes - same as atomic_write_unit_min_sectors in
    				bytes
    - atomic_write_boundary_bytes - same as atomic_write_hw_boundary_sectors in
    				bytes
    - atomic_write_max_bytes      - same as atomic_write_max_sectors in bytes
    
    Atomic writes may only be merged with other atomic writes and only under
    the following conditions:
    - total resultant request length <= atomic_write_max_bytes
    - the merged write does not straddle a boundary
    
    Helper function bdev_can_atomic_write() is added to indicate whether
    atomic writes may be issued to a bdev. If a bdev is a partition, the
    partition start must be aligned with both atomic_write_unit_min_sectors
    and atomic_write_hw_boundary_sectors.
    
    FSes will rely on the block layer to validate that an atomic write BIO
    submitted will be of valid size, so add blk_validate_atomic_write_op_size()
    for this purpose. Userspace expects an atomic write which is of invalid
    size to be rejected with -EINVAL, so add BLK_STS_INVAL for this. Also use
    BLK_STS_INVAL for when a BIO needs to be split, as this should mean an
    invalid size BIO.
    
    Flag REQ_ATOMIC is used for indicating an atomic write.
    Co-developed-by: default avatarHimanshu Madhani <himanshu.madhani@oracle.com>
    Signed-off-by: default avatarHimanshu Madhani <himanshu.madhani@oracle.com>
    Reviewed-by: default avatarMartin K. Petersen <martin.petersen@oracle.com>
    Signed-off-by: default avatarJohn Garry <john.g.garry@oracle.com>
    Reviewed-by: default avatarKeith Busch <kbusch@kernel.org>
    Link: https://lore.kernel.org/r/20240620125359.2684798-6-john.g.garry@oracle.comSigned-off-by: default avatarJens Axboe <axboe@kernel.dk>
    9da3d1e9
blk.h 20.3 KB