• Marko Mäkelä's avatar
    MDEV-18644: Support full_crc32 for page_compressed · 6b6fa3cd
    Marko Mäkelä authored
    This is a follow-up task to MDEV-12026, which introduced
    innodb_checksum_algorithm=full_crc32 and a simpler page format.
    MDEV-12026 did not enable full_crc32 for page_compressed tables,
    which we will be doing now.
    
    This is joint work with Thirunarayanan Balathandayuthapani.
    
    For innodb_checksum_algorithm=full_crc32 we change the
    page_compressed format as follows:
    
    FIL_PAGE_TYPE: The most significant bit will be set to indicate
    page_compressed format. The least significant bits will contain
    the compressed page size, rounded up to a multiple of 256 bytes.
    
    The checksum will be stored in the last 4 bytes of the page
    (whether it is the full page or a page_compressed page whose
    size is determined by FIL_PAGE_TYPE), covering all preceding
    bytes of the page. If encryption is used, then the page will
    be encrypted between compression and computing the checksum.
    For page_compressed, FIL_PAGE_LSN will not be repeated at
    the end of the page.
    
    FSP_SPACE_FLAGS (already implemented as part of MDEV-12026):
    We will store the innodb_compression_algorithm that may be used
    to compress pages. Previously, the choice of algorithm was written
    to each compressed data page separately, and one would be unable
    to know in advance which compression algorithm(s) are used.
    
    fil_space_t::full_crc32_page_compressed_len(): Determine if the
    page_compressed algorithm of the tablespace needs to know the
    exact length of the compressed data. If yes, we will reserve and
    write an extra byte for this right before the checksum.
    
    buf_page_is_compressed(): Determine if a page uses page_compressed
    (in any innodb_checksum_algorithm).
    
    fil_page_decompress(): Pass also fil_space_t::flags so that the
    format can be determined.
    
    buf_page_is_zeroes(): Check if a page is full of zero bytes.
    
    buf_page_full_crc32_is_corrupted(): Renamed from
    buf_encrypted_full_crc32_page_is_corrupted(). For full_crc32,
    we always simply validate the checksum to the page contents,
    while the physical page size is explicitly specified by an
    unencrypted part of the page header.
    
    buf_page_full_crc32_size(): Determine the size of a full_crc32 page.
    
    buf_dblwr_check_page_lsn(): Make this a debug-only function, because
    it involves potentially costly lookups of fil_space_t.
    
    create_table_info_t::check_table_options(),
    ha_innobase::check_if_supported_inplace_alter(): Do allow the creation
    of SPATIAL INDEX with full_crc32 also when page_compressed is used.
    
    commit_cache_norebuild(): Preserve the compression algorithm when
    updating the page_compression_level.
    
    dict_tf_to_fsp_flags(): Set the flags for page compression algorithm.
    FIXME: Maybe there should be a table option page_compression_algorithm
    and a session variable to back it?
    6b6fa3cd
fil0fil.ic 4.09 KB