1. 15 Mar, 2017 4 commits
  2. 14 Mar, 2017 5 commits
  3. 13 Mar, 2017 10 commits
    • Vladislav Vaintroub's avatar
    • Vladislav Vaintroub's avatar
    • Vladislav Vaintroub's avatar
      MDEV-11903 Windows : Support innodb page sizes in the installer/mysql_install_db.exe · a8715884
      Vladislav Vaintroub authored
      - add PAGESIZE property to the MSI installer
      - add combobox  to the MSI UI to select innodb page size
      - add new parameter --innodb_page_size for mysql_install_db.exe.
      this is passed down to bootstrap and also stored in my.ini.
      
      MSI will call mysql_install_db.exe with --innodb_page_size set to the
      PAGESIZE property
      a8715884
    • Oleksandr Byelkin's avatar
      MDEV-12244: C API header file contains C++ comment for COM_BINLOG_DUMP_GTID · bfef611a
      Oleksandr Byelkin authored
      fixed C++ comment in C code
      bfef611a
    • Marko Mäkelä's avatar
      MDEV-12219 Discard temporary undo logs at transaction commit · 13e5c9de
      Marko Mäkelä authored
      Starting with MySQL 5.7, temporary tables in InnoDB are handled
      differently from persistent tables. Because temporary tables are
      private to a connection, concurrency control and multi-versioning
      (MVCC) are not applicable. For performance reasons, purge is
      disabled as well. Rollback is supported for temporary tables;
      that is why we have the temporary undo logs in the first place.
      
      Because MVCC and purge are disabled for temporary tables, we should
      discard all temporary undo logs already at transaction commit,
      just like we discard the persistent insert_undo logs. Before this
      change, update_undo logs were being preserved.
      
      trx_temp_undo_t: A wrapper for temporary undo logs, comprising
      a rollback segment and a single temporary undo log.
      
      trx_rsegs_t::m_noredo: Use trx_temp_undo_t.
      (Instead of insert_undo, update_undo, there will be a single undo.)
      
      trx_is_noredo_rseg_updated(), trx_is_rseg_assigned(): Remove.
      
      trx_undo_add_page(): Remove the parameter undo_ptr.
      Acquire and release the rollback segment mutex inside the function.
      
      trx_undo_free_last_page(): Remove the parameter trx.
      
      trx_undo_truncate_end(): Remove the parameter trx, and add the
      parameter is_temp. Clean up the code a bit.
      
      trx_undo_assign_undo(): Split the parameter undo_ptr into rseg, undo.
      
      trx_undo_commit_cleanup(): Renamed from trx_undo_insert_cleanup().
      Replace the parameter undo_ptr with undo.
      This will discard the temporary undo or insert_undo log at
      commit/rollback.
      
      trx_purge_add_update_undo_to_history(), trx_undo_update_cleanup():
      Remove 3 parameters. Always operate on the persistent update_undo.
      
      trx_serialise(): Renamed from trx_serialisation_number_get().
      
      trx_write_serialisation_history(): Simplify the code flow.
      If there are no persistent changes, do not update MONITOR_TRX_COMMIT_UNDO.
      
      trx_commit_in_memory(): Simplify the logic, and add assertions.
      
      trx_undo_page_report_modify(): Keep a direct reference to the
      persistent update_undo log.
      
      trx_undo_report_row_operation(): Simplify some code.
      Always assign TRX_UNDO_INSERT for temporary undo logs.
      
      trx_prepare_low(): Keep only one parameter. Prepare all 3 undo logs.
      
      trx_roll_try_truncate(): Remove the parameter undo_ptr.
      Try to truncate all 3 undo logs of the transaction.
      
      trx_roll_pop_top_rec_of_trx_low(): Remove.
      
      trx_roll_pop_top_rec_of_trx(): Remove the redundant parameter
      trx->roll_limit. Clear roll_limit when exhausting the undo logs.
      Consider all 3 undo logs at once, prioritizing the persistent
      undo logs.
      
      row_undo(): Minor cleanup. Let trx_roll_pop_top_rec_of_trx()
      reset the trx->roll_limit.
      13e5c9de
    • Marko Mäkelä's avatar
      Fix some compilation warnings. · 056ec4ab
      Marko Mäkelä authored
      056ec4ab
    • Marko Mäkelä's avatar
      MDEV-12091 Shutdown fails to wait for rollback of recovered transactions to finish · e5b155a4
      Marko Mäkelä authored
      In the 10.1 InnoDB Plugin, a call os_event_free(buf_flush_event) was
      misplaced. The event could be triggered by rollback of resurrected
      transactions while shutdown was in progress. This bug was caught
      by cmake -DWITH_ASAN testing. This call was only present in the
      10.1 InnoDB Plugin, not in other versions, or in XtraDB.
      
      That said, the bug affects all InnoDB versions. Shutdown assumes the
      cessation of any page-dirtying activity, including the activity of
      the background rollback thread. InnoDB only waited for the background
      rollback to finish as part of a slow shutdown (innodb_fast_shutdown=0).
      The default is a clean shutdown (innodb_fast_shutdown=1). In a scenario
      where InnoDB is killed, restarted, and shut down soon enough, the data
      files could become corrupted.
      
      logs_empty_and_mark_files_at_shutdown(): Wait for the
      rollback to finish, except if innodb_fast_shutdown=2
      (crash-like shutdown) was requested.
      
      trx_rollback_or_clean_recovered(): Before choosing the next
      recovered transaction to roll back, terminate early if non-slow
      shutdown was initiated. Roll back everything on slow shutdown
      (innodb_fast_shutdown=0).
      
      srv_innodb_monitor_mutex: Declare as static, because the mutex
      is only used within one module.
      
      In 10.2, os_event_destroy() sets the event to a NULL pointer,
      while os_event_free() in earlier versions did not do that.
      e5b155a4
    • Marko Mäkelä's avatar
      Define a mtr_t::start() wrapper inline. · ff8bf6e9
      Marko Mäkelä authored
      ff8bf6e9
    • Marko Mäkelä's avatar
      Adjust an outdated comment. · c32dcae6
      Marko Mäkelä authored
      os_sync_free(), which hid resource leaks, was removed in MySQL 5.7.
      c32dcae6
    • Oleksandr Byelkin's avatar
      MDEV-10555: Server crashes in mysql_admin_table upon killing ANALYZE · c0fb7b45
      Oleksandr Byelkin authored
      Take into acount result of open table operation in mysql_admin_table.
      c0fb7b45
  4. 11 Mar, 2017 1 commit
  5. 10 Mar, 2017 6 commits
    • Oleksandr Byelkin's avatar
      fix test for windows 64 · eb574697
      Oleksandr Byelkin authored
      eb574697
    • Vladislav Vaintroub's avatar
      f2fe5cb2
    • Vladislav Vaintroub's avatar
      Revert MySQL commit that disables writing on Windows while flush is in progress · 7c512138
      Vladislav Vaintroub authored
      Reason : after running sysbench tests (rw,update_no_index), in all cases
      the throughout was considerably (approx 15%) better with the patch removed.
      
      Reverted commit info
      commit 8dc03bee3ade2edcc53a3a257346f4a0a9f0b44c
      Author: Yasufumi Kinoshita <yasufumi.kinoshita@oracle.com>
      Date:   Wed Nov 20 17:02:24 2013 +0900
      
      Bug #17824101 : WL#7050 CAUSES RW PERFORMANCE REGRESSION AT SOME WINDOWS ENVIRONMENT
      7c512138
    • Marko Mäkelä's avatar
      Hard-code innodb_page_size as the undo log page size. · a20340cf
      Marko Mäkelä authored
      InnoDB undo logs currently always use the innodb_page_size,
      whether they are stored in the system tablespace, in a
      dedicated undo tablespace, or in the temporary tablespace.
      Remove redundant page_size parameters.
      
      TrxUndoRsegsIterator::set_next(): return bool instead of page_size.
      a20340cf
    • Marko Mäkelä's avatar
      Simplify InnoDB transaction system initialization. · 0ef91c89
      Marko Mäkelä authored
      trx_rseg_mem_create(): Remove the parameter rseg_array.
      Update trx_sys->rseg_array directly.
      0ef91c89
    • Marko Mäkelä's avatar
      InnoDB purge_sys cleanup. · 14178398
      Marko Mäkelä authored
      TrxUndoRsegsIterator::m_purge_sys: Remove. There is only one purge_sys.
      
      purge_sys_t: Renamed from trx_purge_t. Define a constructor and
      destructor. Allocate rseg_iter, purge_queue inline.
      
      purge_sys->trx: Remove. Use purge_sys->sess->trx instead.
      
      purge_sys->view_active: Remove. Access to purge_sys->view is always
      protected by purge_sys->latch.
      
      trx_purge_sys_create(): Replaced by purge_sys_t::purge_sys_t().
      
      trx_purge_sys_close(): Replaced by purge_sys_t::~purge_sys_t().
      14178398
  6. 09 Mar, 2017 8 commits
    • Vladislav Vaintroub's avatar
      Add SRV_ALL_O_DIRECT_FSYNC to switch(srv_flush_method) in log0log.c. · 9928dbe5
      Vladislav Vaintroub authored
      Also in log_checkpoint(), where fil_flush_file_spaces() was
      not done on Windows, it is not done.
      9928dbe5
    • Vladislav Vaintroub's avatar
      MDEV-12201 innodb_flush_method are not available on Windows · a98009ab
      Vladislav Vaintroub authored
       Remove srv_win_file_flush_method
      
      - Rename srv_unix_file_flush_method to srv_file_flush_method, and
        rename constants to remove UNIX from them, i.e SRV_UNIX_FSYNC=>SRV_FSYNC
      
      - Add SRV_ALL_O_DIRECT_FSYNC corresponding to current Windows default
      (no buffering for either log or data, flush on both log and data)
      
      - change os_file_open on Windows to behave identically to Unix wrt
      O_DIRECT and O_DSYNC settings. map O_DIRECT to FILE_FLAG_NO_BUFFERING and
      O_DSYNC to FILE_FLAG_WRITE_THROUGH
      
      - remove various #ifdef _WIN32
      a98009ab
    • Oleksandr Byelkin's avatar
      MDEV-11363: Assertion `!derived->first_sel ect()->first_inner_unit() ||... · 8e05953d
      Oleksandr Byelkin authored
      MDEV-11363: Assertion `!derived->first_sel ect()->first_inner_unit() || derived->first_select()->first_inner_unit()->first_select()-> exclude_from_table_unique_test' failed in TABLE_LIST::set_check_materialized()
      
      Do not try to materialize derived table which already merged (irreversebly).
      8e05953d
    • Marko Mäkelä's avatar
      70a0500d
    • Marko Mäkelä's avatar
      Simplify InnoDB startup. · 7a30d86e
      Marko Mäkelä authored
      InnoDB needs to collect transactions from the persistent data files
      in trx_rseg_array_init() before trx_lists_init_at_db_start() is
      executed. But there is no need to create purge_sys->purge_queue
      separately from purge_sys.
      
      trx_sys_init_at_db_start(): Change the return type to void.
      Remove the direct call to trx_rseg_array_init(). It will be called
      by trx_lists_init_at_db_start(), which we are calling.
      Initialize the purge system read view.
      
      trx_lists_init_at_db_start(): Call trx_purge_sys_create(), which will
      invoke trx_rseg_array_init() to read the undo log segments.
      
      trx_purge_sys_create(): Remove the parameters. Do not initialize
      the purge system read view, because trx_sys->rw_trx_list has not
      been recovered yet. The purge_sys->view will be initialized at
      the end of trx_sys_init_at_db_start().
      
      trx_rseg_array_init(): Remove the parameter. Use purge_sys->purge_queue
      directly.
      
      innobase_start_or_create_for_mysql(): Remove the local variable
      purge_queue. Do not call trx_purge_sys_create(), because it will be
      called by trx_sys_init_at_db_start().
      7a30d86e
    • Marko Mäkelä's avatar
      Remove trx_sys_t::pending_purge_rseg_array. · 15bdfeeb
      Marko Mäkelä authored
      In MySQL 5.7, there is some redundant code for supposedly handling
      an upgrade from an earlier version of InnoDB.
      
      An upgrade of InnoDB between major versions should include a
      slow shutdown (innodb_fast_shutdown=0) of the previous version.
      
      A comment in trx_lists_init_at_db_start() confused clean shutdown
      and slow shutdown. A clean shutdown does not necessarily guarantee
      that there are no active transactions. A slow shutdown guarantees
      that.
      
      Because there was no code to handle rollback of recovered transactions
      that happened to use the rollback segment slots that MySQL 5.7.2
      repurposed for temporary undo logs, the upgrade is not working in all
      cases, and we may as well remove the code to handle purging.
      
      trx_sys_t::pending_purge_rseg_array: Remove.
      
      trx_undo_get_undo_rec_low(): Define as static. Remove the parameter
      is_redo_rseg.
      
      trx_undo_get_undo_rec(), trx_rseg_get_on_id(): Remove the parameter
      is_redo_rseg.
      
      trx_rseg_mem_free(): Remove the second parameter.
      
      trx_sys_get_nth_rseg(): Replace with trx_rseg_get_on_id().
      
      trx_rseg_schedule_pending_purge(): Remove.
      15bdfeeb
    • Oleksandr Byelkin's avatar
      MDEV-11966: Impossible to execute prepared ANALYZE SELECT · 24cbc8da
      Oleksandr Byelkin authored
      Prepare os ANALYZE now respond as EXPLAIN.
      24cbc8da
    • Marko Mäkelä's avatar
      enum btr_latch_mode: Incorporate some flags. · 5ff6694d
      Marko Mäkelä authored
      This fixes some GCC 6.3.0 warnings and makes the code a little
      more debugging-friendly.
      5ff6694d
  7. 08 Mar, 2017 6 commits
    • Vladislav Vaintroub's avatar
    • Marko Mäkelä's avatar
      MDEV-11688 follow-up: More robust shutdown after aborted startup. · 29a980cf
      Marko Mäkelä authored
      After starting MariaDB 10.2 with an invalid value of
      --innodb-flush-method= (the empty string), shutdown would
      attempt to dereference some NULL pointers. This was probably broken
      in commit 81b7fe9d which implemented
      shutdown after aborted startup.
      
      logs_empty_and_mark_files_at_shutdown(): Allow shutdown even if
      lock_sys, log_sys, or fil_system is NULL.
      
      os_aio_free(): Tolerate os_aio_segment_wait_events==NULL.
      
      innobase_start_or_create_for_mysql(): Do not invoke
      srv_init_abort() before initializing all mutexes for the temporary files.
      
      innodb_shutdown(): Tolerate buf_pool_ptr==NULL.
      29a980cf
    • Marko Mäkelä's avatar
      MDEV-11027 InnoDB log recovery is too noisy · 5da6bd7b
      Marko Mäkelä authored
      Provide more useful progress reporting of crash recovery.
      
      recv_sys_t::progress_time: The time of the last report.
      
      recv_sys_t::report(ib_time_t): Determine whether progress should
      be reported.
      
      recv_scan_print_counter: Remove.
      
      log_group_read_log_seg(): After after each I/O request, invoke
      recv_sys_t::report() and report progress if needed.
      
      recv_apply_hashed_log_recs(): Change the return type back to void
      (DB_SUCCESS was always returned), and rename the parameter to last_batch.
      At the start of each batch, if there are pages to be recovered,
      issue a message.
      5da6bd7b
    • Oleksandr Byelkin's avatar
      MDEV-10704: Assertion `field->field->table == table_arg' failed in... · 0b1abc2f
      Oleksandr Byelkin authored
      MDEV-10704: Assertion `field->field->table == table_arg' failed in fill_record(THD*, TABLE*, List<Item>&, List<Item>&, bool, bool)
      
      the bug test suite
      0b1abc2f
    • Daniel Black's avatar
      Whitespace correction to avoid compile warning · 8c3b98fe
      Daniel Black authored
      Introduced 2f63e2e2
      
      Compiler error was:
      
      sql/log_event.cc: In function ‘size_t log_event_print_value(IO_CACHE*, const uchar*, uint, uint, char*, size_t)’:
      sql/log_event.cc:2897:7: warning: this ‘if’ clause does not guard... [-Wmisleading-indentation]
             if (!ptr)
             ^~
      sql/log_event.cc:2900:9: note: ...this statement, but the latter is misleadingly indented as if it is guarded by the ‘if’
               int32 i32= uint2korr(ptr);
               ^~~~~
      
      Added in 950abd52
      
      Error was:
      
      sql/item_sum.cc:3478:5: warning: this ‘if’ clause does not guard... [-Wmisleading-indentation]
           if ((!args[i]->fixed &&
           ^~
      /sql/item_sum.cc:3482:7: note: ...this statement, but the latter is misleadingly indented as if it is guarded by the ‘if’
             with_subselect|= args[i]->with_subselect;
             ^~~~~~~~~~~~~~
      Signed-off-by: default avatarDaniel Black <daniel.black@au.ibm.com>
      8c3b98fe
    • Igor Babaev's avatar
      Fixed bug mdev-12185. · 2d948ebd
      Igor Babaev authored
      The bug was caused by a wrong order of statements in With_clause::print().
      As a result any view definition containing WITH clause with several
      CTE specifications was put the frm file in a syntactically incorrect
      form.
      2d948ebd