1. 06 Aug, 2008 1 commit
  2. 04 Aug, 2008 2 commits
    • Sergei Golubchik's avatar
      wt_thd_cond_timedwait() now allows the list of blockers to change after · 651f61fc
      Sergei Golubchik authored
      wt_thd_will_wait_for() was called. That is a caller doesn't need to hold a
      mutex all the time preventing blockers from releasing a resource.
      
      651f61fc
    • Sergei Golubchik's avatar
      compiler warnings · 83472904
      Sergei Golubchik authored
      trnman: remove old lockman code
      trnman: replace trid_to_committed_trn hash with trid_to_trn
      
      storage/maria/ma_blockrec.c:
        compiler warnings
      storage/maria/ma_loghandler.c:
        compiler warnings
      storage/maria/ma_write.c:
        compiler warnings
      storage/maria/trnman.c:
        remove old lockman code
        replace trid_to_committed_trn hash with trid_to_trn
      storage/maria/trnman.h:
        remove old lockman code
        replace trid_to_committed_trn hash with trid_to_trn
      storage/maria/unittest/ma_test_loghandler-t.c:
        compiler warnings
      storage/maria/unittest/ma_test_loghandler_multigroup-t.c:
        compiler warnings
      storage/maria/unittest/ma_test_loghandler_multithread-t.c:
        compiler warnings
      83472904
  3. 02 Aug, 2008 1 commit
  4. 29 Jul, 2008 1 commit
    • Sergei Golubchik's avatar
      WL#3064 - waiting threads - wait-for graph and deadlock detection · 6ba12f07
      Sergei Golubchik authored
      client/mysqltest.c:
        compiler warnings
      configure.in:
        remove old tests for unused programs
        disable the use of gcc built-ins if smp assembler atomics were selected explictily.
        add waiting_threads.o to THREAD_LOBJECTS
      include/lf.h:
        replace the end-of-stack pointer with the pointer to the end-of-stack pointer.
        the latter could be stored in THD (mysys_vars) and updated in pool-of-threads
        scheduler.
        constructor/destructor in lf-alloc
      include/my_pthread.h:
        shuffle set_timespec/set_timespec_nsec macros a bit to be able to fill
        several timeout structures with only one my_getsystime() call
      include/waiting_threads.h:
        waiting threads - wait-for graph and deadlock detection
      mysys/Makefile.am:
        add waiting_threads.c
      mysys/lf_alloc-pin.c:
        replace the end-of-stack pointer with the pointer to the end-of-stack pointer.
        the latter could be stored in THD (mysys_vars) and updated in pool-of-threads
        scheduler.
        constructor/destructor in lf-alloc
      mysys/lf_hash.c:
        constructor/destructor in lf-alloc
      mysys/my_thr_init.c:
        remember end-of-stack pointer in the mysys_var
      mysys/waiting_threads.c:
        waiting threads - wait-for graph and deadlock detection
      storage/maria/ha_maria.cc:
        replace the end-of-stack pointer with the pointer to the end-of-stack pointer.
        the latter could be stored in THD (mysys_vars) and updated in pool-of-threads
        scheduler.
      storage/maria/ma_commit.c:
        replace the end-of-stack pointer with the pointer to the end-of-stack pointer.
        the latter could be stored in THD (mysys_vars) and updated in pool-of-threads
        scheduler.
      storage/maria/trnman.c:
        replace the end-of-stack pointer with the pointer to the end-of-stack pointer.
        the latter could be stored in THD (mysys_vars) and updated in pool-of-threads
        scheduler.
      storage/maria/trnman_public.h:
        replace the end-of-stack pointer with the pointer to the end-of-stack pointer.
        the latter could be stored in THD (mysys_vars) and updated in pool-of-threads
        scheduler.
      storage/maria/unittest/trnman-t.c:
        replace the end-of-stack pointer with the pointer to the end-of-stack pointer.
        the latter could be stored in THD (mysys_vars) and updated in pool-of-threads
        scheduler.
      unittest/mysys/Makefile.am:
        add waiting_threads-t
      unittest/mysys/lf-t.c:
        factor out the common code for multi-threaded stress unit tests
        move lf tests to a separate file
      unittest/mysys/my_atomic-t.c:
        factor out the common code for multi-threaded stress unit tests
        move lf tests to a separate file
      unittest/mysys/thr_template.c:
        factor out the common code for multi-threaded stress unit tests
      unittest/mysys/waiting_threads-t.c:
        wt tests
      6ba12f07
  5. 12 Jul, 2008 2 commits
    • Michael Widenius's avatar
      Auto merge · 9e762653
      Michael Widenius authored
      mysql-test/r/maria2.result:
        Manual merge
      9e762653
    • Michael Widenius's avatar
      Fixing bug when using alter table on locked maria table · 50fa1eb8
      Michael Widenius authored
      Reset history when we reenable logging for transactional tables (safety fix)
      
      mysql-test/r/maria2.result:
        New results
      mysql-test/t/maria2.test:
        Added test case for alter table on locked maria table
      mysql-test/valgrind.supp:
        Added suppression rules for warnings in libc / libld
      storage/maria/ma_extra.c:
        Remove table from trnman list if we are going to drop or rename it; We don't want not existing shares in the list when we do commit!
      storage/maria/ma_recovery.c:
        Ensure that info->state don't point to history event when we disable logging for a table;  This is needed as alter table will first do commit and then unlock, which would cause us to access a non existing object when we reenable logging.
        Reset history when we reenable logging (safety fix)
      storage/maria/ma_state.c:
        Do less work when share->now_transactional is not set. (Safety fix)
        Added function to remove shares to be deleted from trnman->used_tables
        Added function to reset history to current context
      storage/maria/ma_state.h:
        Prototypes for new function
      50fa1eb8
  6. 11 Jul, 2008 1 commit
    • Guilhem Bichot's avatar
      Fix for BUG#38018 INSERT SELECT ON DUPLICATE KEY UPDATE and LOAD DATA CONCURRENT REPLACE · 6f8b889a
      Guilhem Bichot authored
      used TL_WRITE_CONCURRENT_INSERT though they may update/delete a row. This could cause concurrent SELECTs
      to see a changing table while the SELECT happens, or if the query was made of a group of SELECTs,
      some SELECTs would see different versions of the table. And anyway versioning in Maria was so far coded
      to support only insertions. REPLACE SELECT, INSERT VALUES ON DUPLICATE KEY UPDATE, LOAD DATA REPLACE
      were ok.
      
      mysql-test/r/maria2.result:
        result. Without the code fix, the assertion added to ha_maria::update_row() would fire twice.
      mysql-test/t/maria2.test:
        test when INSERT ON DUPLICATE KEY UPDATE and LOAD DATA CONCURRENT REPLACE do update rows
      storage/maria/ha_maria.cc:
        Assert that update_row and delete_row never see TL_WRITE_CONCURRENT_INSERT.
        INSERT SELECT ON DUPLICATE KEY UPDATE and LOAD DATA CONCURRENT REPLACE
        must upgrade TL_WRITE_CONCURRENT_INSERT to TL_WRITE because they may update/delete a row.
      6f8b889a
  7. 10 Jul, 2008 2 commits
  8. 09 Jul, 2008 6 commits
    • Guilhem Bichot's avatar
      Merge of latest mysql-maria · 8de480a2
      Guilhem Bichot authored
      8de480a2
    • Guilhem Bichot's avatar
      Fix for BUG#37873 "Client gets ok from INSERT VALUES before commit record is on disk": · 71f72bad
      Guilhem Bichot authored
      this was true also for INSERT SELECT, UPDATE, DELETE. This fix will be removed when Maria supports COMMIT/ROLLBACK
      ("Maria 2.0"), because then Maria will trans_register_ha() and so participate in ha_commit_trans().
      Without the fix, the assertion added to ha_maria::external_lock() fires many times in *maria*.test.
      
      sql/sql_parse.cc:
        Before sending OK to client, commit transaction in Maria.
      storage/maria/ha_maria.cc:
        Assertion added to external_lock() when committing: OK should not have been sent yet (ACI*D*).
        In ha_maria::implicit_commit(), possibility to not create a new transaction, this is used
        before net_end_statement(), when the next step is close_thread_tables();
        in this use case, ha_maria::implicit_commit() should not commit if under LOCK TABLES.
      storage/maria/ha_maria.h:
        new prototype
      71f72bad
    • Michael Widenius's avatar
      Fixes for bug#37276: · 7f022824
      Michael Widenius authored
      - Fixes key corruption where pages wasn't marked that they contained transid.
      - Fixed bug in block record that could create too small rows when transid was removed. This fixed some asserts() when testing block length
      
      Added --abort-source-on-error to the mysql client. (Very helpfull when debugging wrong .sql files)
      
      client/client_priv.h:
        Added enum for new option to mysql
      client/mysql.cc:
        Added new option --abort-source-on-error to allow one to get 'source' to stop on error. This is 0 by default, to keep old behaviour.
        Print file name and line number when getting an error when doing source filename
      sql/field.cc:
        Removed old dead code
      sql/sql_class.cc:
        Removed old dead code
      storage/maria/ma_blockrec.c:
        Added checking of min block length to check_directory()
        When creating new directory entry, set length to 0; This ensures that the assert checks() on block lengths works properly.
        Added more DBUG_ASSERT() and more calls to check_directory()
        In get_head_or_tail_page(), send in correct min_block_length. This is now safe as the length of new blocks are now 0
      storage/maria/ma_delete.c:
        When moving key to parent page, mark page if key has transid
      storage/maria/ma_write.c:
        Fixed bug where _ma_find_last_pos() didn't set int_key->flag.
        Simpilifed code by unrolling loop.
      7f022824
    • Guilhem Bichot's avatar
      Test for fix made by Monty for BUG#37276 (CHECK TABLE said Invalid key block... · 942b3879
      Guilhem Bichot authored
      Test for fix made by Monty for BUG#37276 (CHECK TABLE said Invalid key block position: 15731098820608  key
      +# block size: 8192  file_length: 425984). Other corruption cases still not fixed.
      Without the fix, the test would yield the corruption message in CHECK TABLE.
      
      mysql-test/r/maria-big2.result:
        result
      mysql-test/t/maria-big2.test:
        test for bugfix
      942b3879
    • Guilhem Bichot's avatar
      - lifting a limit: INSERT|REPLACE SELECT and LOAD DATA always prevented... · 81d3d3ac
      Guilhem Bichot authored
      - lifting a limit: INSERT|REPLACE SELECT and LOAD DATA always prevented versioning, now what do so is if
      the table is empty.
      - lifting another limit: versioning was disabled if table had more than one unique index
      - correcting test of statement-based binlogging, when converting read locks to TL_READ_NO_INSERT
      
      KNOWN_BUGS.txt:
        removing mostly fixed limitation (see ha_maria.cc)
      mysql-test/r/maria-mvcc.result:
        result update
      mysql-test/t/maria-mvcc.test:
        now when table is empty it does not do versioning, so test hung; inserting one row at start of the test,
        to enable versioning.
      sql/sql_parse.cc:
        Maria team wrongly removed this "break", thanks Davi for noticing
      storage/maria/ha_maria.cc:
        - We used to prevent versioning in INSERT/REPLACE SELECT and LOAD DATA, because the index rebuild done by
        bulk insert sometimes, is unsafe when versioning is on. Here we change that: in store_lock(), if the table is empty
        (which is required for index rebuild to be used), we disable versioning; in start_bulk_insert(), we don't do
        index rebuild if versioning is enabled.
        - Test for statement-based binlogging was incomplete: statement-based binlogging is on for this statement
        if binlog is open and statement has binlogging enabled and statement is not doing row-based binlogging
      storage/maria/ma_open.c:
        Monty and I agreed that it's ok to have versioning on a table with more than one unique index: if an INSERT
        hits a duplicate key when inserting the second index' key, no other thread should be able to touch the 
        first index' just-inserted key, because that key has an uncommitted transaction id, so the first thread
        should have time to remove the first index' key.
      81d3d3ac
    • Guilhem Bichot's avatar
      Fix for BUG#37876 "Importing Maria table from other server via binary copy does not work": · 60b88ce4
      Guilhem Bichot authored
      - after auto-zerofill (ha_maria::check_and_repair()) kepts its state's LSNs unchanged, which could
      be the same as the create_rename_lsn of another pre-existing table, which would break versioning as this LSN
      serves as unique identifier in the versioning code (in maria_open()). Even the state pieces which
      maria_zerofill() did change were lost (because they didn't go to disk).
      - after this fix, if two tables were auto-zerofilled at the same time (by _ma_mark_changed())
      they could receive the same create_rename_lsn, which would break versioning again. Fix is to write a log
      record each time a table is imported.
      - Print state's LSNs (create_rename_lsn, is_of_horizon, skip_redo_lsn) and UUID in maria_chk -dvv.
      
      mysql-test/r/maria-autozerofill.result:
        result
      mysql-test/t/maria-autozerofill.test:
        Test for auto-zerofilling
      storage/maria/ha_maria.cc:
        The state changes done by auto-zerofilling never reached disk.
      storage/maria/ma_check.c:
        When zerofilling a table, including its pages' LSNs, new state LSNs are needed next time the table
        is imported into a Maria instance.
      storage/maria/ma_create.c:
        Write LOGREC_IMPORTED_TABLE when importing a table. This is informative and ensures
        that the table gets a unique create_rename_lsn even though multiple tables
        are imported by concurrent threads (it advances the log's end LSN).
      storage/maria/ma_key_recover.c:
        comment
      storage/maria/ma_locking.c:
        instead of using translog_get_horizon() for state's LSNs of imported table,
        use the LSN of to-be-written LOGREC_IMPORTED_TABLE.
      storage/maria/ma_loghandler.c:
        New type of log record
      storage/maria/ma_loghandler.h:
        New type of log record
      storage/maria/ma_loghandler_lsn.h:
        New name for constant as can be used not only by maria_chk but auto-zerofill now too.
      storage/maria/ma_open.c:
        instead of using translog_get_horizon() for state's LSNs of imported table,
        use the LSN of to-be-written LOGREC_IMPORTED_TABLE.
      storage/maria/ma_recovery.c:
        print content of LOGREC_IMPORTED_TABLE in maria_read_log.
      storage/maria/maria_chk.c:
        print info about LSNs of the table's state, and UUID, when maria_chk -dvv
      storage/maria/maria_pack.c:
        new name for constant
      storage/maria/unittest/ma_test_recovery.pl:
        Now that maria_chk -dvv shows state LSNs and UUID those need to be filtered out,
        as maria_read_log -a does not use the same as at original run.
      60b88ce4
  9. 05 Jul, 2008 2 commits
    • Michael Widenius's avatar
      Automatic merge · f9ef13d5
      Michael Widenius authored
      f9ef13d5
    • Michael Widenius's avatar
      Bug#37276 maria crash on insert around the time check table is run · 82d79389
      Michael Widenius authored
      Fixed several (but not all) issues found by the test program:
      - ASSERT on row_length in ma_blockrec.c::_ma_compact_block_page()
      - Fixed bug when splitting node pages
      - Fixed hang in 'closeing tables' (conflicting mutex order) by ensuring we first take trnman lock and then share->intern_lock
      
      storage/maria/ma_blockrec.c:
        When compacting a row page when allocating space for a new row, the min length of a the new block may be temporarly smaller than 'min_block_length'.
      storage/maria/ma_check.c:
        More DBUG output
      storage/maria/ma_checkpoint.c:
        Call new function _ma_remove_not_visible_states_with_lock() to ensure we first take lock on trnman and then on share->intern_lock
        +
      storage/maria/ma_close.c:
        Added comment
      storage/maria/ma_open.c:
        Added comment
      storage/maria/ma_search.c:
        Copy also node data; Caused bug when splitting node pages
      storage/maria/ma_state.c:
        Added _ma_remove_not_visible_states_with_lock() to ensure we take locks in right order
      storage/maria/ma_state.h:
        Added new prototype
      storage/maria/trnman.c:
        Added trnman_lock() and trnman_unlock().
        Needed by _ma_remove_not_visible_states_with_lock() to get mutex in right order
      storage/maria/trnman_public.h:
        Added new prototypes
      82d79389
  10. 03 Jul, 2008 1 commit
    • Guilhem Bichot's avatar
      Fix for BUG#35107 "maria-preload.test is disabled because unrepeatable page cache statistics" · 4d48802f
      Guilhem Bichot authored
      What varies accross machine is maria_pagecache_read_requests, but maria_pagecache_reads doesn't and
      is the most interesting (helps verify that disk wasn't touched after preloading), that's all we keep.
      
      mysql-test/r/maria-preload.result:
        unrepeatable variable removed
      mysql-test/t/maria-preload.test:
        unrepeatable variable removed
      storage/maria/ma_test_force_start.pl:
        portability fix for running under Windows
      4d48802f
  11. 02 Jul, 2008 1 commit
  12. 01 Jul, 2008 1 commit
    • Guilhem Bichot's avatar
      Back-port of changes made to 6.0-maria (to remove compiler warnings or fix simple test failures) · 3e37fb35
      Guilhem Bichot authored
      in the last days: substitution in tests has to work for absolute datadir (/dev/shm/...);
      internal temp tables (like information_schema) can be Maria; Maria may not be compiled in; splitting
      too long maria.test in two; mtr --embedded runs in mysql-test not mysql-test/var/master-data
      so we need some absolute paths in tests; can't restart mysqld in --embedded; missing DBUG_VOID_RETURN in
      mysqltest.c (fix from Serg); is_collation_character_set_applicability.test was too long name
      which broke tar's 99-char limit.
      3e37fb35
  13. 30 Jun, 2008 4 commits
    • Guilhem Bichot's avatar
      cutting test in two because it takes many things · 6559f5c2
      Guilhem Bichot authored
      mysql-test/r/maria-recovery.result:
        cutting test in two
      mysql-test/r/maria-recovery2.result:
        cutting test in two
      mysql-test/t/maria-recovery.test:
        cutting test in two
      mysql-test/t/maria-recovery2-master.opt:
        cutting test in two
      mysql-test/t/maria-recovery2.test:
        cutting test in two
      6559f5c2
    • Guilhem Bichot's avatar
      Fix for BUG#37288 "Maria - zerofill corrupts table". Testcase is running... · 24257638
      Guilhem Bichot authored
      Fix for BUG#37288 "Maria - zerofill corrupts table". Testcase is running ma_test_recovery.pl on Windows.
      
      storage/maria/ma_blockrec.c:
        comment
      storage/maria/ma_check.c:
        When zerofilling the data file, _ma_compact_block_page() may increase free space in a
        page so bitmap page needs to be corrected.
      24257638
    • Guilhem Bichot's avatar
      Fix for BUG#35107 "maria-preload.test is disabled because causes assertion". · fdebe278
      Guilhem Bichot authored
      maria-preload will be re-enabled later because other pieces of it have possibly random output.
      
      storage/maria/ma_check.c:
        Fix for BUG#35107 "maria-preload.test is disabled because causes assertion".
      fdebe278
    • Guilhem Bichot's avatar
      Fix for unit test failures. · 0432bc1e
      Guilhem Bichot authored
      storage/maria/ma_test1.c:
        rec_length was too short by one byte: at line 299 memcpy(record,read_record,rec_length) thus didn't copy the
        last byte, so 'record' was not ok for use by update_record(), contained an incomplete blob address, sometimes
        crashed on Itanium.
      storage/maria/unittest/ma_test_loghandler_multithread-t.c:
        Tests failed once, never before for hundreds of times, we don't know if test is correct, disabling.
      0432bc1e
  14. 28 Jun, 2008 5 commits
    • Michael Widenius's avatar
      Disable versioning (concurrent writes) if more than one unique key · f27efe69
      Michael Widenius authored
      The reason for this is that if we change one unique key and then get a failure on the second, we may not be able to rename the first one back before someone else writes the same key value.  In Maria 2.0, when we keep deleted key values in the tree, this will not be a problem anymore
      Fixed typedisable concurrent insert/select for SQLCOM_LOAD as there are problems with concurrent threads during index recreation
      
      KNOWN_BUGS.txt:
        More comments
      storage/maria/ha_maria.cc:
        Fixed typo (REPLACE -> INSERT)
        Also disable concurrent insert/select for SQLCOM_LOAD as there are problems with concurrent threads during index recreation
      storage/maria/ma_open.c:
        Disable versioning (concurrent writes) if more than one unique key
      f27efe69
    • Michael Widenius's avatar
      Automatic merge · c5805837
      Michael Widenius authored
      Added some minor changes that was done in my tree while waiting for test to run:
      - Remove in Maria T_QUICK when retrying repair for enabling indexes, as the record file may be in use by other threads
      - Disable code that is only relevant for EXTERNAL_LOCKING
      
      include/m_string.h:
        Automatic merge
      storage/maria/ha_maria.cc:
        Remove T_QUICK when retrying repair for enabling indexes, as the record file may be in use by other threads
      storage/maria/ma_check.c:
        Automatic merge
      storage/maria/ma_key.c:
        Automatic merge
      storage/maria/ma_loghandler.c:
        Automatic merge
      storage/maria/ma_open.c:
        Disable code that is only relevant for EXTERNAL_LOCKING
      storage/maria/ma_sp_key.c:
        Automatic merge
      storage/maria/ma_write.c:
        Automatic merge
      storage/maria/trnman.c:
        Automatic merge
      c5805837
    • Michael Widenius's avatar
      Fix for Bug #37007 Maria: different checksum for MyISAM table depending on CHECKSUM=0|1 · d29e7f74
      Michael Widenius authored
      This also adds a check that MyISAM tables with incompatible checksums are detected by CHECK TABLE ... [FOR UPGRADE] and thus also by mysql_upgrade.
      The tables that are incomatible are MyISAM tables with ROW_FORMAT=fixed and has VARCHAR fields and have CHECKSUM enabled.
      Before these tables gave different checksum if you used CHECK TABLE with or without EXTENDED
      
      mysql-test/r/old-mode.result:
        Now we get same results with and without EXTENDED
      mysql-test/r/row-checksum-old.result:
        Initial results
      mysql-test/r/row-checksum.result:
        Initial results
      mysql-test/t/old-mode.test:
        Added test with QUICK to show that the live checksum is not used when running with --old
      mysql-test/t/row-checksum-old-master.opt:
        Start mysqld with --old mode to enable old checksum code
      mysql-test/t/row-checksum-old.test:
        Run row-checksum test under mysqld --old
      mysql-test/t/row-checksum.test:
        Verify that checksum are calculated the same way with and without EXTENDED
        We run this with several storage engines to ensure results are the same over storage engines
      sql/ha_partition.cc:
        Use new HA_HAS_xxx_CHECKSUM flags
      sql/handler.cc:
        Use new HA_HAS_xxx_CHECKSUM flags
      sql/handler.h:
        Split HA_HAS_CHECKSUM into HA_HAS_NEW_CHECKSUM and HA_HAS_OLD_CHECKSUM flags.
        This is a safe API change as only MyISAM and Maria should use these handler flags.
      sql/sql_show.cc:
        Use new HA_HAS_xxx_CHECKSUM flags
      sql/sql_table.cc:
        Use file->checksum() for live checksums if the life checksum method corresponds to the mysqld --old flag
      storage/maria/ha_maria.cc:
        Use new HA_HAS_xxx_CHECKSUM flags
      storage/myisam/ha_myisam.cc:
        Set HA_HAS_OLD_CHECKSUM and/or HA_HAS_NEW_CHECKSUM flags depending on if this is a new myisam or old myisam file
        Add method check_for_upgrade() to detect if the table is of old version with a checksum that is incompatible with CHECK TABLE ... EXTENDED
      storage/myisam/ha_myisam.h:
        Added check_for_upgrade()
      storage/myisam/mi_open.c:
        Removed not neede cast
        Initialize share->has_null_fields and share->has_varchar_fields variables
      storage/myisam/myisamdef.h:
        Added share->has_null_fields and share->has_varchar_fields
      d29e7f74
    • Sergei Golubchik's avatar
    • Michael Widenius's avatar
      Fix for Bug #36578 Maria: maria-recover may fail to autorepair a table · 9f589947
      Michael Widenius authored
      Fixed also some similar issues in MyISAM. This was not noticed before as MyISAM did a second retry without key cache (which just made the second repair attempty slower)
      
      storage/maria/ha_maria.cc:
        Print information if we retry without quick in case of CHECK TABLE table_name QUICK
        Remove T_QUICK flag when retrying repair, but set T_SAFE_REPAIR to ensure we don't loose any rows
        Remember T_RETRY_WITH_QUICK flag when restoring repair flags
        Don't print 'checking table' if we are not checking table in auto-repair
        Don't use T_QUICK in auto repair (safer)
        Changed parameter of type HA_PARAM &param to HA_PARAM *param
      storage/maria/ha_maria.h:
        Changed parameter of type HA_PARAM &param to HA_PARAM *param
      storage/maria/ma_check.c:
        Added retry without T_QUICK if there is a problem reading a row in BLOCK_RECORD
      storage/myisam/ha_myisam.cc:
        Remove T_QUICK flag when retrying repair, but set T_SAFE_REPAIR to ensure we don't loose any rows
        Remember T_RETRY_WITH_QUICK flag when restoring repair flags
      9f589947
  15. 26 Jun, 2008 5 commits
    • unknown's avatar
      merge · 38d024b5
      unknown authored
      38d024b5
    • unknown's avatar
      Fixed maria-big test failure. · 7b8d4af1
      unknown authored
      storage/maria/ma_loghandler.c:
        Processed case when current buffer filled but there is no new LSN in the buffer generated (so it is no need to fluesh this buffer) and buffer->last_lsn is LSN_IMPOSSIBLE.
      7b8d4af1
    • Guilhem Bichot's avatar
      Fixes for build errors under Windows and compiler warning under Linux · f0c53638
      Guilhem Bichot authored
      include/m_string.h:
        new macro like LINT_INIT but for struct. In m_string.h because bzero() becomes available only there
      storage/maria/ma_check.c:
        compiler error under Windows (declaration after statements...)
      storage/maria/ma_key.c:
        trnman.h is not in include/ but in storage/maria
      storage/maria/ma_sp_key.c:
        trnman.h is not in include/ but in storage/maria
      storage/maria/ma_write.c:
        avoid compiler warning (org_key.flag may be used uninitialized)
      f0c53638
    • Michael Widenius's avatar
      Merge; No notable changes · 1d726038
      Michael Widenius authored
      .bzr-mysql/default.conf:
        Automatic merge
      config/ac-macros/plugins.m4:
        Automatic merge
      configure.in:
        Automatic merge
      include/my_global.h:
        Automatic merge
      mysql-test/include/maria_empty_logs.inc:
        Use Guilmhems version, but don't echo use database
      mysql-test/r/maria-no-logging.result:
        Automatic merge
      mysql-test/r/maria-page-checksum.result:
        Automatic merge
      mysql-test/r/maria-recover.result:
        Automatic merge
      mysql-test/r/maria2.result:
        Automatic merge
      mysql-test/t/maria-no-logging.test:
        Automatic merge
      mysql-test/t/maria-page-checksum.test:
        Automatic merge
      mysql-test/t/maria-purge.test:
        Automatic merge
      mysql-test/t/maria-recover.test:
        Automatic merge
      mysql-test/t/maria2.test:
        Automatic merge
      sql/sql_table.cc:
        Automatic merge
      storage/maria/CMakeLists.txt:
        Automatic merge
      storage/maria/ma_ft_parser.c:
        Automatic merge
      storage/maria/ma_loghandler.c:
        Automatic merge
      storage/maria/ma_recovery.c:
        Automatic merge
      storage/maria/ma_rt_test.c:
        Manual merge
      storage/maria/ma_state.c:
        Automatic merge
      storage/maria/ma_test_force_start.pl:
        Automatic merge
      storage/maria/plug.in:
        Automatic merge
      storage/maria/unittest/CMakeLists.txt:
        Automatic merge
      storage/maria/unittest/Makefile.am:
        Automatic merge
      storage/maria/unittest/ma_test_all-t:
        Automatic merge
      storage/maria/unittest/ma_test_loghandler_multithread-t.c:
        Automatic merge
      storage/maria/unittest/ma_test_recovery.pl:
        Automatic merge
      storage/myisam/rt_test.c:
        Automatic merge
      1d726038
    • Michael Widenius's avatar
      Added versioning of Maria index · 52cb0c24
      Michael Widenius authored
      Store max_trid in index file as state.create_trid. This is used to pack all transids in the index pages relative to max possible transid for file.
      Enable versioning for transactional tables with index. Tables with an auto-increment key, rtree or fulltext keys are not versioned.
      Changed info->lastkey to type MARIA_KEY. Removed info->lastkey_length as this is now part of info->lastkey
      Renamed old info->lastkey to info->lastkey_buff
      Use exact key lenghts for keys, not USE_WHOLE_KEY
      For partial key searches, use SEARCH_PART_KEY
      When searching to insert new key on page, use SEARCH_INSERT to mark that key has rowid
      
      Changes done in a lot of files:
      - Modified functions to use MARIA_KEY instead of key pointer and key length
      - Use keyinfo->root_lock instead of share->key_root_lock[keynr]
      - Simplify code by using local variable keyinfo instead if share->keyinfo[i]
      - Added #fdef EXTERNAL_LOCKING around removed state elements
      - HA_MAX_KEY_BUFF -> MARIA_MAX_KEY_BUFF (to reserve space for transid)
      - Changed type of 'nextflag' to uint32 to ensure all SEARCH_xxx flags fits into it
      
      .bzrignore:
        Added missing temporary directory
      extra/Makefile.am:
        comp_err is now deleted on make distclean
      include/maria.h:
        Added structure MARIA_KEY, which is used for intern key objects in Maria.
        Changed functions to take MARIA_KEY as an argument instead of pointer to packed key.
        Changed some functions that always return true or false to my_bool.
        Added virtual function make_key() to avoid if in _ma_make_key()
        Moved rw_lock_t for locking trees from share->key_root_lock to MARIA_KEYDEF. This makes usage of the locks simpler and faster
      include/my_base.h:
        Added HA_RTREE_INDEX flag to mark rtree index. Used for easier checks in ma_check()
        Added SEARCH_INSERT to be used when inserting new keys
        Added SEARCH_PART_KEY for partial searches
        Added SEARCH_USER_KEY_HAS_TRANSID to be used when key we use for searching in btree has a TRANSID
        Added SEARCH_PAGE_KEY_HAS_TRANSID to be used when key we found in btree has a transid
      include/my_handler.h:
        Make next_flag 32 bit to make sure we can handle all SEARCH_ bits
      mysql-test/include/maria_empty_logs.inc:
        Read and restore current database; Don't assume we are using mysqltest.
        Don't log use databasename to log. Using this include should not cause any result changes.
      mysql-test/r/maria-gis-rtree-dynamic.result:
        Updated results after adding some check table commands to help pinpoint errors
      mysql-test/r/maria-mvcc.result:
        New tests
      mysql-test/r/maria-purge.result:
        New result after adding removal of logs
      mysql-test/r/maria-recovery-big.result:
        maria_empty_logs doesn't log 'use mysqltest' anymore
      mysql-test/r/maria-recovery-bitmap.result:
        maria_empty_logs doesn't log 'use mysqltest' anymore
      mysql-test/r/maria-recovery-rtree-ft.result:
        maria_empty_logs doesn't log 'use mysqltest' anymore
      mysql-test/r/maria-recovery.result:
        maria_empty_logs doesn't log 'use mysqltest' anymore
      mysql-test/r/maria.result:
        New tests
      mysql-test/r/variables-big.result:
        Don't log id as it's not predictable
      mysql-test/suite/rpl_ndb/r/rpl_truncate_7ndb_2.result:
        Updated results to new binlog results. (Test has not been run in a long time as it requires --big)
      mysql-test/suite/rpl_ndb/t/rpl_truncate_7ndb_2-master.opt:
        Moved file to ndb replication test directory
      mysql-test/suite/rpl_ndb/t/rpl_truncate_7ndb_2.test:
        Fixed wrong path to included tests
      mysql-test/t/maria-gis-rtree-dynamic.test:
        Added some check table commands to help pinpoint errors
      mysql-test/t/maria-mvcc.test:
        New tests
      mysql-test/t/maria-purge.test:
        Remove logs to make test results predictable
      mysql-test/t/maria.test:
        New tests for some possible problems
      mysql-test/t/variables-big.test:
        Don't log id as it's not predictable
      mysys/my_handler.c:
        Updated function comment to reflect old code
        Changed nextflag to be uint32 to ensure we can have flags > 16 bit
        Changed checking if we are in insert with NULL keys as next_flag can now include additional bits that have to be ignored.
        Added SEARCH_INSERT flag to be used when inserting new keys in btree. This flag tells us the that the keys includes row position and it's thus safe to remove SEARCH_FIND
        Added comparision of transid. This is only done if the keys actually have a transid, which is indicated by nextflag
      mysys/my_lock.c:
        Fixed wrong test (Found by Guilhem)
      scripts/Makefile.am:
        Ensure that test programs are deleted by make clean
      sql/rpl_rli.cc:
        Moved assignment order to fix compiler warning
      storage/heap/hp_write.c:
        Add SEARCH_INSERT to signal ha_key_cmp that we we should also compare rowid for keys
      storage/maria/Makefile.am:
        Remove also maria log files when doing make distclean
      storage/maria/ha_maria.cc:
        Use 'file->start_state' as default state for transactional tables without versioning
        At table unlock, set file->state to point to live state. (Needed for information schema to pick up right number of rows)
        In ha_maria::implicit_commit() move all locked (ie open) tables to new transaction. This is needed to ensure ha_maria->info doesn't point to a deleted history event.
        Disable concurrent inserts for insert ... select and table changes with subqueries if statement based replication as this would cause wrong results on slave
      storage/maria/ma_blockrec.c:
        Updated comment
      storage/maria/ma_check.c:
        Compact key pages (removes transid) when doing --zerofill
        Check that 'page_flag' on key pages contains KEYPAGE_FLAG_HAS_TRANSID if there is a single key on the page with a transid
        Modified functions to use MARIA_KEY instead of key pointer and key length
        Use new interface to _ma_rec_pos(), _ma_dpointer(), _ma_ft_del(), ma_update_state_lsn()
        Removed not needed argument from get_record_for_key()
        Fixed that we check doesn't give errors for RTREE; We now treath these like SPATIAL
        Remove some SPATIAL specific code where the virtual functions can handle this in a general manner
        Use info->lastkey_buff instead of info->lastkey
        _ma_dpos() -> _ma_row_pos_from_key()
        _ma_make_key() -> keyinfo->make_key()
        _ma_print_key() -> _ma_print_keydata()
        _ma_move_key() -> ma_copy_copy()
        Add SEARCH_INSERT to signal ha_key_cmp that we we should also compare rowid for keys
        Ensure that data on page doesn't overwrite page checksum position
        Use DBUG_DUMP_KEY instead of DBUG_DUMP
        Use exact key lengths instead of USE_WHOLE_KEY to ha_key_cmp()
        Fixed check if rowid points outside of BLOCK_RECORD data file
        Use info->lastkey_buff instead of key on stack in some safe places
        Added #fdef EXTERNAL_LOCKING around removed state elements
      storage/maria/ma_close.c:
        Use keyinfo->root_lock instead of share->key_root_lock[keynr]
      storage/maria/ma_create.c:
        Removed assert that is already checked in maria_init()
        Force transactinal tables to be of type BLOCK_RECORD
        Fixed wrong usage of HA_PACK_RECORD (should be HA_OPTION_PACK_RECORD)
        Mark keys that uses HA_KEY_ALG_RTREE with HA_RTREE_INDEX for easier handling of these in ma_check
        Store max_trid in index file as state.create_trid. This is used to pack all transids in the index pages relative to max possible transid for file.
      storage/maria/ma_dbug.c:
        Changed _ma_print_key() to use MARIA_KEY
      storage/maria/ma_delete.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        info->lastkey2-> info->lastkey_buff2
        Added SEARCH_INSERT to signal ha_key_cmp that we we should also compare rowid for keys
        Use new interface for get_key(), _ma_get_last_key() and others
        _ma_dpos() -> ma_row_pos_from_key()
        Simplify setting of prev_key in del()
        Ensure that KEYPAGE_FLAG_HAS_TRANSID is set in page_flag if key page has transid
        Treath key pages that may have a transid as if keys would be of variable length
      storage/maria/ma_delete_all.c:
        Reset history state if maria_delete_all_rows() are called
        Update parameters to _ma_update_state_lsns() call
      storage/maria/ma_extra.c:
        Store and restore info->lastkey
      storage/maria/ma_ft_boolean_search.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
      storage/maria/ma_ft_nlq_search.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        Use lastkey_buff2 instead of info->lastkey+info->s->base.max_key_length (same thing)
      storage/maria/ma_ft_update.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
      storage/maria/ma_ftdefs.h:
        Modified functions to use MARIA_KEY instead of key pointer and key length
      storage/maria/ma_fulltext.h:
        Modified functions to use MARIA_KEY instead of key pointer and key length
      storage/maria/ma_init.c:
        Check if blocksize is legal
        (Moved test here from ma_open())
      storage/maria/ma_key.c:
        Added functions for storing/reading of transid 
        Modified functions to use MARIA_KEY instead of key pointer and key length
        Moved _ma_sp_make_key() out of _ma_make_key() as we now use keyinfo->make_key to create keys
        Add transid to keys if table is versioned
        Added _ma_copy_key()
      storage/maria/ma_key_recover.c:
        Add logging of page_flag (holds information if there are keys with transid on page)
        Changed DBUG_PRINT("info" -> DBUG_PRINT("redo" as the redo logging can be quite extensive
        Added lots of DBUG_PRINT()
        Added support for index page operations: KEY_OP_SET_PAGEFLAG and KEY_OP_COMPACT_PAGE
      storage/maria/ma_key_recover.h:
        Modified functions to use MARIA_KEY instead of key pointer and key length
      storage/maria/ma_locking.c:
        Added new arguments to _ma_update_state_lsns_sub()
      storage/maria/ma_loghandler.c:
        Fixed all logging of LSN to look similar in DBUG log
        Changed if (left != 0) to if (left) as the later is used also later in the code
      storage/maria/ma_loghandler.h:
        Added new index page operations
      storage/maria/ma_open.c:
        Removed allocated "state_dummy" and instead use share->state.common for transactional tables that are not versioned
        This is needed to not get double increments of state.records (one in ma_write.c and on when log is written)
        Changed info->lastkey to MARIA_KEY type
        Removed resetting of MARIA_HA variables that have 0 as default value (as info is zerofilled)
        Enable versioning for transactional tables with index. Tables with an auto-increment key, rtree or fulltext keys are not versioned.
        Check on open that state.create_trid is correct
        Extend share->base.max_key_length in case of transactional table so that it can hold transid
        Removed 4.0 compatible fulltext key mode as this is not relevant for Maria
        Removed old and wrong #ifdef ENABLE_WHEN_WE_HAVE_TRANS_ROW_ID code block
        Initialize all new virtual function pointers
        Removed storing of state->unique, state->process and store state->create_trid instead
      storage/maria/ma_page.c:
        Added comment to describe key page structure
        Added functions to compact key page and log the compact operation
      storage/maria/ma_range.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        Use SEARCH_PART_KEY indicator instead of USE_WHOLE_KEY to detect if we are doing a part key search
        Added handling of pages with transid
      storage/maria/ma_recovery.c:
        Don't assert if table we opened are not transactional. This may be a table which has been changed from transactional to not transactinal
        Added new arguments to _ma_update_state_lsns()
      storage/maria/ma_rename.c:
        Added new arguments to _ma_update_state_lsns()
      storage/maria/ma_rkey.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        Don't use USE_WHOLE_KEY, use real length of key
        Use share->row_is_visible() to test if row is visible
        Moved search_flag == HA_READ_KEY_EXACT out of 'read-next-row' loop as this only need to be tested once
        Removed test if last_used_keyseg != 0 as this is always true
      storage/maria/ma_rnext.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        Simplify code by using local variable keyinfo instead if share->keyinfo[i]
        Use share->row_is_visible() to test if row is visible
      storage/maria/ma_rnext_same.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        lastkey2 -> lastkey_buff2
      storage/maria/ma_rprev.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        Simplify code by using local variable keyinfo instead if share->keyinfo[i]
        Use share->row_is_visible() to test if row is visible
      storage/maria/ma_rsame.c:
        Updated comment
        Simplify code by using local variable keyinfo instead if share->keyinfo[i]
        Modified functions to use MARIA_KEY instead of key pointer and key length
      storage/maria/ma_rsamepos.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
      storage/maria/ma_rt_index.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        Use better variable names
        Removed not needed casts
        _ma_dpos() -> _ma_row_pos_from_key()
        Use info->last_rtree_keypos to save position to key instead of info->int_keypos
        Simplify err: condition
        Changed return type for maria_rtree_insert() to my_bool as we are only intressed in ok/fail from this function
      storage/maria/ma_rt_index.h:
        Modified functions to use MARIA_KEY instead of key pointer and key length
      storage/maria/ma_rt_key.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        Simplify maria_rtree_add_key by combining idenitcal code and removing added_len
      storage/maria/ma_rt_key.h:
        Modified functions to use MARIA_KEY instead of key pointer and key length
      storage/maria/ma_rt_mbr.c:
        Changed type of 'nextflag' to uint32
        Added 'to' argument to RT_PAGE_MBR_XXX functions to more clearly see which variables changes value
      storage/maria/ma_rt_mbr.h:
        Changed type of 'nextflag' to uint32
      storage/maria/ma_rt_split.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        key_length -> key_data_length to catch possible errors
      storage/maria/ma_rt_test.c:
        Fixed wrong comment
        Reset recinfo to avoid valgrind varnings
        Fixed wrong argument to create_record() that caused test to fail
      storage/maria/ma_search.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        Added support of keys with optional trid
        Test for SEARCH_PART_KEY instead of USE_WHOLE_KEY to detect part key reads
        _ma_dpos() -> _ma_row_pos_from_key()
        If there may be keys with transid on the page, have _ma_bin_search() call _ma_seq_search()
        Add _ma_skip_xxx() functions to quickly step over keys (faster than calling get_key() in most cases as we don't have to copy key data)
        Combine similar code at end of _ma_get_binary_pack_key()
        Removed not used function _ma_move_key()
        In _ma_search_next() don't call _ma_search() if we aren't on a nod page.
        Update info->cur_row.trid with trid for found key
        
        
        
        Removed some not needed casts
        Added _ma_trid_from_key()
        Use MARIA_SHARE instead of MARIA_HA as arguments to _ma_rec_pos(), _ma_dpointer() and _ma_xxx_keypos_to_recpos() to make functions faster and smaller
      storage/maria/ma_sort.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
      storage/maria/ma_sp_defs.h:
        _ma_sp_make_key() now fills in and returns (MARIA_KEY *) value
      storage/maria/ma_sp_key.c:
        _ma_sp_make_key() now fills in and returns (MARIA_KEY *) value
        Don't test sizeof(double), test against 8 as we are using float8store()
        Use mi_float8store() instead of doing swap of value (same thing but faster)
      storage/maria/ma_state.c:
        maria_versioning() now only calls _ma_block_get_status() if table supports versioning
        Added _ma_row_visible_xxx() functions for different occasions
        When emptying history, set info->state to point to the first history event.
      storage/maria/ma_state.h:
        Added _ma_row_visible_xxx() prototypes
      storage/maria/ma_static.c:
        Indentation changes
      storage/maria/ma_statrec.c:
        Fixed arguments to _ma_dpointer() and _ma_rec_pos()
      storage/maria/ma_test1.c:
        Call init_thr_lock() if we have versioning
      storage/maria/ma_test2.c:
        Call init_thr_lock() if we have versioning
      storage/maria/ma_unique.c:
        Modified functions to use MARIA_KEY
      storage/maria/ma_update.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
      storage/maria/ma_write.c:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        Simplify code by using local variable keyinfo instead if share->keyinfo[i]
        In _ma_enlarge_root(), mark in page_flag if new key has transid
        _ma_dpos() -> _ma_row_pos_from_key()
        Changed return type of _ma_ck_write_tree() to my_bool as we are only testing if result is true or not
        Moved 'reversed' to outside block as area was used later
      storage/maria/maria_chk.c:
        Added error if trying to sort with HA_BINARY_PACK_KEY
        Use new interface to get_key() and _ma_dpointer()
        _ma_dpos() -> _ma_row_pos_from_key()
      storage/maria/maria_def.h:
        Modified functions to use MARIA_KEY instead of key pointer and key length
        Added 'common' to MARIA_SHARE->state for storing state for transactional tables without versioning
        Added create_trid to MARIA_SHARE
        Removed not used state variables 'process' and 'unique'
        Added defines for handling TRID's in index pages
        Changed to use MARIA_SHARE instead of MARIA_HA for some functions
        Added 'have_versioning' flag if table supports versioning
        Moved key_root_lock from MARIA_SHARE to MARIA_KEYDEF
        Changed last_key to be of type MARIA_KEY. Removed lastkey_length
        lastkey -> lastkey_buff, lastkey2 -> lastkey_buff2
        Added _ma_get_used_and_nod_with_flag() for faster access to page data when page_flag is read
        Added DBUG_DUMP_KEY for easier DBUG_DUMP of a key
        Changed 'nextflag' and assocaited variables to uint32
      storage/maria/maria_ftdump.c:
        lastkey -> lastkey_buff
      storage/maria/trnman.c:
        Fixed wrong initialization of min_read_from and max_commit_trid
        Added trnman_get_min_safe_trid()
      storage/maria/unittest/ma_test_all-t:
        Added --start-from
      storage/myisam/mi_check.c:
        Added SEARCH_INSERT, as ha_key_cmp() needs it when doing key comparision for inserting key on page in rowid order
      storage/myisam/mi_delete.c:
        Added SEARCH_INSERT, as ha_key_cmp() needs it when doing key comparision for inserting key on page in rowid order
      storage/myisam/mi_range.c:
        Updated comment
      storage/myisam/mi_write.c:
        Added SEARCH_INSERT, as ha_key_cmp() needs it when doing key comparision for inserting key on page in rowid order
      storage/myisam/rt_index.c:
        Fixed wrong parameter to rtree_get_req() which could cause crash
      52cb0c24
  16. 24 Jun, 2008 1 commit
  17. 16 Jun, 2008 1 commit
  18. 13 Jun, 2008 2 commits
    • Guilhem Bichot's avatar
      Port of ma_test_force_start.pl (test program for... · 771a66ea
      Guilhem Bichot authored
      Port of ma_test_force_start.pl (test program for --maria-force-start-after-recovery-failures) to Windows.
      
      storage/maria/ma_test_force_start.pl:
        port to Windows: detection of where 'mysql' command-line client is (debug/release/etc)), .exe suffix,
        --console instead of --mem, --P instead of --socket, taskkill instead of perl's kill.
      771a66ea
    • Guilhem Bichot's avatar
      disabling lockman2-t: takes too much time for a unit test (>=15 min), and what it · 26f685e7
      Guilhem Bichot authored
      tests is not used in Maria, this fixes BUG#34744 "Maria Unit test "lockman2" fails
      on Mac OS X 10.4 PowerPC 64-bit"
      
      storage/maria/unittest/CMakeLists.txt:
        disabling lockman2-t
      storage/maria/unittest/Makefile.am:
        disabling lockman2-t
      26f685e7
  19. 12 Jun, 2008 1 commit