1. 20 Nov, 2007 1 commit
  2. 20 Jun, 2007 1 commit
  3. 18 Jun, 2007 1 commit
  4. 14 Jun, 2007 1 commit
    • unknown's avatar
      bug#29099 - slow backup for disk data · e59c1f5d
      unknown authored
      - implement read ahead during disk data scan
      
      
      storage/ndb/src/kernel/blocks/dbtup/Dbtup.hpp:
        maximum read ahead
      storage/ndb/src/kernel/blocks/dbtup/DbtupGen.cpp:
        maximum read ahead should not be larger than page buffer size
        maximum aslo set to 32 pages
      storage/ndb/src/kernel/blocks/dbtup/DbtupScan.cpp:
        read ahead for disk data scan
      storage/ndb/src/kernel/blocks/pgman.cpp:
        set higher max_io_waits for read ahead
        round off upwards in page_buffer size
      storage/ndb/src/kernel/vm/SimulatedBlock.cpp:
        add null callback to be used for read ahead (no callback needed)
      storage/ndb/src/kernel/vm/SimulatedBlock.hpp:
        add null callback to be used for read ahead (no callback needed)
      storage/ndb/src/ndbapi/TransporterFacade.cpp:
        remove the debug trace, not needed any more
      storage/ndb/test/tools/hugoFill.cpp:
        allow setting database in hugoFill
      e59c1f5d
  5. 12 Jun, 2007 3 commits
    • unknown's avatar
      Bug#29044 - memory buddy allocator "unoptimal" memory handling · 805d32bd
      unknown authored
      - add config param to have better behavior with large tables
      
      
      805d32bd
    • unknown's avatar
      extend backup dump to give more info · 98e08c79
      unknown authored
      98e08c79
    • unknown's avatar
      ndb - bug#29044 · 1f90b253
      unknown authored
        Improve buddy high order allocation
        Make removeCommonArea O(1) instead of O(N)
        Add limit to left/right search
      
      
      storage/ndb/src/kernel/blocks/dbtup/DbtupDebug.cpp:
        Add info to buddy module test about 
        1) loops being made in buddy
        2) how much was allocated
      storage/ndb/src/kernel/blocks/dbtup/DbtupPagMan.cpp:
        1) make removeCommonArea o(1) - as list is (after fix) double linked anyway
        2) set page_state = ZFREE_COMMON insertCommonArea and ~ZFREE_COMMON in removeCommonArea
        3) add max loops in search left/right
        4) add more debug info
      1f90b253
  6. 05 Jun, 2007 3 commits
    • unknown's avatar
      Merge tulin@bk-internal.mysql.com:/home/bk/mysql-5.1-telco-gca · 98708b01
      unknown authored
      into  poseidon.mysql.com:/home/tomas/mysql-5.1-telco-gca
      
      
      mysql-test/ndb/ndb_config_2_node.ini:
        Auto merged
      storage/ndb/include/mgmapi/mgmapi_config_parameters.h:
        Auto merged
      storage/ndb/src/kernel/blocks/dblqh/Dblqh.hpp:
        Auto merged
      storage/ndb/src/kernel/blocks/dblqh/DblqhInit.cpp:
        Auto merged
      storage/ndb/src/kernel/blocks/ndbcntr/NdbcntrMain.cpp:
        Auto merged
      storage/ndb/src/mgmsrv/ConfigInfo.cpp:
        Auto merged
      storage/ndb/src/kernel/blocks/dblqh/DblqhMain.cpp:
        manual merge
      98708b01
    • unknown's avatar
      Bug #28751 Lots of memory locked in memory causes high kswapd · 35b2f212
      unknown authored
      - add odirect option for lcp+backup+redo log to lower CPU/kswapd usage
      - writing odirect removes need for kernel write buffers avoiding kswapd to kick in
      
      
      mysql-test/ndb/ndb_config_2_node.ini:
        run mysql-test-run using ODirect
      storage/ndb/include/mgmapi/mgmapi_config_parameters.h:
        add new config parameter to choose ODirect
      storage/ndb/include/ndb_global.h.in:
        specify alignment needed for odirect
      storage/ndb/src/kernel/blocks/backup/Backup.cpp:
        read odirect config param
        open LCP and Backup datafiles with odirect if specified
        insert empty padding record if odirect is used
        allocate buffers aligned to be able to use odirect
      storage/ndb/src/kernel/blocks/backup/Backup.hpp:
        odirect and padding options
      storage/ndb/src/kernel/blocks/backup/BackupFormat.hpp:
        add empty_record in file format
      storage/ndb/src/kernel/blocks/backup/BackupInit.cpp:
        read odirect config and allocate aligned
      storage/ndb/src/kernel/blocks/backup/FsBuffer.hpp:
        correct debug printouts
      storage/ndb/src/kernel/blocks/dblqh/Dblqh.hpp:
        read odirect config param and align buffers
      storage/ndb/src/kernel/blocks/dblqh/DblqhInit.cpp:
        read odirect config param and align buffers
      storage/ndb/src/kernel/blocks/dblqh/DblqhMain.cpp:
        read config params and open redo log files with odirect if set
      storage/ndb/src/kernel/blocks/ndbfs/AsyncFile.cpp:
        aligned writing for odirect
        correct odirect open options with test+fallback if odirect fails
      storage/ndb/src/kernel/blocks/ndbfs/AsyncFile.hpp:
        align + odirect check
      storage/ndb/src/kernel/blocks/restore.cpp:
        restor block to ignore new lcp padding empty_record
      storage/ndb/src/kernel/vm/SimulatedBlock.cpp:
        alligend log buffer allocation for odirect
      storage/ndb/src/kernel/vm/SimulatedBlock.hpp:
        alligend log buffer allocation for odirect
      storage/ndb/src/mgmsrv/ConfigInfo.cpp:
        new config param for odirect, default false
      storage/ndb/tools/restore/Restore.cpp:
        ndb_restore to skip empty_record alignment padding in backup file
      35b2f212
    • unknown's avatar
      Bug #28899 not possible to set separate watchdog timeout at startup · 1182b801
      unknown authored
      
      storage/ndb/include/mgmapi/mgmapi_config_parameters.h:
        add new configuration parameter TimeBetweenWatchDogCheckInitial
      storage/ndb/include/portlib/NdbTick.h:
        enable timing code
      storage/ndb/src/common/portlib/NdbTick.c:
        enable timing code
      storage/ndb/src/kernel/blocks/ndbcntr/NdbcntrMain.cpp:
        read watchdog timeout to set it after malloc
      storage/ndb/src/kernel/vm/Configuration.cpp:
        read initial watchdog timeout and set it in the beginning
      storage/ndb/src/kernel/vm/Configuration.hpp:
        read initial watchdog timeout and set it in the beginning
      storage/ndb/src/kernel/vm/SimulatedBlock.cpp:
        introduce new state for "action" malloc of memory
      storage/ndb/src/kernel/vm/SimulatedBlock.hpp:
        introduce new state for "action" malloc of memory
      storage/ndb/src/kernel/vm/WatchDog.cpp:
        rewrite watchdog to check every 100ms for being stuch, but keep shutdown after 3 * interval
        for "action" == 9 (malloc)  keep old behavior and only output every interval
      storage/ndb/src/mgmsrv/ConfigInfo.cpp:
        add new configuration parameter TimeBetweenWatchDogCheckInitial
      1182b801
  7. 04 Jun, 2007 2 commits
    • unknown's avatar
      ndb - bug#28726 · 253c2808
      unknown authored
        make sure to remove LCP files aswell if specifying --initial
      
      
      storage/ndb/src/kernel/blocks/ndbcntr/NdbcntrMain.cpp:
        Add removal of LCP/X directories
      253c2808
    • unknown's avatar
      ndb - make size of redo log files (fragment log files) configurable · c8e0d0db
      unknown authored
        using new config variable FragmentLogFileSize (4M - 1G)
      
      
      mysql-test/ndb/ndb_config_1_node.ini:
        change log file size (test)
      mysql-test/ndb/ndb_config_2_node.ini:
        change log file size (test)
      storage/ndb/include/mgmapi/mgmapi_config_parameters.h:
        add new confif parameter
      storage/ndb/src/kernel/blocks/dblqh/Dblqh.hpp:
        make logfile size configurable
      storage/ndb/src/kernel/blocks/dblqh/DblqhInit.cpp:
        make logfile size configurable
      storage/ndb/src/kernel/blocks/dblqh/DblqhMain.cpp:
        make logfile size configurable
      storage/ndb/src/mgmsrv/ConfigInfo.cpp:
        add new config variable
      storage/ndb/src/ndbapi/ndberror.c:
        update error message
      c8e0d0db
  8. 03 Jun, 2007 1 commit
    • unknown's avatar
      Bug#20612. · 1a166bc4
      unknown authored
      
      storage/ndb/src/kernel/blocks/pgman.cpp:
        a) in one case pl_queue.remove(ptr) was not followed
        by state &= ~ Page_entry::ONQUEUE.
        
        b) when collecting initial hot entries have to remove
        from queue if somehow got there.
        
        b) is easy to get with large buffer cache (256M).
        a) or b) is probably cause of bug#20612.
      1a166bc4
  9. 30 May, 2007 4 commits
  10. 29 May, 2007 6 commits
    • unknown's avatar
      shorten some files for tar to work · a14059db
      unknown authored
      
      storage/ndb/ndbapi-examples/ndbapi_simple_index/main.cpp:
        Rename: storage/ndb/ndbapi-examples/ndbapi_simple_index/ndbapi_simple_index.cpp -> storage/ndb/ndbapi-examples/ndbapi_simple_index/main.cpp
      storage/ndb/ndbapi-examples/mgmapi_logevent/main.cpp:
        Rename: storage/ndb/ndbapi-examples/mgmapi_logevent/mgmapi_logevent.cpp -> storage/ndb/ndbapi-examples/mgmapi_logevent/main.cpp
      storage/ndb/ndbapi-examples/mgmapi_logevent2/main.cpp:
        Rename: storage/ndb/ndbapi-examples/mgmapi_logevent2/mgmapi_logevent2.cpp -> storage/ndb/ndbapi-examples/mgmapi_logevent2/main.cpp
      storage/ndb/src/kernel/blocks/dblqh/redoLogReader/reader.cpp:
        Rename: storage/ndb/src/kernel/blocks/dblqh/redoLogReader/redoLogFileReader.cpp -> storage/ndb/src/kernel/blocks/dblqh/redoLogReader/reader.cpp
      storage/ndb/ndbapi-examples/ndbapi_simple_dual/main.cpp:
        Rename: storage/ndb/ndbapi-examples/ndbapi_simple_dual/ndbapi_simple_dual.cpp -> storage/ndb/ndbapi-examples/ndbapi_simple_dual/main.cpp
      a14059db
    • unknown's avatar
      Merge tulin@bk-internal.mysql.com:/home/bk/mysql-5.1-telco-gca · 92bea0c3
      unknown authored
      into  whalegate.ndb.mysql.com:/home/tomas/mysql-5.1-telco-gca
      
      
      92bea0c3
    • unknown's avatar
      Merge joreland@bk-internal.mysql.com:/home/bk/mysql-5.1-telco-gca · 4efc39f9
      unknown authored
      into  perch.ndb.mysql.com:/home/jonas/src/51-telco-gca
      
      
      storage/ndb/src/kernel/blocks/dblqh/Dblqh.hpp:
        Auto merged
      storage/ndb/src/kernel/blocks/dblqh/DblqhMain.cpp:
        Auto merged
      storage/ndb/src/kernel/blocks/dbtup/DbtupScan.cpp:
        Auto merged
      storage/ndb/test/run-test/daily-basic-tests.txt:
        Auto merged
      4efc39f9
    • unknown's avatar
      Merge perch.ndb.mysql.com:/home/jonas/src/50-work · 34cbf35e
      unknown authored
      into  perch.ndb.mysql.com:/home/jonas/src/51-telco-gca
      
      
      storage/ndb/test/run-test/daily-basic-tests.txt:
        merge
      34cbf35e
    • unknown's avatar
      Merge perch.ndb.mysql.com:/home/jonas/src/41-work · f75c300a
      unknown authored
      into  perch.ndb.mysql.com:/home/jonas/src/50-work
      
      
      ndb/test/run-test/daily-basic-tests.txt:
        merge
      f75c300a
    • unknown's avatar
      ndb - fix typo · bfc82a63
      unknown authored
      bfc82a63
  11. 28 May, 2007 6 commits
  12. 25 May, 2007 1 commit
    • unknown's avatar
      Bug #28525 Node failures in PGMAN at ndbrequire (line 430) · babe38a4
      unknown authored
      
      storage/ndb/src/kernel/blocks/pgman.cpp:
        Under heavy insert PGMAN can run out of page entries
        even when set to 100 times page cache entries.
        
        In this use pattern the extra entries remain idle
        on LIRS stack.  Only ONSTACK is set.  There is not
        enough activity to free them the normal way.
        
        A study of PGMAN / DBTUP behaviour is needed.
        
        This patch adds new sublist SL_IDLE.  When page entry
        pool is empty, an idle entry is released from SL_IDLE
        front if there is any.  Otherwise, we still crash.
        
        The factor above is set from 100 to 10 (still high).
      storage/ndb/src/kernel/blocks/pgman.hpp:
        Under heavy insert PGMAN can run out of page entries
        even when set to 100 times page cache entries.
        
        In this use pattern the extra entries remain idle
        on LIRS stack.  Only ONSTACK is set.  There is not
        enough activity to free them the normal way.
        
        A study of PGMAN / DBTUP behaviour is needed.
        
        This patch adds new sublist SL_IDLE.  When page entry
        pool is empty, an idle entry is released from SL_IDLE
        front if there is any.  Otherwise, we still crash.
        
        The factor above is set from 100 to 10 (still high).
      babe38a4
  13. 24 May, 2007 2 commits
  14. 22 May, 2007 1 commit
    • unknown's avatar
      Bug #28593 cluster backup scans in acc index order, bad for disk data · f77ba282
      unknown authored
      - change to scan in tup and disk order (if applicable)
      
      
      storage/ndb/src/kernel/blocks/backup/Backup.cpp:
        tup scan for backup also, not only lcp
      storage/ndb/src/kernel/blocks/dblqh/DblqhMain.cpp:
        choose disk order scan for disktables during backup
        + move bug workaround for 27776 from tup to lqh
      storage/ndb/src/kernel/blocks/dbtup/DbtupDiskAlloc.cpp:
        add missing jamEntry
      storage/ndb/src/kernel/blocks/dbtup/DbtupScan.cpp:
        move bug workaround for 27776 from tup to lqh
      storage/ndb/src/kernel/blocks/pgman.cpp:
        missing jamEntry
      f77ba282
  15. 18 May, 2007 7 commits
    • unknown's avatar
      Merge perch.ndb.mysql.com:/home/jonas/src/50-work · c40e8752
      unknown authored
      into  perch.ndb.mysql.com:/home/jonas/src/51-telco-gca
      
      
      storage/ndb/src/kernel/blocks/cmvmi/Cmvmi.cpp:
        Auto merged
      c40e8752
    • unknown's avatar
      Merge perch.ndb.mysql.com:/home/jonas/src/41-work · be77fa28
      unknown authored
      into  perch.ndb.mysql.com:/home/jonas/src/50-work
      
      
      ndb/src/kernel/blocks/cmvmi/Cmvmi.cpp:
        Auto merged
      be77fa28
    • unknown's avatar
      ndb - bug#28443 · deba58ee
      unknown authored
        review comment 2, atleast 1 signal need for test prg
      
      
      ndb/src/kernel/blocks/cmvmi/Cmvmi.cpp:
        review comment, atleast 1 signal need
      deba58ee
    • unknown's avatar
      Merge perch.ndb.mysql.com:/home/jonas/src/50-work · c979e32a
      unknown authored
      into  perch.ndb.mysql.com:/home/jonas/src/51-telco-gca
      
      
      storage/ndb/src/common/transporter/TransporterRegistry.cpp:
        merge
      c979e32a
    • unknown's avatar
      Merge perch.ndb.mysql.com:/home/jonas/src/41-work · d1625447
      unknown authored
      into  perch.ndb.mysql.com:/home/jonas/src/50-work
      
      
      ndb/src/common/transporter/TransporterRegistry.cpp:
        Auto merged
      d1625447
    • unknown's avatar
      ndb - bug#28443 · a5731933
      unknown authored
        review comment
        if some tcp-transporter has data, then do select with timeout 0
      
      
      ndb/src/common/transporter/TransporterRegistry.cpp:
        review comment
        if some tcp-transporter has data, then do select with timeout 0
      a5731933
    • unknown's avatar
      Merge perch.ndb.mysql.com:/home/jonas/src/50-work · 746ee8f8
      unknown authored
      into  perch.ndb.mysql.com:/home/jonas/src/51-telco-gca
      
      
      storage/ndb/src/common/transporter/Packer.cpp:
        Auto merged
      storage/ndb/src/common/transporter/TCP_Transporter.hpp:
        Auto merged
      storage/ndb/src/common/transporter/TransporterRegistry.cpp:
        Auto merged
      storage/ndb/src/kernel/blocks/cmvmi/Cmvmi.cpp:
        Auto merged
      storage/ndb/test/ndbapi/testNdbApi.cpp:
        merge
      storage/ndb/test/run-test/daily-basic-tests.txt:
        merge
      746ee8f8