May 22, 2012

Post: MySQL Server Variables - SQL layer or Storage Engine specific.

…. bulk_insert_buffer_size – Used by MyISAM tables only to optimize bulk inserts (multiple value inserts). Really helps if you have really bulk inserts 100-1000+ values per single insert statement. concurrent_insert – Enables concurrent insert (while…

Post: Ultimate MySQL variable and status reference list

…_cache_sizeblogpercona.commanual Binlog_stmt_cache_useblogpercona.commanual bootstrapblogpercona.commanual bulk_insert_buffer_sizeblogpercona.commanual Bytes_receivedblogpercona.commanual Bytes_sentblogpercona.commanual character_set…_versionblogpercona.commanual innodb_write_io_threadsblogpercona.commanual insert_idblogpercona.commanual interactive_timeoutblogpercona.commanual join_buffer_sizeblogpercona.commanual keep_files_on_createblogpercona.commanual…

Post: MySQL Server Memory Usage

… always where – these are key_buffer_size, innodb_buffer_pool_size, innodb_additional_memory_pool_size, innodb_log_buffer_size, query_cache_size. If you’re using MyISAM… might be even larger – bulk inserts may allocate bulk_insert_buffer_size bytes of memory if done to MyISAM tables. myisam_sort_buffer_size used for ALTER TABLE…

Comment: Thoughts on MySQL Replication

… and good sized bulk_insert_buffer_size performance improvement can be dramatic. Sometimes I’ve got 100 times increase (using 100.000 values per insert statement or so) – The tricks are however to increse max_allowed_packet as well and keep key_buffer_size larger than bulk_insert_buffer_size

Comment: When is it a time to upgrade memory ?

bulk_insert_buffer_size=8M # Innobd Tuning #innodb_force_recovery=2 innodb_thread_concurrency=2 innodb_file_per_table=1 innodb_doublewrite=0 # Set buffersize to about 25% of the buffer pool size innodb_log_group_home_dir = /mnt/log_mysql innodb_log_file_size=1G innodb_log_buffer_size

Post: Aligning IO on a hard disk RAID – the Benchmarks

…_cache_size = 16M max_heap_table_size = 64M thread_cache_size = 32 query_cache_size = 0 tmp_table_size = 64M key_buffer_size = 8M bulk_insert_buffer_size = 8M myisam_sort_buffer_size = 8M myisam_max_sort_file_size

Comment: MySQL Server Variables - SQL layer or Storage Engine specific.

Any idea how the bulk_insert_buffer_size affects inserts when using INSERT INTO … SELECT versus LOAD DATA INFILE. This is mainly for new tables without existing data.

Post: Predicting how long data load would take

… sort which is very fast and Innodb can use insert buffer for them. Data Insert Order It is well known it is important… from bulk_insert_tree_size increase myisam_sort_buffer_size or key_buffer_size increase. Innodb typically needs large innodb_buffer_pool_size and large innodb_log_file_size to…

Post: Using MyISAM in production

…sure you have decent myisam_sort_buffer_size and large myisam_max_sort_file_size otherwise recovery may be done … but it has to be one insert at the time. Happily inserts in MyISAM are rather fast so … great trouble if you need to run some bulk operations. For example running full table scan query …

Post: How many partitions can you have ?

… 5.1.41 for my tests increasing buffer pool to 1G and log file size to 128M so all data is comfortably… UPDATE path on INSERT OF DUPLICATE KEY UPDATE (adding ON DUPLICATE KEY UPDATE set c=c+1 to my bulk inserts) the regression became even larger. 1 partition insert took 50 seconds to complete, 10…