June 18, 2013

Comment: MySQL Server Variables - SQL layer or Storage Engine specific.

Any idea how the bulk_insert_buffer_size affects inserts when using INSERT INTO … SELECT versus LOAD DATA INFILE. This is mainly for new tables without existing data.

Post: Predicting how long data load would take

… sort which is very fast and Innodb can use insert buffer for them. Data Insert Order It is well known it is important… from bulk_insert_tree_size increase myisam_sort_buffer_size or key_buffer_size increase. Innodb typically needs large innodb_buffer_pool_size and large innodb_log_file_size to…

Post: Using MyISAM in production

…sure you have decent myisam_sort_buffer_size and large myisam_max_sort_file_size otherwise recovery may be done … but it has to be one insert at the time. Happily inserts in MyISAM are rather fast so … great trouble if you need to run some bulk operations. For example running full table scan query …

Post: InnoDB Full-text Search in MySQL 5.6 (part 1)

… to note that the InnoDB buffer pool for my 5.6 instance is 128MB – smaller than the size of my DIR data…, which discusses improving bulk insert performance. At the very bottom, the page claims that you can speed up bulk loading into an InnoDB…_state | 0 | +—————————+——–+ 10 rows in set (0.00 sec) mysql> insert into dir_test_innodb (full_name, details) SELECT reverse(full…

Post: How many partitions can you have ?

… 5.1.41 for my tests increasing buffer pool to 1G and log file size to 128M so all data is comfortably… UPDATE path on INSERT OF DUPLICATE KEY UPDATE (adding ON DUPLICATE KEY UPDATE set c=c+1 to my bulk inserts) the regression became even larger. 1 partition insert took 50 seconds to complete, 10…

Comment: Should you move from MyISAM to Innodb ?

… on, and data is compressed (key-buffer-size=4). Total db content is only 15G. Our Inserts drop to 2500 samples / seconds (400 kB per second) when compression is on. We perform bulk inserts (i.e. values (),(),(),…). I set the innodb_buffer_pool_size to 1G (having 4G ram) which seems to be the highest buffer

Comment: Read Buffers, mmap, malloc and MySQL Performance

Insert – yes, the buffer of that size is used for bulk inserts. INSERT … SELECT for example would probably do it. But not simple single-value inserts. In… I didn’t try blobs, I don’t think read_buffer_size would be allocated for single value inserts with blobs.

Post: MySQL Users Conference - Innodb

…having IO and uncompression happening in parallel, improving buffer pool usage (currently you may need to …- you have to specify compressed block size, this is the size to which you expect each page to…all insert cases – in fact if the insert is single value insert or the number of values in the bulk

Post: Heikki Tuuri answers to Innodb questions, Part II

… Mysql is the main one with “innodb_buffer_pool_size=20480M”) while the bulk of the rest (9 GB) is used for… – choosing innodb_buffer_pool_size Q36: There have been several MySQL bugs opened about multi-core scalability (concurrent queries, autoincrement, concurrent inserts, instrumentation…