… So, in effect, you’re adding performance hit to performance hit. The other reason is …, thus resulting in less binary log data being sent down to the lower-level…. For example, if you see a large number of long-running queries in … up with –skip-grant-tables and insert a few rows into an InnoDB table…
Post: Is Synchronous Replication right for your app?
May 14, 2013 By 18 Comments
…to several hundred. This really will open a large window where rows won’t be able to… but also updates groups with some metadata: BEGIN; INSERT INTO users_groups (user_id, group_id) VALUES (…. I see this tuning very frequently for “performance” reasons when data durability isn’t as crucial. This is…
Post: Benchmarking single-row insert performance on Amazon EC2
May 16, 2012 By 17 Comments
… working for a customer benchmarking insert performance on Amazon EC2, and I have some interesting… really really matters. High-Memory Quadruple Extra Large Instance 68.4 GB of memory 26 …data-set on the insert rate. We can see that adding the secondary indexes to the table has decreased the insert…
Post: MySQL on Amazon RDS part 1: insert performance
March 15, 2011 By 37 Comments
…, which is listed as “High-Memory Quadruple Extra Large DB Instance: 68 GB of memory, 26 ECUs (…400,000,000 rows. This creates a table+index data size approximately twice as big as memory, so … in-memory bottleneck to solely on-disk. The insert performance is quite variable, more so than I would …
Post: Predicting how long data load would take
May 24, 2007 By 14 Comments
… and Innodb can use insert buffer for them. Data Insert Order It is well known it is important to load data in primary key order into Innodb tables for optimal performance, but… large innodb_buffer_pool_size and large innodb_log_file_size to perform load effectively Load Options There two main ways to load data…
Post: High-Performance Click Analysis with MySQL
December 22, 2008 By 13 Comments
…data; try to make your rows fixed-length. One reason denormalization is important is that nested-loop joins on large data…-to-scale database server for the initial insertion, because you can write CSV files with … is that MySQL doesn’t tend to perform well on a data warehousing workload. The nested-…
Post: Performance impact of complex queries
January 17, 2007 By 11 Comments
… is often underestimated is impact of MySQL Performance by complex queries on large data sets(ie some large aggregate queries) and batch jobs. It… reason for this to happen – query which crunches large amount of data set wipes data from your normal working set from OS cache… DELETE … LIMIT 1000 and insert sleep 10; in between. By spreading load this way you make sure large portion of the cache…
Post: Data mart or data warehouse?
July 15, 2010 By 14 Comments
… even data from radio telescopes. This data is extracted from the source system(s) and then cleaned up and inserted into the data warehouse… “insert only”. Data is very likely never updated or deleted in these databases and they are expected to grow to very large sizes… will perform better on a star schema than on a snowflake or fully normalized schema at data warehouse volumes. This is in large…
Post: How many partitions can you have ?
December 5, 2009 By 19 Comments
… with large MySQL data warehouse had the table which was had data merged into it with INSERT ON DUPLICATE KEY UPDATE statements. The performance was… (max 2) partitions got data inserted to them per insert statement. As I tested the UPDATE path on INSERT OF DUPLICATE KEY UPDATE (adding…
Post: Heikki Tuuri answers to Innodb questions, Part II
November 4, 2007 By 13 Comments
… queries, autoincrement, concurrent inserts, instrumentation, etc.). Rather than treat each defect as an individual case, is there any performance testing going on… setup and switching roles is a good way to get large data manageable. MySQL Master Master Manager can help you to automate…
