… memory is what really really matters. High-Memory Quadruple Extra Large Instance 68.4 GB of memory 26 EC2 Compute Units… so that we can see the impact of growth in data-set on the insert rate. We can see that adding the…, and the variation in the rate can be classified as large, because it varies between ~6.5k to ~12.5k INSERTs…
Post: Join Optimizations in MySQL 5.6 and MariaDB 5.5
April 4, 2012 By 2 Comments
… benchmarking in-memory workload, the InnoDB buffer pool size is set to 6G and the buffer pool was warmed up, so… numbers are values for Innodb_buffer_pool_reads and Innodb_data_read. We can see that with appropriately sized buffers less… data is read from disk 2.2G vs 5G. However, there is one number in MariaDB 5.5 that is quite large…
Post: Troubleshooting MySQL Memory Usage
March 21, 2012 By 3 Comments
… it working with large blobs ? Using user variables ? …data_length+index_length) from information_schema.tables where engine=’memory’; +——————————-+ | sum(data_length+index_length) | +——————————-+ | 126984 | +——————————-+ 1 row in set…
Post: Multi Range Read (MRR) in MySQL 5.6 and MariaDB 5.5
March 21, 2012 By 10 Comments
… sorting the secondary key tuples. If the buffer size is large enough only a single range lookup will be needed, however….84G 1.89G 1.53G 1.89G 1.53G Innodb_data_reads 120552 123872 100551 103011 77213 Innodb_pages_read 120548…. The query time is reduced further when buffer size is set large enough so that the index tuples fit in the buffer…
Post: How FLUSH TABLES WITH READ LOCK works with Innodb Tables
March 23, 2012 By 20 Comments
…LOCK can be quite large because of the … | 0 | 0 | 1 | +——-+——+———–+———-+————+——+——————————+——————————+———–+—————+———–+ 5 rows in set (0.00 sec) … helpful when backing up data from the slave with …
Post: Working with large data sets in MySQL
July 5, 2007 By 12 Comments
… of large data sets – it can take hell a lot of time to deal with. This may sound obvious if you have some large data set… gotten for small data set may not apply to large data set so you need to re-test your “final design” again with large set. One thing I often find people miscount is assuming data…
Post: PHP Large result sets and summary tables.
July 6, 2007 By 8 Comments
… site preparing for massive growth. To make sure it handles large data sets as part of the process we work on generation test… other queries, ie INSERTs and UPDATEs while you traverse with data. Not with unbuffered query because connection is still busy. Need… data against web services and so on – in this case the overhead of creating yet another temporary table is not so large…
Post: Why MySQL could be slow with large tables ?
June 9, 2006 By 139 Comments
…… but when dealing with large data sets it could be recepie to disaster. The problem is not the data size – normalized data normally becomes smaller… aggregate result sets. So if you’re dealing with large data sets and complex queries here are few tips Try to fit data set you’re… full table scan may be faster. Avoid joins to large tables Joining of large data sets using nested loops is very expensive. Try to…
Post: Recovery beyond data restore
August 2, 2008 By 11 Comments
… will be needed in the worst case of data loss which is trashing the data which gets to all slaves via replication… in time and load data locally with SQL_LOG_BIN=0 set for session. If the large portion of data trashed you may need to recover full database on all slaves which is best done in binary mode for large data sets…
Post: Upcoming Webinar "Managing Big Data with Percona Server, XtraBackup and Tungsten"
February 2, 2011 By 3 Comments
… February 10, We will be giving a webinar “Managing Big Data with Percona Server, XtraBackup and Tungsten”. This is joint Continuent… data is a big problem for growing SaaS businesses and large web applications. In this webinar, we’ll teach you how to set… provisioning of large data sets, and how to replicate scalably and safely using Tungsten Replicator with parallel apply. Bring your big data questions to…
