… software RAID 10. Now let’s come to the MySQL configuration. MySQL Configuration I used Percona Server 5.5.22-55 for… defined a partitioning scheme such that every partition would hold 100 million rows. Table Structure The table structure of the table with no… ~12.5k INSERTs per second, with noticeable spikes after every 100 million rows inserted. I noticed that the insert rate drop was mainly…
Post: Why MySQL could be slow with large tables ?
June 9, 2006 By 141 Comments
… table with over 30 millions of rows. “val” column in this table has 10000 distinct value, so range 1..100 selects about 1…’ll need to perform 30 millions of random row reads, which gives us 300.000 seconds with 100 rows/sec rate. So we would… large data sets. In MySQL single query runs as single thread (with exeption of MySQL Cluster) and MySQL issues IO requests one by…
Post: The MySQL optimizer, the OS cache, and sequential versus random I/O
April 28, 2008 By 17 Comments
…row *************************** Name: fact Engine: MyISAM Rows: 147045493 Avg_row_length: 117 Data_length: 17217646764 Index_length: 11993816064 mysql… by 100 I/…million rows / 117 bytes per row / 4096 bytes per read), plus about 150 million random I/Os for the first dimension table, plus 150 million…
Comment: Using Sphinx as MySQL data retrieval accelerator
November 7, 2006 By 25 Comments
… when using a sqlserver such as mysql so this would perhaps be a hint to the mysql developers to adopt new sorting… units which in average means that each sorted 100/8 = 12.5 million rows and not 100 million rows as it was claimed in the original post. It would also be interresting to see how many rows…
Comment: Benchmarking single-row insert performance on Amazon EC2
May 16, 2012 By 17 Comments
… transaction-id makes the insertions easy. Basically you fill in 100 million rows, then start a new partition and fill that in. During… problem be 10B rows, the cost of querying will go up by another factor of ten (it will be 100 disk seeks… python version that Mark wrote http://bazaar.launchpad.net/~mdcallag/mysql-patch/mytools/annotate/head%3A/bench/ibench/iibench.py) is…
Post: MySQL-Memcached or NOSQL Tokyo Tyrant - part 3
October 19, 2009 By 25 Comments
… boosting performance with memcached on top of MySQL, in Part 2 we talked about running 100% outside the data with memcached, and… ( 1.4 memcached ), mysql was 5.1 XtraDB. Each environment had 2 tables each with 2 million rows. The data was identical. memcached and Tyrant stored a comma delimited string to represent the row.  Mysql was…
Post: Percona Server scalability on multi-cores server
September 29, 2010 By 14 Comments
… using from 1 to 32 threads. The database size was 100 million rows ( about 23GB of data). (Starting with Percona Server 5.1… results with the latest MySQL 5.5 releases, and especially in cases with the number of threads is > 100. I’m going…
Post: Can we get faster expression handling in MySQL
March 30, 2010 By 7 Comments
… to one in MySQL. The result ? Sphinx scored 3x to 20x faster. Andrew goes to explain results are not 100% comparable (as… looking to optimize MySQL problem, especially in analytics space when expressions should be computed over hundreds of millions of rows have expressed their concerns with this part of MySQL execution. I’m wondering if…
Comment: Using Sphinx as MySQL data retrieval accelerator
November 7, 2006 By 25 Comments
… each time and that on 100 million rows in just 0.7 seconds that will be way faster than mysql itself performs sorting which…
Post: MySQL-Memcached or NOSQL Tokyo Tyrant - part 1
October 15, 2009 By 16 Comments
… Million and looks up the result via that key. It then uses data from that random row … this post will talk about performance in a 100% pure memcached environment. Part 3 will focus on…Using this application I can then compare using MySQL to using MySQL + Memcached, and then to other solutions like …
