… Units each) 1690 GB of instance storage 64-bit platform I/O Performance: …Now let’s come to the MySQL configuration. MySQL Configuration I used Percona Server 5…_max_dirty_pages_pct = 50 innodb_io_capacity = 800 innodb_read_io_threads = 8… see the impact of growth in data-set on the insert rate. We…
Post: Upgrading MySQL
January 5, 2010 By 23 Comments
… cases. When storage type changes, such as DECIMAL field got whole another meaning in MySQL 5.0 MySQL generally supports legacy storage format for… way to check for known incompatibilities and fix them. The data storage is however only small part of the problem – much bigger… measuring its capacity) Setting up the Slave(s) If you want to minimize downtime it is best to use MySQL Replication for…
Post: Shard-Query EC2 images available
May 11, 2011 By 2 Comments
…=’Contains all avaialble data from 1988 to 2010′; mysql> use ontime1; Database changed mysql> show table status … raw input data), which is quite nice. Each shard contains only 128MB of data! Storage engine makes…-import-table-from-xtrabackup=1 innodb-io-capacity=1000 innodb-log-buffer-size=32M innodb…
Post: Ultimate MySQL variable and status reference list
January 8, 2011 By 4 Comments
…MySQL manual, …data_pending_readsblogpercona.commanual Innodb_data_pending_writesblogpercona.commanual Innodb_data_readblogpercona.commanual Innodb_data_readsblogpercona.commanual Innodb_data_writesblogpercona.commanual Innodb_data… standaloneblogpercona.commanual storage_engineblogpercona.commanual…
Post: Finding your MySQL High-Availability solution – The questions
October 16, 2009 By 36 Comments
… data, you are most likely using the InnoDB storage engine, since MyISAM is not transactional and do not sync data to disk. Similarly, MySQL… hardware) the write capacity of a database server. In term of write capacity here are you choices. Write capacity MySQL replication Fair Master-Master…
Post: High-Performance Click Analysis with MySQL
December 22, 2008 By 13 Comments
…much inevitable: if you do this kind of data processing in MySQL, you’re going to end up heavily I…Sharding is inevitable if your write workload exceeds the capacity of a single server (or if you’re … An impression per day becomes a fixed overhead of storage size. So, you actually have as many rows…
Post: When would you use SAN with MySQL ?
March 9, 2009 By 18 Comments
… – if you have MySQL/server restart you may have warmup being quite shorter than in case of local storage. It is also… looking for maximal data consistency (as SAN users often are) you better have binary log flushed on commit too. MySQL also has… it great. My Advice for Scaling IO capacity with SAN (this applies to directly attached storage too) is to really understand what…
Post: Is disk Everything for MySQL Performance ?
April 25, 2008 By 7 Comments
… cases when storage size becomes the limit rather than number of IOs it can handle. Imagine for example data archive storage. On BoardReader for example we’re limited by space and how much data we can comfortably put in MySQL Instance… not always the case. Another mistake is to measure IO capacity in spindles – So your hard drive can do 200 random…
Post: Rendundant Array of Inexpensive Servers
August 21, 2008 By 15 Comments
…it is paranoid and this is how you want your data storage to be. This is also why Sun is … performance impact and (in particular if you use MySQL Replication for HA) the switch to the new …hardware but share the data center. You may have “spares” to provide extra on demand capacity for web servers …
Post: Distributed Set Processing with Shard-Query
May 14, 2011 By 27 Comments
… data on which your queries operate. It can, however, use a mapper for partition elimination. The mapper is pluggable. On each storage… capacity in data center A, and there is not enough power to add new nodes there. You can add new nodes in data… of compute resource which speaks SQL, but right now only MySQL storage nodes are supported. Amdahl’s law applies to the distributed…
