…processed all the writes This is the easiest case, we will make s2 a master and redirect replication on the other… Those of you who have already done these operations with file-based replication know that it … it mean that we cannot easily recover the data with mysqlbinlog? There is a solution of …
Post: Migrating between MySQL schemas with Percona Xtrabackup
June 10, 2013 By 2 Comments
…this post. Similarly, reloading the data will be a very IO intense operation (redo logs, binlogs, etc) … values (potentially corrupted via user error or other issues) with SQL rather than needing to …(thanks Bill Karwin!), the cumbersome part of this process is the DISCARD/IMPORT TABLESPACE step as …
Post: The write cache: Swap insanity tome III
April 19, 2013 By 5 Comments
… the allocation of memory for the MySQL process using the numactl utility, drop the file …In order to figure out, I started of data gathering metrics like: pt-stalk, vmstat, top, iostat… the push to S3 involves a split operation to create files of 5GB since the …one to a non-zero value sets the other …
Post: MySQL: Data Storage or Data Processing
November 18, 2007 By 9 Comments
… scale data processing other techniques are used. Google uses some bigtable based technologies for search and Google Analytics (which is quite typical log processing… MySQL Cluster will evolve and data storage nodes will be able to perform all kinds of operations, in which case it will…
Post: Working with large data sets in MySQL
July 5, 2007 By 12 Comments
… would need to do careful process of ALTERing table on the slave and switching roles or some other techniques. You can’t… as results you’ve gotten for small data set may not apply to large data set so you need to re-test… set. One thing I often find people miscount is assuming data management operations will be proportional to the database size. Say it…
Post: How Percona does a MySQL Performance Audit
November 24, 2008 By 17 Comments
… to gather a lot of the data for us and speed the process, when possible, but the core… two key commands for this on most operating systems (there are others, such as mpstat or dstat, that…compare it against the server’s variables or whatever other data I need, and write something instructional to the…
Post: Distributed Set Processing with Shard-Query
May 14, 2011 By 27 Comments
… FROM clause, and UNION operations to operate fully in parallel. Distributed set processing is database agnostic. Keep… in the distributed query processing. There is almost no data shipping, as only aggregated …up computation over ICE, InnoDB, Vectorwise and other databases, all at the same time, …
Post: Choosing innodb_buffer_pool_size
November 3, 2007 By 39 Comments
… size of Innodb TableSpaces) because it does not only contain data pages – it also contain adaptive hash indexes, insert buffer, locks… Happy The other challenge you may have is making your OS happy and avoiding swapping out MySQL Process or other important processes to make… – there are portions of both MySQL Process and other processes which you do not need during normal operation so it is OK to get…
Post: Using MyISAM in production
June 17, 2006 By 36 Comments
…. Lock priorities. By default MySQL treats updates as higher priority operations. You can use SELECT HIGH_PRIORITY or UPDATE LOW_PRIORITY… tables used in batch processing and other means Exported data If you export data from OLTP system for example to perform data analyses – MyISAM will…
Post: High-Performance Click Analysis with MySQL
December 22, 2008 By 13 Comments
… the most aggregated data possible to save work. Avoid operations that update huge chunks of aggregated data at once. Among other things, you… is pretty much inevitable: if you do this kind of data processing in MySQL, you’re going to end up heavily I… the tactics I’ve used to successfully scale large click-processing and other types of event-analysis databases. In some cases I…
