…user activity in MySQL has traditionally been challenging. Most data can be obtained from the slow or general log… been discussed on a previous post in our blog. Starting with 5.1, the new plugin API … a script to listen on this socket and process the audit records as you wish. Performance-wise, …
Post: Is your MySQL buffer pool warm? Make it sweat!
April 16, 2013 By 6 Comments
… is a cross-post from Groupon’s engineering blog, and is Part 1 of 2. Thank you… during peak traffic. The standby server does not process query traffic except for replication. The buffer pool … prevent INSERTs, UPDATEs, and DELETEs from corrupting the data on the standby server. You will need Percona …
Post: The write cache: Swap insanity tome III
April 19, 2013 By 5 Comments
… complex configuration. Probably most readers of this blog know (or should know) about Linux swappiness setting… the allocation of memory for the MySQL process using the numactl utility, drop the file …In order to figure out, I started of data gathering metrics like: pt-stalk, vmstat, top, iostat…
Post: Distributed Set Processing with Shard-Query
May 14, 2011 By 27 Comments
… useful to understand the performance: I will shortly release another blog post focusing on ICE performance at 20 nodes, but before… they can all participate in the distributed query processing. There is almost no data shipping, as only aggregated sets are sent over…. I’ll document that process shortly, I think I need to make some minor abstraction modifications in the data access layer. Shard…
Post: High-Performance Click Analysis with MySQL
December 22, 2008 By 13 Comments
… is pretty much inevitable: if you do this kind of data processing in MySQL, you’re going to end up heavily I… contrast, moving the processing outside the database lets you parallelize trivially. If you need to analyze the non-aggregated data, you can…-part article on data archiving on my own blog a while back. The benefits of purging and archiving data can be dramatic…
Post: Preprocessing Data
August 8, 2011 By 3 Comments
… the separate table. 2) You work in a social micro-blogging start up and it is important for your users to… there is no wait time when data is inserted. This can be done by forking processes or using a queuing system. You… database server. This is a form of batch processing. Examples could be reporting, data quality checks and optimizations. Intervals Similar to the…
Post: Using Flexviews - part two, change data capture
March 25, 2011 By 26 Comments
… can pre-compute joins and may aggregate and summarize data. Using the aggregated data can significantly improve query response times compared to…_format=row to process SBR changes from a MySQL master. I’ll talk more about that in another blog post. FlexCDC does not implement a full binary log parser. Instead, it invokes the ‘mysqlbinlog’ utility and it processes the…
Post: State of MySQL Market and will Replication live ?
April 9, 2008 By 29 Comments
… Engines targeting certain workloads. PrimeBase is working on scalable blog streaming to make it possible store large blobs such …relational data processing and storage system – BigTable with MapReduce, Amazon Dynamo and SimpleDB, Hadoop Another angle of customization of data store and processing …
Post: Monty unviels Maria and starts Blogging
January 29, 2008 By 4 Comments
… Monty finally found a time to create his own blog with very descriptive name Monty Says. At the …not in line with serious traditional DBMS thinking when data in theory never is corrupted and database maintains …best thing you can do to speed up this process is download maria and give it a try on…
Post: MySQL Backup tools used by Percona Remote DBA for MySQL
March 13, 2013 By 8 Comments
… get into specifics on the tips/tricks to restore data in a future blog post. Tips/Tricks: run with –kill-long-queries… data while automatically replicating out to all slaves mysqlbinlog 5.6 Last year Percona IT director Tamas Kozak had a great blog… if your data is not encrypted before transfer Monitoring Monitoring is the most important piece to tie all of these process together…
