…what the cause is some batch jobs, reports and other non response time critical activities are overloading the system causing user experience to degrade. The…the system. Unless it is really time critical process I would not use more than 4 parallel processes…if I need to delete old data instead of …
Post: Troubleshooting MySQL Memory Usage
March 21, 2012 By 3 Comments
…are allocated on server and Com_stmt_send_long_data to see whenever sending long data…to remove (or still use for processing). Of course you will see … not the total any more as Innodb has moved allocating memory from operation …allowing us to see directly for what purpose memory is allocated and …
Post: MySQL: Data Storage or Data Processing
November 18, 2007 By 9 Comments
…the cache (ie memcache) is often implemented to offload MySQL. When it comes to large scale data processing other techniques are…data and kill them. Now think what happens if you Search Google or engage in any other processing…
Post: When should you store serialized objects in the database?
January 21, 2010 By 42 Comments
…What are the downsides? I would say that the first serious downside is write amplification. If you are…process. It can become difficult to apply even the simplest constraints on the data…
Post: Distributed Set Processing with Shard-Query
May 14, 2011 By 27 Comments
…processing standpoint, rows are the worst case for performance. Optimal mathematical performance requires operations…the structure of the data on which your queries operate. It can, however, use a mapper for partition elimination. The…
Post: Recovery beyond data restore
August 2, 2008 By 11 Comments
… restore the whole system to operating state, especially for complex systems. Instead of looking just at data restore process you better look at the whole process… as they are on the master. Now what do you do in case of hard crash this is when the data is lost on the master… still operate normally), have LVM setup if you want to avoid shutting off slave or master to clone the data and making sure the…
Post: Aligning IO on a hard disk RAID – the Theory
June 9, 2011 By 15 Comments
…the process when using pvcreate to initialize disk for LVM use, the two options you are interested in are…the data is properly aligned underneath: you don’t know if you should be using an offset, what…
Post: Heikki Tuuri answers to Innodb questions, Part II
November 4, 2007 By 13 Comments
…what are the limits of different operations for different levels of concurrency, specifically around mutexes and contention? How does this fit into the development process…
Post: Data mart or data warehouse?
July 15, 2010 By 13 Comments
…the data warehouse with ETL tools. This process is usually called “conforming” the source data into the warehouse schema. Another important aspect of the…
Post: The relationship between Innodb Log checkpointing and dirty Buffer pool pages
February 17, 2012 By 5 Comments
…modified data from multiple transactions in the transaction log. As I said before, dirty pages are flushed to disk in the background. The… transactions that are not flushed. This, in essence, is what fuzzy checkpointing is. The checkpoint process is really a logical operation. It occasionally …
