…the allocation of memory for the MySQL process using the numactl utility, drop the file cache and pre-allocate the innodb buffer pool with the…What was I missing? In order to figure out, I started of data…
Post: MySQL: Data Storage or Data Processing
November 18, 2007 By 9 Comments
…the cache (ie memcache) is often implemented to offload MySQL. When it comes to large scale data processing other techniques are…data and kill them. Now think what happens if you Search Google or engage in any other processing…
Post: When should you store serialized objects in the database?
January 21, 2010 By 47 Comments
…What are the downsides? I would say that the first serious downside is write amplification. If you are…process. It can become difficult to apply even the simplest constraints on the data…
Post: Distributed Set Processing with Shard-Query
May 14, 2011 By 27 Comments
…processing standpoint, rows are the worst case for performance. Optimal mathematical performance requires operations…the structure of the data on which your queries operate. It can, however, use a mapper for partition elimination. The…
Post: Recovery beyond data restore
August 2, 2008 By 11 Comments
… restore the whole system to operating state, especially for complex systems. Instead of looking just at data restore process you better look at the whole process… as they are on the master. Now what do you do in case of hard crash this is when the data is lost on the master… still operate normally), have LVM setup if you want to avoid shutting off slave or master to clone the data and making sure the…
Post: Aligning IO on a hard disk RAID – the Theory
June 9, 2011 By 18 Comments
…the process when using pvcreate to initialize disk for LVM use, the two options you are interested in are…the data is properly aligned underneath: you don’t know if you should be using an offset, what…
Post: Heikki Tuuri answers to Innodb questions, Part II
November 4, 2007 By 13 Comments
…what are the limits of different operations for different levels of concurrency, specifically around mutexes and contention? How does this fit into the development process…
Post: Data mart or data warehouse?
July 15, 2010 By 14 Comments
…the data warehouse with ETL tools. This process is usually called “conforming” the source data into the warehouse schema. Another important aspect of the…
Post: The relationship between Innodb Log checkpointing and dirty Buffer pool pages
February 17, 2012 By 10 Comments
…modified data from multiple transactions in the transaction log. As I said before, dirty pages are flushed to disk in the background. The… transactions that are not flushed. This, in essence, is what fuzzy checkpointing is. The checkpoint process is really a logical operation. It occasionally …
Post: Tokyo Tyrant - The Extras Part I : Is it Durable?
November 10, 2009 By 5 Comments
…data to permanent storage locations, if any, in those whole pages containing any part of the address space of the process…operations ( used for maintenance ). What is missing here is a scheduled call to msync. I looked and traced back the…
