June 18, 2013

Post: The write cache: Swap insanity tome III

the allocation of memory for the MySQL process using the numactl utility, drop the file cache and pre-allocate the innodb buffer pool with theWhat was I missing? In order to figure out, I started of data

Post: MySQL: Data Storage or Data Processing

the cache (ie memcache) is often implemented to offload MySQL. When it comes to large scale data processing other techniques aredata and kill them. Now think what happens if you Search Google or engage in any other processing

Post: When should you store serialized objects in the database?

What are the downsides? I would say that the first serious downside is write amplification. If you areprocess. It can become difficult to apply even the simplest constraints on the data

Post: Distributed Set Processing with Shard-Query

processing standpoint, rows are the worst case for performance. Optimal mathematical performance requires operationsthe structure of the data on which your queries operate. It can, however, use a mapper for partition elimination. The

Post: Recovery beyond data restore

… restore the whole system to operating state, especially for complex systems. Instead of looking just at data restore process you better look at the whole process… as they are on the master. Now what do you do in case of hard crash this is when the data is lost on the master… still operate normally), have LVM setup if you want to avoid shutting off slave or master to clone the data and making sure the

Post: Aligning IO on a hard disk RAID – the Theory

the process when using pvcreate to initialize disk for LVM use, the two options you are interested in arethe data is properly aligned underneath: you don’t know if you should be using an offset, what

Post: Heikki Tuuri answers to Innodb questions, Part II

what are the limits of different operations for different levels of concurrency, specifically around mutexes and contention? How does this fit into the development process

Post: Data mart or data warehouse?

the data warehouse with ETL tools. This process is usually called “conforming” the source data into the warehouse schema. Another important aspect of the

Post: The relationship between Innodb Log checkpointing and dirty Buffer pool pages

…modified data from multiple transactions in the transaction log. As I said before, dirty pages are flushed to disk in the background.  The… transactions that are not flushed.  This, in essence, is what fuzzy checkpointing is. The checkpoint process is really a logical operation.  It occasionally …

Post: Tokyo Tyrant - The Extras Part I : Is it Durable?

data to permanent storage locations, if any, in those whole pages containing any part of the address space of the processoperations ( used for maintenance ).  What is missing here is a scheduled call to msync.  I looked and traced back the