June 20, 2013

Comment: Using Flexviews - part two, change data capture

… is significantly different from the old consumer. Please test the speed and reliability and report any bugs to the bug tracker…

Post: Getting real life query speeds with MySQL

… your application, the problem they usually run into is – query speed when it is run first time may be very different… significant chance data will still remain in Operation System cache speeding up query run. So what can you do ? First decide…

Post: Here's a quick way to Foresee if Replication Slave is ever going to catch up and When!

… = $1; } speed = (delay-($1-prev))/delay; o_speed = (start-($1-passed))/passed if (speed == 0) speed_d = 1; else speed_d = speed; eta = $1/speed_d; if…

Post: How would you compress your MySQL Backup

… options) resulting in 260MB compressed file. This gives us compression speed of about 21MB/sec – clearly much less than even single… is faster local network transfer default GZIP compression will not speed things up on the standard point to point 1Gbit network….7 seconds which gives 105MB/sec read speed from archive media and 276MB/sec write speed to the hard drive – this means…

Post: Predicting how long data load would take

… of different table structures. So which variables affect the load speed: Table Structure This one is tricky. The shorter rows you… you can see there are many variables which affect load speed which makes it extremely hard to predict. Especially fact load… though. During our recent data load speed we for example could see data load speed of 60GB during one hour and 10GB…

Post: How number of columns affects performance ?

… an important role. I was interested in peak row processing speed so I looked at full table scan in case data… depends on number of columns. Another interesting observation is access speed to different columns. the max(t1) and max(t99) were… them. Also note the covering index scan speed is very similar to full table scan speed – this is rather expected as table…

Comment: L2 cache for MySQL

… world the memory/storage will all be the same hi-speed so the idea of buffers and caches will no longer… hard to get rid of the duality hi-speed expensive memory vs lower-speed cheap mass memory but I would rather use… but the idea of going from a 2 speeds memory scenario to a 3 speeds one, and managed from the same software…

Post: Just do the math!

… may be in memory or on disk which affects scan speed. Another aspect is the temporary table – the number of rows… factor. In case we hit the disk the disk read speed becomes the limiting factor – for example with 500 byte rows… memory too. This is of course some simplification as processing speed may well be non linear depending on the data size…

Post: Compression for InnoDB backup

… stops to work. threadslevelcompressed sizecompress ratiocomression time, seccompr speed, MB/sdecomp time, secdecomp speed, MB/s qpress116,058.930.5210955.599265.86… To summarize results: pbzip2 obviously show good compression, but the speed of processing is too slow. What is interesting on Level…

Comment: Predicting how long data load would take

… it could fulfill our requirement. I found the data insertioin speed slows down drammatically (about 300 times slower) when the table… I can not avoid the break down of the insertion speed completely. It will happen sooner or later. My question is that is this type of insertion speed drammtic slow down scenario can never be avoided no matter…