June 18, 2013

Post: Impact of memory allocators on MySQL performance

… utilization of CPU/RAM resources. Efficient memory allocator should help to improve scalability, increase throughput and keep memory footprint under the control. In this post I’m going to check impact of several memory allocators…

Post: InnoDB Flushing: a lot of memory and slow disk

… graph). MySQL’s general recommendation for this case is to increase innodb_io_capacity and decrease innodb_max_dirty_pages_pct…_dirty_pages_pct limit. Another possible solution would be to increase innodb_log_file_size, but that: 1) only delays the… throttling mechanism that will limit the rate of changes in memory. Optimize the flushing of sequential neighbor pages in a way…

Comment: Innodb Performance Optimization Basics

… tables you can solve my increasing memory used for heap, so the temporary tables are written to memory instead of on disk. I… temporary files to /dev/shm instead but ended up by increasing max_heap_table_size. I know there is one more… you have to increase to the same, can’t just remmeber which one. Default is 16Mb so try increase to 32,48…

Post: Finding an optimal balance of I/O, CPU, and RAM for MySQL

… MySQL scales as you add more memory to the server. Vadim recently benchmarked the effects of increasing memory and CPU core count. He… sponsored by Virident, is that as you add CPUs and increase memory size, MySQL doesn’t scale as well as we would… present. Therefore, to decrease the price-to-performance ratio and increase the utilization of the tachIOn drive, Vadim sharded the database…

Post: Should I buy a Fast SSD or more memory?

… point out that once you hit this point, a further increase in memory at all. The B arrow is where the data… get the same improvement with memory, you would have needed to add 60% more memory -or- 260% more memory for a 5x improvement… interesting: Can you easily add another 32G RAM (are your memory slots already filled?) Does your budget allow to install SSD…

Post: MySQL Performance on Memory Appliance

… a chance to check out MySQL Performance on “Memory Appliance” by Violin Memory which can be used as extremely high speed storage system. I helped Violin Memory to optimize MySQL for customer workload and Violin memory and also had a chance to… with single thread it also did not scale well with increased concurrency even though we had 8 cores available for disposal…

Post: Read Buffers, mmap, malloc and MySQL Performance

…. Indeed allocating with mmap is much slower than allocating from memory memory pool which process already “owns” and in real life it… 10 times slow down over time as memory becomes fragmented with 50.000+ of memory areas mapped. As the gap in the… the pools rather than mmap. This though will at least increase memory consumptions as deallocating of these large buffers will not instantly…

Comment: InnoDB compression woes

… compression help in turning a dataset that doesn’t in memory into one that does? I read that InnoDB keeps both compressed and uncompressed page in memory. In that case using compression would actually increase memory requirements because now there is duplicate… turn a table that’s too big to fit in memory (eg. a 30G table and a 20G buffer pool) into…

Post: When is it a time to upgrade memory ?

… IO bound or may be just because amount of queries increased dramatically or may be because queries changed their plans. Do… depends on buffer size so you get and understanding what Memory-To-Disk ratio is optimal for your application, or at…_size you can use it as guidance to add more memory or more servers. Of course this is all oversimplifications – you…

Comment: Percona XtraDB Cluster reference architecture with HaProxy

….closed[0009:000a] My suggestion was to increase memory limit for haproxy process, I have increased it to 1GB (bulk size = 700M) but…