May 25, 2012

Post: Troubleshooting MySQL Memory Usage

… see MySQL memory consumption plotted. I use “VSZ” columns from “ps” output on Linux. It helps me to understand how this memory allocation happens… has moved allocating memory from operation system directly not from addition memory pool (hence 0). Such allocations are not seen in “Total memory allocated” line yet…

Post: InnoDB memory allocation, ulimit, and OpenSUSE

… majority of its memory allocations in ut_malloc_low(), so to get an idea of the pattern of requested allocations I added a… pool. Even with the extra 3.37 GB allocation, there was still some free memory. Or was there? Maybe some hidden monster…. I tested it with allocating 70 GB concurrently in each process so as to overrun physical memory + swap. Both allocations were successful, one…

Post: MySQL Server Memory Usage

… “ps aux” to see VSZ – Virtual Memory allocated by MySQL process. You can also look at “Resident Memory” but I find it less helpful… require 768MB of memory. Storage Engines. In general storage engines may have their own per thread or global memory allocations which are not tuned as buffers. Watch for these especially now with many storage engines being released for MySQL by…

Post: 10+ Ways to Crash or Overload MySQL

… is to get enough memory allocated to get to address space limit and MySQL will crash when one of internal memory allocations would unexpectedly fail… different stored procedures calling each other. Calls require memory allocation and especially stack memory allocations. There are some protections to ensure you would not…

Post: Wanted: Better memory profiling for MySQL

… to see amount of memory allocated for current thread in addition to global memory allocation. As MySQL is progressing the problem of memory allocation transparency is becoming more and more serious. There are much more objects which MySQL

Post: MySQL-Memcached or NOSQL Tokyo Tyrant - part 1

… won’t… and yet others require lots and lots of memory allocated to memcached to be successful.    This application… do. Using this application I can then compare using MySQL to using MySQL + Memcached, and then to other solutions like Tokyo Tyrant… won’t… and yet others require lots and lots of memory allocated to memcached to be successful. This application selects a random…

Post: How much memory Innodb Dictionary can take ?

… limit. So how much memory can it really take ? Here is some production stats from real system: mysql> select count(*) from INNODB…) In this case The memory stats from SHOW INNODB STATUS look like: Total memory allocated 1101004800; in additional pool allocated 0 Internal hash tables… (0 + 0) Threads 408536 (406936 + 1600) Dictionary memory allocated 698012720 So considering about 700M were allocated for dictionary cache in this case we…

Post: MySQL, AIX5L and malloc()

… run MySQL database on AIX 5L operating system. You compiled it successfully, configured and.. unluckily database didn’t start due to memory allocation problem? Basically, for some historical reasons AIX OS will allow your application to allocate maximum 256MB of memory per process…

Post: Memory allocation in Stored Function

… check only select: mysql> select avg(length(hello(name))) from testf; and here is vmstat 5 output: procs ———–memory———- —swap– —–io—- –system… 0 As you see MySQL ate 5GB of memory in 85 sec. That makes things clearer. As I understand MySQL allocates memory in each call of Stored Function, but de-allocates it…

Post: Helgrinding MySQL with InnoDB for Synchronisation Errors, Fun and Profit

… the waiters field next, the read must be serialized in memory after the reset. A speculative processor might perform the read… 0x5e06270 is 0 bytes inside a block of size 800000 alloc‘d ==9090==    at 0x4C28FDF: malloc (vg_replace_malloc.c:236…, I’d consider backporting and using MySQL 5.5 atomic operation primitives with proper memory barriers, so that there is no need…