Comments on: TMP_TABLE_SIZE and MAX_HEAP_TABLE_SIZE http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/ Percona's MySQL & InnoDB performance and scalability blog Sat, 11 Feb 2012 16:45:54 +0000 hourly 1 http://wordpress.org/?v=3.2.1 By: Byte http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/comment-page-1/#comment-848600 Byte Tue, 29 Nov 2011 23:36:29 +0000 http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/#comment-848600 As it happends, we are running into performance issues when we set both of these variables to 128M on our MySQL server instead of leaving these values untouched (they were not set in my.cnf so 16M is the default). Alot of simple "SELECT RowById WHERE ColumnA IN (SELECT Values From TEMPTABLE)" queries suddenly took up to 10x as long as before. When we change the MySQL config back, everything was back to normal. Can anybody hint me to an explanation of some sort? Thanks! As it happends, we are running into performance issues when we set both of these variables to 128M on our MySQL server instead of leaving these values untouched (they were not set in my.cnf so 16M is the default). Alot of simple “SELECT RowById WHERE ColumnA IN (SELECT Values From TEMPTABLE)” queries suddenly took up to 10x as long as before.

When we change the MySQL config back, everything was back to normal.

Can anybody hint me to an explanation of some sort?

Thanks!

]]> By: Andrew http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/comment-page-1/#comment-786053 Andrew Thu, 09 Dec 2010 21:25:57 +0000 http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/#comment-786053 mysqlreport reports: __ Created Temp ________________________________________________________ Disk table 112 0.1/s Table 332 0.2/s Size: 512.0M File 88 0.1/s I read on the mysqlreport doco that 'Disk table' is used when a temporary table will not fit in the allocated tmp_table_size (in this case 512MB). My first question is: what is the difference between internal memory (tmp_table_size) and explicit memory (max_heap_table_size)? My second question is: how can you determine the 1.largest 2.most frequent table size created on disk so that tmp_table_size (or is it max_heap_table_size, or both?) can be adjusted upwards in size? mysqlreport reports:

__ Created Temp ________________________________________________________
Disk table 112 0.1/s
Table 332 0.2/s Size: 512.0M
File 88 0.1/s

I read on the mysqlreport doco that ‘Disk table’ is used when a temporary table will not fit in the allocated tmp_table_size (in this case 512MB).

My first question is: what is the difference between internal memory (tmp_table_size) and explicit memory (max_heap_table_size)?

My second question is: how can you determine the
1.largest
2.most frequent

table size created on disk so that tmp_table_size (or is it max_heap_table_size, or both?) can be adjusted upwards in size?

]]> By: Rubén Ortiz » MySQL - Variables básicas a configurar http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/comment-page-1/#comment-459963 Rubén Ortiz » MySQL - Variables básicas a configurar Fri, 30 Jan 2009 12:25:43 +0000 http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/#comment-459963 [...] http://www.mysqlperformanceblog.com/ [...] [...] http://www.mysqlperformanceblog.com/ [...]

]]> By: Rubén Ortiz http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/comment-page-1/#comment-459929 Rubén Ortiz Fri, 30 Jan 2009 11:25:11 +0000 http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/#comment-459929 Hi, excuse me for ask before find it better. I read this on MySQL, "ChangeSet@stripped, 2007-01-03 14:45:26+03:00, ted@stripped +7 -0 BUG #4291: max_heap_table_size affects creation of disk-based temporary table fix: the new system variable memory_tmp_table_size is introduced; it stands now for the exact purpose the Manual says tmp_table_size used to do. tmp_table_size retains to (give a hint about a) limit of the on-disk temporary table size. The limit imposed upon the disk-based temporary tables is still quite relative due to MyISAM current implementation restrictions." So I understand this buf was fixed to 5.X and tmp_table_size is now deprecated, isn't it? Thanks! Hi, excuse me for ask before find it better. I read this on MySQL,

“ChangeSet@stripped, 2007-01-03 14:45:26+03:00, ted@stripped +7 -0
BUG #4291: max_heap_table_size affects creation of disk-based temporary table

fix: the new system variable memory_tmp_table_size is introduced; it stands now for the exact purpose the Manual says tmp_table_size used to do.

tmp_table_size retains to (give a hint about a) limit of the on-disk temporary table size. The limit imposed upon the disk-based temporary tables is still quite relative due to MyISAM current implementation restrictions.”

So I understand this buf was fixed to 5.X and tmp_table_size is now deprecated, isn’t it?

Thanks!

]]> By: Rubén Ortiz http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/comment-page-1/#comment-459923 Rubén Ortiz Fri, 30 Jan 2009 10:51:58 +0000 http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/#comment-459923 Hi again last comment was on 2007. Do you know if bug is fixed now? Peter says that "I constantly see temporary tables sized in gigabytes". Could you be so kind to explain to us how you see it? Thanks!! Hi again

last comment was on 2007. Do you know if bug is fixed now? Peter says that “I constantly see temporary tables sized in gigabytes”. Could you be so kind to explain to us how you see it?

Thanks!!

]]> By: rajeesh http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/comment-page-1/#comment-193871 rajeesh Thu, 15 Nov 2007 10:36:20 +0000 http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/#comment-193871 tmp_table_size=45M , if its increse or decrese what will the effect of mysql database tmp_table_size=45M , if its increse or decrese what will the effect of mysql database

]]> By: Hjalmars it-blogg » MySQL-tweaking http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/comment-page-1/#comment-169996 Hjalmars it-blogg » MySQL-tweaking Wed, 19 Sep 2007 20:25:44 +0000 http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/#comment-169996 [...] sÃ¥ mycket information jag kan om ämnet genom att läsa mysqls optimeringskapitel, forumtrÃ¥dar, blogginlägg, tricks och tricks [...] [...] sÃ¥ mycket information jag kan om ämnet genom att läsa mysqls optimeringskapitel, forumtrÃ¥dar, blogginlägg, tricks och tricks [...]

]]> By: peter http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/comment-page-1/#comment-35418 peter Tue, 23 Jan 2007 20:03:23 +0000 http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/#comment-35418 Thank you James, I see it got added there. As MySQL old timer I did not get back to that page for other than new variables as I remember meaning about them. The quote I gave was from this url: http://dev.mysql.com/doc/refman/5.0/en/memory-storage-engine.html I guess I would expect working do be different in this place to. It is probably hard to keep such large document synchronized. Thank you James,

I see it got added there. As MySQL old timer I did not get back to that page for other than new variables as I remember meaning about them.

The quote I gave was from this url:

http://dev.mysql.com/doc/refman/5.0/en/memory-storage-engine.html

I guess I would expect working do be different in this place to.

It is probably hard to keep such large document synchronized.

]]> By: James Holt http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/comment-page-1/#comment-35416 James Holt Tue, 23 Jan 2007 19:48:31 +0000 http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/#comment-35416 Peter, reading this I thought I recalled reading about it in the docs somewhere. I looked around and found it here: http://dev.mysql.com/doc/refman/5.1/en/server-system-variables.html (scroll down to tmp_table_size) Not defending the behavior by any stretch; it is highly anti-intuitive. -James Holt Peter, reading this I thought I recalled reading about it in the docs somewhere.
I looked around and found it here:

http://dev.mysql.com/doc/refman/5.1/en/server-system-variables.html
(scroll down to tmp_table_size)

Not defending the behavior by any stretch; it is highly anti-intuitive.

-James Holt

]]> By: James Day http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/comment-page-1/#comment-34553 James Day Mon, 22 Jan 2007 06:51:47 +0000 http://www.mysqlperformanceblog.com/2007/01/19/tmp_table_size-and-max_heap_table_size/#comment-34553 Peter, thanks for mentioning this. I expect that the plan will be changed now Sergei knows that it would break backwards compatibility. A new synonym for tmp_table_size that is the memory limit and a new variable for disk size would do the job without breaking existing setups. Then tmp_table_size can be deprecated. Peter, thanks for mentioning this. I expect that the plan will be changed now Sergei knows that it would break backwards compatibility. A new synonym for tmp_table_size that is the memory limit and a new variable for disk size would do the job without breaking existing setups. Then tmp_table_size can be deprecated.

]]>