<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: MySQL File System Fragmentation Benchmarks</title>
	<atom:link href="http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/</link>
	<description>Everything about MySQL Performance</description>
	<lastBuildDate>Sat, 07 Nov 2009 18:35:44 -0800</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8.4</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: peter</title>
		<link>http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/comment-page-1/#comment-552728</link>
		<dc:creator>peter</dc:creator>
		<pubDate>Thu, 30 Apr 2009 18:13:08 +0000</pubDate>
		<guid isPermaLink="false">http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/#comment-552728</guid>
		<description>There is probably some kind of bug when. You should not get negative numbers of course.</description>
		<content:encoded><![CDATA[<p>There is probably some kind of bug when. You should not get negative numbers of course.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: KevG</title>
		<link>http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/comment-page-1/#comment-540036</link>
		<dc:creator>KevG</dc:creator>
		<pubDate>Wed, 15 Apr 2009 19:33:04 +0000</pubDate>
		<guid isPermaLink="false">http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/#comment-540036</guid>
		<description>Sorry if this is a bit late.  But is there a newer version of this script.  I seem to be getting negative numbers from values.

Trial 1:

tables: 1; total records: 10000000; write rows per sec: 19153382.199996 , reads rows per sec: -
13280177.210685sec.
Content-type: text/html
X-Powered-By: PHP/4.3.9

tables: 10; total records: 10000000; write rows per sec: 53662175.142607 , reads rows per sec: 
-10424734.977175sec.
Content-type: text/html
X-Powered-By: PHP/4.3.9

tables: 100; total records: 10000000; write rows per sec: 31758735.240128 , reads rows per sec:
 28556416.055559sec.
Content-type: text/html
X-Powered-By: PHP/4.3.9

tables: 1000; total records: 10000000; write rows per sec: 58727492.688427 , reads rows per sec
: -37967090.126279sec.
Content-type: text/html
X-Powered-By: PHP/4.3.9

tables: 10000; total records: 10000000; write rows per sec: -18732414.94547 , reads rows per sec: 37017842.600133sec.

Thanks</description>
		<content:encoded><![CDATA[<p>Sorry if this is a bit late.  But is there a newer version of this script.  I seem to be getting negative numbers from values.</p>
<p>Trial 1:</p>
<p>tables: 1; total records: 10000000; write rows per sec: 19153382.199996 , reads rows per sec: -<br />
13280177.210685sec.<br />
Content-type: text/html<br />
X-Powered-By: PHP/4.3.9</p>
<p>tables: 10; total records: 10000000; write rows per sec: 53662175.142607 , reads rows per sec:<br />
-10424734.977175sec.<br />
Content-type: text/html<br />
X-Powered-By: PHP/4.3.9</p>
<p>tables: 100; total records: 10000000; write rows per sec: 31758735.240128 , reads rows per sec:<br />
 28556416.055559sec.<br />
Content-type: text/html<br />
X-Powered-By: PHP/4.3.9</p>
<p>tables: 1000; total records: 10000000; write rows per sec: 58727492.688427 , reads rows per sec<br />
: -37967090.126279sec.<br />
Content-type: text/html<br />
X-Powered-By: PHP/4.3.9</p>
<p>tables: 10000; total records: 10000000; write rows per sec: -18732414.94547 , reads rows per sec: 37017842.600133sec.</p>
<p>Thanks</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Gregor</title>
		<link>http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/comment-page-1/#comment-361802</link>
		<dc:creator>Gregor</dc:creator>
		<pubDate>Tue, 14 Oct 2008 09:07:23 +0000</pubDate>
		<guid isPermaLink="false">http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/#comment-361802</guid>
		<description>Peter,

sorry my fault - damn.
I wrote the drop database by myself...*arg*</description>
		<content:encoded><![CDATA[<p>Peter,</p>
<p>sorry my fault &#8211; damn.<br />
I wrote the drop database by myself&#8230;*arg*</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: peter</title>
		<link>http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/comment-page-1/#comment-361538</link>
		<dc:creator>peter</dc:creator>
		<pubDate>Mon, 13 Oct 2008 05:57:51 +0000</pubDate>
		<guid isPermaLink="false">http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/#comment-361538</guid>
		<description>Gregor,

What are you speaking about ?  If you DROP TABLE or DROP DATABASE ibdata1  never shrinks.</description>
		<content:encoded><![CDATA[<p>Gregor,</p>
<p>What are you speaking about ?  If you DROP TABLE or DROP DATABASE ibdata1  never shrinks.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Gregor</title>
		<link>http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/comment-page-1/#comment-361517</link>
		<dc:creator>Gregor</dc:creator>
		<pubDate>Mon, 13 Oct 2008 05:09:45 +0000</pubDate>
		<guid isPermaLink="false">http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/#comment-361517</guid>
		<description>Peter,

no didn&#039;t run on production. But there is no note about this scary design, this is just the point where i want to mention.
And it wouldn&#039;t happend if you delete each table by own drop table - it&#039;s just happend when you drop the database with the data inside.

 - it&#039;s always good to know...

best regards</description>
		<content:encoded><![CDATA[<p>Peter,</p>
<p>no didn&#8217;t run on production. But there is no note about this scary design, this is just the point where i want to mention.<br />
And it wouldn&#8217;t happend if you delete each table by own drop table &#8211; it&#8217;s just happend when you drop the database with the data inside.</p>
<p> &#8211; it&#8217;s always good to know&#8230;</p>
<p>best regards</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: peter</title>
		<link>http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/comment-page-1/#comment-361140</link>
		<dc:creator>peter</dc:creator>
		<pubDate>Fri, 10 Oct 2008 20:58:37 +0000</pubDate>
		<guid isPermaLink="false">http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/#comment-361140</guid>
		<description>Gregor,

There is no bug here.  Things work as designed - ibdata1 can&#039;t be shrunk either by deleting tables or deleting databases.
You may not like such design but it does not make it a bug

The innodb_file_per_table was created exactly as a workaround and I doubt there would be ether ibdata1 shrinker implemented.

Regarding the script - why is it dangerous ?  Have you run it on production table and run our of space ?  That is dangerous... but not the script.</description>
		<content:encoded><![CDATA[<p>Gregor,</p>
<p>There is no bug here.  Things work as designed &#8211; ibdata1 can&#8217;t be shrunk either by deleting tables or deleting databases.<br />
You may not like such design but it does not make it a bug</p>
<p>The innodb_file_per_table was created exactly as a workaround and I doubt there would be ether ibdata1 shrinker implemented.</p>
<p>Regarding the script &#8211; why is it dangerous ?  Have you run it on production table and run our of space ?  That is dangerous&#8230; but not the script.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Gregor</title>
		<link>http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/comment-page-1/#comment-361060</link>
		<dc:creator>Gregor</dc:creator>
		<pubDate>Fri, 10 Oct 2008 10:14:47 +0000</pubDate>
		<guid isPermaLink="false">http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/#comment-361060</guid>
		<description>This Script is really dangerous !

Because there is a &quot;bug&quot; in MySQL InnoDB which don&#039;t shrink the file ibdata1 after a DROP Database without dropping the Table - If you have the defalut setting and not innodb_file_per_table enabled..

For more Information see here:
http://bugs.mysql.com/bug.php?id=15748

http://bugs.mysql.com/bug.php?id=1287
http://bugs.mysql.com/bug.php?id=1341
http://bugs.mysql.com/bug.php?id=36943


Here a solution, but completly reimport is not that fun for a production enviroment....
http://crazytoon.com/2007/04/03/mysql-ibdata-files-do-not-shrink-on-database-deletion-innodb/

best regards gregor</description>
		<content:encoded><![CDATA[<p>This Script is really dangerous !</p>
<p>Because there is a &#8220;bug&#8221; in MySQL InnoDB which don&#8217;t shrink the file ibdata1 after a DROP Database without dropping the Table &#8211; If you have the defalut setting and not innodb_file_per_table enabled..</p>
<p>For more Information see here:<br />
<a href="http://bugs.mysql.com/bug.php?id=15748" rel="nofollow">http://bugs.mysql.com/bug.php?id=15748</a></p>
<p><a href="http://bugs.mysql.com/bug.php?id=1287" rel="nofollow">http://bugs.mysql.com/bug.php?id=1287</a><br />
<a href="http://bugs.mysql.com/bug.php?id=1341" rel="nofollow">http://bugs.mysql.com/bug.php?id=1341</a><br />
<a href="http://bugs.mysql.com/bug.php?id=36943" rel="nofollow">http://bugs.mysql.com/bug.php?id=36943</a></p>
<p>Here a solution, but completly reimport is not that fun for a production enviroment&#8230;.<br />
<a href="http://crazytoon.com/2007/04/03/mysql-ibdata-files-do-not-shrink-on-database-deletion-innodb/" rel="nofollow">http://crazytoon.com/2007/04/03/mysql-ibdata-files-do-not-shrink-on-database-deletion-innodb/</a></p>
<p>best regards gregor</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Shai</title>
		<link>http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/comment-page-1/#comment-356598</link>
		<dc:creator>Shai</dc:creator>
		<pubDate>Fri, 19 Sep 2008 22:51:43 +0000</pubDate>
		<guid isPermaLink="false">http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/#comment-356598</guid>
		<description>From the sample code, your read statitic is bogus. 
you do many more SELECT on many table than one table so, of course, you will get slower time, but in reality if you did your calculation correctly you will get a much faster read when you have more tables with less data in each table. here is the problem:

insteed of 
$number_of_records/(microtime(1)-$t_temp);
do this:
$number_of_tables/(microtime(1)-$t_temp);

and if you do want to keep it with number_of_record try this
($number_of_records*$number_of_tables)/(microtime(1)-$t_temp);</description>
		<content:encoded><![CDATA[<p>From the sample code, your read statitic is bogus.<br />
you do many more SELECT on many table than one table so, of course, you will get slower time, but in reality if you did your calculation correctly you will get a much faster read when you have more tables with less data in each table. here is the problem:</p>
<p>insteed of<br />
$number_of_records/(microtime(1)-$t_temp);<br />
do this:<br />
$number_of_tables/(microtime(1)-$t_temp);</p>
<p>and if you do want to keep it with number_of_record try this<br />
($number_of_records*$number_of_tables)/(microtime(1)-$t_temp);</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Nate</title>
		<link>http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/comment-page-1/#comment-325211</link>
		<dc:creator>Nate</dc:creator>
		<pubDate>Wed, 09 Jul 2008 18:08:13 +0000</pubDate>
		<guid isPermaLink="false">http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/#comment-325211</guid>
		<description>I am a newbie to MySQL and am not getting the high insert throughput as in this benchmark.  Could you post the my.cnf file used and the computer hardware specs that produced this benchmark.  I am interested in general, innodb, and myisam settings and installation configuration of the machine.  I am interested in how many processors and processor type, processor cache, RAM size, front side bus speed, harddrive rpms, harddrive max write speed, and operating system.   Also are you doing multiple inserts per transaction.

here is data from my tests:
computer 1:

My.ini
[client]
port=3306
[mysql]
default-character-set=latin1
[mysqld]
port=3306
basedir=&quot;C:/Program Files/MySQL/MySQL Server 5.0/&quot;
datadir=&quot;C:/Program Files/MySQL/MySQL Server 5.0/Data/&quot;
default-character-set=latin1
default-storage-engine=INNODB
#default-storage-engine=MyISAM
sql-mode=&quot;STRICT_TRANS_TABLES,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION&quot;
max_connections=100
query_cache_size=0
table_cache=256
tmp_table_size=93M
thread_cache_size=8
#*** MyISAM Specific options
myisam_max_sort_file_size=100G
myisam_max_extra_sort_file_size=100G
myisam_sort_buffer_size=185M
key_buffer_size=157M
read_buffer_size=64K
read_rnd_buffer_size=256K
sort_buffer_size=256K
#*** INNODB Specific options ***
innodb_additional_mem_pool_size=20M
innodb_flush_log_at_trx_commit=0
innodb_log_buffer_size=4M
innodb_buffer_pool_size=304M
innodb_log_file_size=152M
innodb_thread_concurrency=8

RAM: 1GB
Processor: Intel P4 2.253GHz
Cache size: 512KB
Front side bus: 530 MHz
Harddrive: WDC WD400BB-75DEA0
Max Burn Rate: 100MB/s  tested 8MB/s
RPMs: 7200

using multiple inserts per transaction for 1 innodb table (25 inserts or .2 seconds of data to be inserted) I got 1121, 1133, and 1166 inserts per second into that one table.
using autocommit for innodb inserts I got 1125, and 1158 inserts per second into the table
using myisam I got 1186 and 1177 inserts per second into the table
the average data length was 231B.  It seemed the writing of the insert is what was taking all the time.  Data was coming in much faster than it was able to insert.  The data queue was getting quite long.  I ran the test for 5 minutes.  The inserts per second was pretty constant the little variation arrose in how fast the data was coming in which was no more than 3000 packets of data per second.  The processor would go up to about 80% during tests.

please give me feed back.  I am trying to get the data to be inserted faster than it is coming in.  Please post the my.cnf file that you were able to get 9000 inserts per second and the computer specs for that test.

Thanks.</description>
		<content:encoded><![CDATA[<p>I am a newbie to MySQL and am not getting the high insert throughput as in this benchmark.  Could you post the my.cnf file used and the computer hardware specs that produced this benchmark.  I am interested in general, innodb, and myisam settings and installation configuration of the machine.  I am interested in how many processors and processor type, processor cache, RAM size, front side bus speed, harddrive rpms, harddrive max write speed, and operating system.   Also are you doing multiple inserts per transaction.</p>
<p>here is data from my tests:<br />
computer 1:</p>
<p>My.ini<br />
[client]<br />
port=3306<br />
[mysql]<br />
default-character-set=latin1<br />
[mysqld]<br />
port=3306<br />
basedir=&#8221;C:/Program Files/MySQL/MySQL Server 5.0/&#8221;<br />
datadir=&#8221;C:/Program Files/MySQL/MySQL Server 5.0/Data/&#8221;<br />
default-character-set=latin1<br />
default-storage-engine=INNODB<br />
#default-storage-engine=MyISAM<br />
sql-mode=&#8221;STRICT_TRANS_TABLES,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION&#8221;<br />
max_connections=100<br />
query_cache_size=0<br />
table_cache=256<br />
tmp_table_size=93M<br />
thread_cache_size=8<br />
#*** MyISAM Specific options<br />
myisam_max_sort_file_size=100G<br />
myisam_max_extra_sort_file_size=100G<br />
myisam_sort_buffer_size=185M<br />
key_buffer_size=157M<br />
read_buffer_size=64K<br />
read_rnd_buffer_size=256K<br />
sort_buffer_size=256K<br />
#*** INNODB Specific options ***<br />
innodb_additional_mem_pool_size=20M<br />
innodb_flush_log_at_trx_commit=0<br />
innodb_log_buffer_size=4M<br />
innodb_buffer_pool_size=304M<br />
innodb_log_file_size=152M<br />
innodb_thread_concurrency=8</p>
<p>RAM: 1GB<br />
Processor: Intel P4 2.253GHz<br />
Cache size: 512KB<br />
Front side bus: 530 MHz<br />
Harddrive: WDC WD400BB-75DEA0<br />
Max Burn Rate: 100MB/s  tested 8MB/s<br />
RPMs: 7200</p>
<p>using multiple inserts per transaction for 1 innodb table (25 inserts or .2 seconds of data to be inserted) I got 1121, 1133, and 1166 inserts per second into that one table.<br />
using autocommit for innodb inserts I got 1125, and 1158 inserts per second into the table<br />
using myisam I got 1186 and 1177 inserts per second into the table<br />
the average data length was 231B.  It seemed the writing of the insert is what was taking all the time.  Data was coming in much faster than it was able to insert.  The data queue was getting quite long.  I ran the test for 5 minutes.  The inserts per second was pretty constant the little variation arrose in how fast the data was coming in which was no more than 3000 packets of data per second.  The processor would go up to about 80% during tests.</p>
<p>please give me feed back.  I am trying to get the data to be inserted faster than it is coming in.  Please post the my.cnf file that you were able to get 9000 inserts per second and the computer specs for that test.</p>
<p>Thanks.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: paul</title>
		<link>http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/comment-page-1/#comment-259255</link>
		<dc:creator>paul</dc:creator>
		<pubDate>Sat, 29 Mar 2008 08:54:56 +0000</pubDate>
		<guid isPermaLink="false">http://www.mysqlperformanceblog.com/2008/03/21/mysql-file-system-fragmentation-benchmarks/#comment-259255</guid>
		<description>We use it in production, as XFS slowed up on us and mysql became just slow because we had a lot of users on it. The speed difference was like the difference in O(e^n) vs O(n), but as we have a quite uncommon workload it is somewhat our own problem. We have a lot of Databases which are quite tiny.
You might still be interessted in testing it, as my experience shows that a query on an idle server with xfs and 100K Databases takes way longer than a query on the same server with reiserfs.</description>
		<content:encoded><![CDATA[<p>We use it in production, as XFS slowed up on us and mysql became just slow because we had a lot of users on it. The speed difference was like the difference in O(e^n) vs O(n), but as we have a quite uncommon workload it is somewhat our own problem. We have a lot of Databases which are quite tiny.<br />
You might still be interessted in testing it, as my experience shows that a query on an idle server with xfs and 100K Databases takes way longer than a query on the same server with reiserfs.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
