November 5, 2009

Air traffic queries in MyISAM and Tokutek (TokuDB)

Posted by Vadim |

This is next post in series
Analyzing air traffic performance with InfoBright and MonetDB
Air traffic queries in LucidDB
Air traffic queries in InfiniDB: early alpha

Let me explain the reason of choosing these engines. After initial three posts I am often asked “What is baseline ? Can we compare results with standard MySQL engines ?”. So there come MyISAM to consider it as base point to see how column-oriented-analytic engines are better here.

[read more...]

New developers training course is almost ready

Posted by Morgan Tocker |

We’ve been busy expanding our training curriculum to include training for developers building applications with MySQL.  We have reached the point where we’re ready for a pilot teach – and it brings me great pleasure to announce that we’re opening it up for blog readers to attend, free of charge.

The details:
San Francisco
4th December
9:30AM – 5PM

Spaces are limited, so to give everyone a fair chance we’re delaying registration to open at noon tomorrow (Friday) Pacific Time. It’s strictly first in first served, so be quick!  The registration link is here.

InnoDB: look after fragmentation

Posted by Vadim |

One problem made me puzzled for couple hours, but it was really interesting to figure out what's going on.

So let me introduce problem at first. The table is

CODE:
  1. CREATE TABLE `c` (
  2.   `tracker_id` int(10) unsigned NOT NULL,
  3.   `username` char(20) character set latin1 collate latin1_bin NOT NULL,
  4.   `time_id` date NOT NULL,
  5.   `block_id` int(10) unsigned default NULL,
  6.   PRIMARY KEY  (`tracker_id`,`username`,`time_id`),
  7.   KEY `block_id` (`block_id`)
  8. ) ENGINE=InnoDB

Table has 11864696 rows and takes Data_length: 698,351,616 bytes on disk

The problem is that after restoring table from mysqldump, the query that scans data by primary key was slow. How slow ? Let me show.
[read more...]

November 2, 2009

Air traffic queries in InfiniDB: early alpha

Posted by Vadim |

As Calpont announced availability of InfiniDB I surely couldn't miss a chance to compare it with previously tested databases in the same environment.
See my previous posts on this topic:
Analyzing air traffic performance with InfoBright and MonetDB
Air traffic queries in LucidDB

I could not run all queries against InfiniDB and I met some hiccups during my experiment, so it was less plain experience than with other databases.

[read more...]

November 1, 2009

Speaking at the LA MySQL Meetup – 18th November

Posted by Morgan Tocker |
Morgan speaking at Highload.ru
A recent photo from Highload.ru

I said in my last post, that we're interested in speaking at MySQL meetups, and I'm happy to say that the Los Angeles MySQL Meetup has taken us up on the offer.

On November 18th, I'll be giving an introductory talk on InnoDB/XtraDB Performance Optimization.  I will be the second speaker, with Carl Gelbart first speaking on Infobright.

What brings me to LA?  On the same day (18th Nov) I'll be teaching a one day class on Performance Optimization for MySQL with InnoDB and XtraDB.  If you haven't signed up yet - spaces are still available.

October 30, 2009

New MariaDB release is out

Posted by peter |

MariaDB project kept development going in the repository only not providing any binary releases since April, so release was well over due and it is here now.

If you're wondering how this release of MariaDB is different from MySQL you should read this FAQ

Giving a talk in Palo Alto, November 3rd

Posted by peter |

I'm going to give a talk on Goal Driven Performance Optimization next Tuesday. This is one of my favorite talks as it goes beyond MySQL to the principles you can apply to performance optimizations of the complex systems, especially when you have to do a lot in limited time or budget and so you can't just fix everything what can be fixed.

Please RSVP if you're planning to attend as space is limited.

Thanks to Sam Ghods and Box.Net for organizing the event.

October 27, 2009

State of the art: Galera – synchronous replication for InnoDB

Posted by Vadim |

First time I heard about Galera on Percona Performance Conference 2009, Seppo Jaakola was presenting "Galera: Multi-Master Synchronous MySQL Replication Clusters". It was impressed as I personally always wanted it for InnoDB, but we had it in plans at the bottom of the list, as this is very hard to implement properly.
The idea by itself is not new, I remember synchronous replication was announced for SolidDB on MySQL UC 2007, but later the product was killed by IBM.

So long time after PPC 2009 there was available version mysql-galera-0.6, which had serious flow, to setup a new node you had to take down whole cluster. And all this time Codership ( company that develops Galera) was working on 0.7 release that introduces node propagation keeping cluster online. You can play with 0.7pre release by yourself MySQL/Galera Release 0.7pre.
[read more...]

October 26, 2009

Air traffic queries in LucidDB

Posted by Vadim |

After my first post Analyzing air traffic performance with InfoBright and MonetDB where I was not able to finish task with LucidDB, John Sichi contacted me with help to setup. You can see instruction how to load data on LucidDB Wiki page

You can find the description of benchmark in original post, there I will show number I have for LucidDB vs previous systems.

[read more...]

October 25, 2009

XtraDB Amazon Image

Posted by Aleksandr Kuzminsky |

For those who use Amazon EC2 service and were anxious about having XtraDB ready to launch there is a good news.

We created a public AMI (Amazon Machine Image) with XtraDB release 8 installed on CentOS 5.3.

How to use it.

First make sure it is avaiable.

CODE:
  1. $ ec2-describe-images ami-4701e22e
  2. IMAGE   ami-4701e22e    xtradb/centos-5.3-x86_64.fs.manifest.xml        834362721059    available       public          x86_64  machine
  3. $

Run it. It is built for x86_64 plaform, so allowed types are m1.large, m1.xlarge and c1.xlarge

CODE:
  1. $ ec2-run-instances ami-4701e22e -t m1.large
  2. RESERVATION     r-46b3432e      834362721059    default
  3. INSTANCE        i-ecc74084      ami-4701e22e                    pending         0               m1.large        2009-10-25T18:31:06+0000        us-east-1c

Wait till the instance starts

CODE:
  1. $ ec2-describe-instances i-ecc74084
  2. RESERVATION     r-46b3432e      834362721059    default
  3. INSTANCE        i-ecc74084      ami-4701e22e    ec2-75-101-203-143.compute-1.amazonaws.com      domU-12-31-39-0A-26-22.compute-1.internal       running      0
  4. m1.large        2009-10-25T18:31:06+0000        us-east-1c

Now it is up and ready.