MySQL Performance Blog

Dear Community,

As of today release 0.9.5rc is available.

In this release there are following changes:
Changelog:

• Option –no-lock is added to innobackupex-1.5.1. Use it only while ALL your
  tables are InnoDB and you DO NOT CARE about binary log
  position of backup
• XtraBackup is ported for InnoDB Plugin 1.0.4. Barracuda file format as well as compressed tables are supported. We thank a well known Social Network site for the sponsorship.
  
• Windows conscious change more
• Impoved error messages in innobackupex
• Windows conscious experimental change
• Suppress purge when –stats
• Build number in RPM name. For instance, in the name xtrabackup-0.9.5rc-50.rhel5.x86_64.rpm 50 is the build number.
• Suppress master_thread ibuf operations for –stats
• Suppress ibuf operations for –stats
• fFx fatal bug at –backup when added –stats
• New option –stats to gather index stats
• Fixed some bugs for a 32bit platform

Fixed bugs:

• Bug #435634 in Percona-XtraBackup: “xtrabackup can’t write to a file on windows”
• Bug #437788 in Percona-XtraBackup: “xtrabackup.exe can’t write to a file”
• Bug #386535 in Percona-XtraBackup: “ibbackup_binlog_marker bug still persists”
• Bug #402884 in Percona-XtraBackup: “tries to create temporary tables in relative ./tmp directory”
• Bug #417178 in Percona-XtraBackup: “can’t backup tables with $ in name”

The binary packages for RHEL4,5, Debian, FreeBSD, MacOS as well as source code of the XtraBackup is available on http://www.percona.com/mysql/xtrabackup/0.9.5rc/.

The Debian package is also available via APT. Just add these lines  in /etc/apt/sources.list

deb http://repo.percona.com/apt lenny main
deb-src http://repo.percona.com/apt lenny main

Update the local database

# apt-get update

And install xtrabackup

# apt-get install xtrabackup

The project lives on Launchpad : https://launchpad.net/percona-xtrabackup and you can report bug to Launchpad bug system:
https://launchpad.net/percona-xtrabackup/+filebug. The documentation is available on our Wiki.

For general questions use our Pecona-discussions group, and for development question Percona-dev group.

For support, commercial and sponsorship inquiries contact Percona.

Dear Community,

Today we are announcing XtraDB release 7.
This is the last release based on InnoDB plugin version 1.0.3, as you might know Innobase has released 1.0.4.

The release includes following new features:

• MySQL 5.1.37 as a base release
• speed hack for buf_flush_insert_sorted_into_flush_list controlled by the new variable innodb_fast_recovery

Fixed bugs:

• MySQL Bugs: #45357: 5.1.35 crashes with Failing assertion: index->type & DICT_CLUSTERED
• Bug #405714 in Percona-XtraDB: “During page flush it may be enqueued for flush again when innodb_flush_neighbours=0”
• Bug #395783 in Percona-XtraDB: “main.innodb_bug42101 fails on 5.1.36”

This fixes also http://bugs.mysql.com/bug.php?id=45749 and http://bugs.mysql.com/bug.php?id=42101

The builds for RedHat4,5 and Debian are located on http://www.percona.com/mysql/xtradb/5.1.37-7/
The latest source code of XtraDB, including development branch you can find on LaunchPAD.

Please report any bugs found on Bugs in Percona XtraDB Storage Engine for MySQL.
For general questions use our Pecona-discussions group, and for development question Percona-dev group.

For support, commercial and sponsorship inquiries contact Percona

Dear Community,

The 18-th build of MySQL server with Percona patches is available now.

Comparing to the previous release it has following new features:

• The build is based on MySQL-5.0.84
• Fixed the issue with CLIENT_STATISTICS
• New patch innodb_recovery_patches.patch greatly improves recovery time

Fixed bugs in the build:

• Bug #407117 in Percona patches: “any mysql-test fails with a warning “master.err: ctype_ucs2_def: InnoDB: Warning: some resources were not cleaned up in shutdown:”"
• Bug #352840 in Percona patches: “INNODB_BUFFER_POOL_CONTENT privacy issue”

You can download binaries and sources with the patches here

http://www.percona.com/mysql/5.0.84-b18/

The Percona patches live on Launchpad : https://launchpad.net/percona-patches and you can report bug to Launchpad bug system:

https://launchpad.net/percona-patches/+filebug. The documentation is available on our Wiki

For general questions use our Pecona-discussions group, and for development question Percona-dev group.

For support, commercial and sponsorship inquiries contact Percona.

Dear Community,

The build 17 of MySQL with Percona patches is available.

New features in the release:

• MySQL-5.0.83 is taken as the basis
• The new patch innodb_use_sys_malloc.patch is added
• The new patch innodb_split_buf_pool_mutex.patch is added

This patch splits the single global InnoDB buffer pool mutex into several mutexes for different purposes. This reduces mutex contention. It may help if you suffer performance loss when the working set does not fit in memory. You can detect buffer pool mutex contention by examining the output of SHOW INNODB STATUS and looking at the first section, SEMAPHORES.

• Google’s style IO – innodb_io_patches.patch
• FreeBSD .tar.gz package for amd64 platform is available

You can download binaries and sources with the patches here

http://www.percona.com/mysql/5.0.83-b17/

The Percona patches live on Launchpad : https://launchpad.net/percona-patches and you can report bug to Launchpad bug system:

https://launchpad.net/percona-patches/+filebug. The documentation is available on our Wiki

For general questions use our Pecona-discussions group, and for development question Percona-dev group.

For support, commercial and sponsorship inquiries contact Percona.

Dear community,

Today we are pleased to announce release 6 of XtraDB – the result of 2 months hard work.

The release includes following new features:

• MySQL 5.1.36 as a base release
• New patch innodb_recovery_patches.patch
• Experimental adaptive checkpoint method estimate
• innodb_stats – the implementation of the fix forMySQL Bug#30423
• expand-import Support of import InnoDB / XtraDB tables from another server
• split-bufpool-mutex-3 New patch to split buffer pool mutex
• g-style-io-thread Google’s fixes to InnoDB IO threads
• dict-size-limit Limit of internal data dictionary

Fixed bugs:

• MySQL Bugs: #39793: Foreign keys not constructed when column has a ‘#’ in a comment or default value
• Bug #395784 in Percona-XtraDB: “main.innodb_xtradb_bug317074 internal check fails on 5.1.36”
• Bug #395778 in Percona-XtraDB: “main.innodb-analyze internal check failed on 5.1.36”
• Bug #391189 in Percona-XtraDB: “main.innodb_bug36172 mysq test fails with innodb_stat.patch applied”
• Bug #388884 in Percona-XtraDB: “patching fails on 5.1.35”

The builds for RedHat4,5 and Debian are located on http://www.percona.com/mysql/xtradb/5.1.36-6/
The latest source code of XtraDB, including development branch you can find on LaunchPAD.

Please report any bugs found on Bugs in Percona XtraDB Storage Engine for MySQL.
For general questions use our Pecona-discussions group, and for development question Percona-dev group.

For support, commercial and sponsorship inquiries contact Percona

Dear community,

We are pleased to announce the build16 of MySQL server® with Percona patches.

Since the build13 there was a couple of customer specific releases, which explains cutover in numbering and a pause between the builds. Also we prepared build for both 5.0.77 and 5.0.82 versions.

Since that time new patches were added:

• profiling_slow.patch

This patch adds information from SHOW PROFILE to query information in slow.log output.
profiling_server. This variable ( ON / OFF ) enables profiling of all queries (in all connections).
profiling_use_getrusage. This variable ( ON / OFF ) enables usage of getrusage function in profiling.
Be careful, enabling profiling_server may cause performance degradation, especially with profiling_use_getrusage.

• innodb_extra_rseg.patch

innodb_extra_rsegments. The number of extra user rollback segments created when new db is created.
New information_schema table innodb_rseg shows information about all rollback segments

• innodb_thread_concurrency_timer_based.patch

This patch provides the configuration variable backport from MySQL 5.4.

Fixed bugs:

• Bug #382778: mysql-test variables fails on 5.0.77 with –with-debug
• Bug #381430: mysql-test profiling fails on 5.0.77
• Bug #375494: log_slow_rate_limit logs all queries on a connection after a >1s query
• Bug #378761: compilation fails on 5.0.77
• Bug #381900: mysql-test information_schema fails on 5.0.77 with –with-debug
• Bug #382783: compilation fails on 5.0.82

You can download binaries (RPMS x86_64) and sources with patches here
http://www.percona.com/mysql/5.0.77-b16/
http://www.percona.com/mysql/5.0.82-b16/

The Percona patches live on Launchpad : https://launchpad.net/percona-patches and you can report bug to Launchpad bug system:
https://launchpad.net/percona-patches/+filebug. The documentation is available on our Wiki

For general questions use our Pecona-discussions group, and for development question Percona-dev group.

For support, commercial and sponsorship inquiries contact Percona

We announce next beta version of our xtrabackup tool.

Changelist includes:

- set innodb_fast_shutdown=1 on xtrabackup shutdown
- set innodb_write_io_threads=10 by default for fast buffer_pool flushing during recovery
- build xtrabackup with –with-extra-charsets=complex
Bug #357653: innobackupex-1.5.1 –copy-back fails
Bug #358194: 2nd-phase is very slow
Bug #358266: xtrabackup-0.5 dies with SEGV on bad command line arguments
Bug #359341: innobackupex still does not read defaults-file

You can download current binaries RPM for RHEL4 and RHEL5 (compatible with CentOS also), DEB for Debian/Ubuntu and tar.gz for Mac OS / Intel 64bit there:
http://www.percona.com/mysql/xtrabackup/0.6/.
By the same link you can find general .tar.gz with binaries which can be run on any modern Linux distribution.
By the same link you can download source code if you do not want to deal with bazaar and Launchpad.

The project lives on Launchpad : https://launchpad.net/percona-xtrabackup and you can report bug to Launchpad bug system:
https://launchpad.net/percona-xtrabackup/+filebug. The documentation is available on our Wiki

For general questions use our Pecona-discussions group, and for development question Percona-dev group.

For support, commercial and sponsorship inquiries contact Percona

Today we glad to announce release 1.0.3-4 of our XtraDB storage engine.

Here is a list of enhancements in this release:

• Move to MySQL 5.1.33
• Move to InnoDB plugin 1.0.3
• more reliable replication, innodb_overwrite_relay_log_info patch now included in the release
• fix assertions for UNIV_DEBUG
• new fix for rw_lock patch

Percona XtraDB 1.0.3-4 (Sakura) available in source and several binary packages.

XtraDB is compatible with existing InnoDB tables (unless you used innodb_extra_undoslots) and we are going to keep compatibility in further releases. We are open for features requests for new engine and ready to accept community patches. You can monitor Percona’s current tasks and further plans on the Percona XtraDB Launchpad project. You can also request features and report bugs there. Also we have setup two maillists for General discussions and for Development related questions.

We added some new features to our backup tool, namely:

• Now we can handle log file taken during backup with size exceeding 4GB, it may happen if backup takes too long and you have a lot of updates on InnoDB tables
• Progress meter during recovery step, now you can see what percentage of log file was handled

Also we did extensive testing and fixed bugs, so now we consider current state as feature complete and with beta-release stability.

You can download current binaries RPM for RHEL4 and RHEL5 (compatible with CentOS also) and DEB for Debian/Ubuntu there
http://www.percona.com/mysql/xtrabackup/0.4/.
By the same link you can find general .tar.gz with binaries which can be run on any modern Linux distribution.
By the same link you can download source code if you do not want to deal with bazaar and Launchpad.

The project lives on Launchpad : https://launchpad.net/percona-xtrabackup and you can report bug to Launchpad bug system:
https://launchpad.net/percona-xtrabackup/+filebug. The documentation is available on our Wiki

For general questions use our Pecona-discussions group, and for development question Percona-dev group.

For support, commercial and sponsorship inquiries contact Percona

We are coming with next version of xtrabackup - online backup solution for MySQL 5.0 / 5.1 and InnoDB standard version, plugin modification and XtraDB. We still consider it as alpha version, though it shows perfect stable results in our tests.

Let me address two often asked question about xtrabackup:
1) Does it work only with XtraDB or with InnoDB also ?
A: xtrabackup is designed to work with standard version of InnoDB in MySQL 5.0. MySQL 5.1 + standard InnoDB / InnoDB-plugin also are supported. It can fully work as drop-in replacement of innodbackup tool and InnoDB Hot Backup online backup.

2) Do we need to run patched MySQL, because the build instruction mentions the patch for MySQL ?
A: xtrabackup can be run with any version of MySQL: community release, enterprise release, percona builds, ourdelta distributions. You do not need to patch MySQL to run backup. The patch for MySQL is needed only to build the binaries of xtrabackup from source code. If you are not comfortable with building from source we provide the binaries for xtrabackup-0.3

New version of xtrabackup contains the feature which is missed in InnoDB Hot Backup - the backup can be produced as stream and copied to remote box or tape, or compressed without needs to store full copy of database on local disks. Very often there is no space to store second copy of database and you need to mount SAN/NAS for extra space. So now you can run it as

and get copy on remote box.
Also new features in 0.3 - it can be compiled against 5.1 and it supports OS X (sponsored feature).

Now we are developing to next feature which is not available for InnoDB users in any form so far - it is incremental and differential backups. Having that you will be able to make copy only of CHANGED data since given backup, there will not be needs to copy whole 250GB datafile if it changed only 1GB of data since yesterday.

You can download current binaries RPM for RHEL4 and RHEL5 (compatible with CentOS also) and DEB for Debian/Ubuntu there
http://www.percona.com/mysql/xtrabackup/0.3/.
By the same link you can find general .tar.gz with binaries which can be run on any modern Linux distribution.
By the same link you can download source code if you do not want to deal with bazaar and Launchpad.

The project lives on Launchpad : https://launchpad.net/percona-xtrabackup and you can report bug to Launchpad bug system:
https://launchpad.net/percona-xtrabackup/+filebug. The documentation is available on our Wiki

For general questions use our Pecona-discussions group, and for development question Percona-dev group.

For support, commercial and sponsorship inquiries contact Percona