… it is not MySQL problem, might be even not problem with your MySQL configuration, queries and …process I would not use more than 4 parallel processes heavily writing to database. Introduce Throttling Sometimes even single process…For example if I need to delete old data instead of DELETE FROM …
Post: Troubleshooting MySQL Memory Usage
March 21, 2012 By 3 Comments
…by current MEMORY tables: mysql> select sum(data_length+index_length) from information_schema.tables where engine=’memory’; +——————————-+ | sum(data_length+index_length…have created and forgot to remove (or still use for processing). Of course you will see these tables going away …
Post: MySQL: Data Storage or Data Processing
November 18, 2007 By 9 Comments
… tend to use MySQL in modern applications and it stroke me in many cases MySQL is not used to process the data, at least not on the large scale – instead it is used for data storage… (ie memcache) is often implemented to offload MySQL. When it comes to large scale data processing other techniques are used. Google uses some…
Post: How to recover deleted rows from an InnoDB Tablespace
February 20, 2012 By 3 Comments
…-tool folder and the data like tablespaces and recovered rows in /root/recovery-tool/data. After the compile process we need to copy the salaries.ibd tablespace to the recovery-tool’s data directory. In… following link: http://www.percona.com/docs/wiki/innodb-data-recovery-tool:mysql-data-recovery:generating_a_table_definition With the table definition…
Post: Using Flexviews - part two, change data capture
March 25, 2011 By 11 Comments
… can pre-compute joins and may aggregate and summarize data. Using the aggregated data can significantly improve query response times compared to… a dedicated MySQL slave which has log_slave_updates=1 and binlog_format=row to process SBR changes from a MySQL master. I… processes the predictable output of this program. mysqlbinlog will always be able to read the binary logs of the version of mysql…
Post: Preprocessing Data
August 8, 2011 By 3 Comments
… the processing the application needs to do at a different point in time. In other words, if you preprocess your data ahead… there is no wait time when data is inserted. This can be done by forking processes or using a queuing system. You… database server. This is a form of batch processing. Examples could be reporting, data quality checks and optimizations. Intervals Similar to the…
Post: Distributed Set Processing with Shard-Query
May 14, 2011 By 27 Comments
… they can all participate in the distributed query processing. There is almost no data shipping, as only aggregated sets are sent over… SQL, but right now only MySQL storage nodes are supported. Amdahl’s law applies to the distributed processing. The results from the…. I’ll document that process shortly, I think I need to make some minor abstraction modifications in the data access layer. Shard…
Post: How fast can MySQL Process Data
April 9, 2008 By 3 Comments
… product is about beating data processing limitations of current systems. This raises valid question how fast can MySQL process (filter) data using it current architecture… considering abstraction of storage engine which requires “row by row” processing which means function calls for each row. Lets see if…
Post: How to Monitor MySQL with Percona's Nagios Plugins
February 22, 2012 By 8 Comments
… times. The pmp-check-mysql-file-privs plugin checks whether MySQL owns every file and directory within its data directory. InnoDB is getting… starting two instances of MySQL on the same files in the data directory, and refusing to shut down MySQL so that it is…. The server is allocating too much memory. A runaway server process, or poorly optimized queries, can consume too much memory and…
Post: How to recover a single InnoDB table from a Full Backup
January 25, 2012 By 7 Comments
… your tables are InnoDB the process is a little bit different story. With Oracle’s stock MySQL you cannot move your ibd…/mysql/data/employees/ Import the new tablespace: mysql> set FOREIGN_KEY_CHECKS=0; mysql> ALTER TABLE salaries IMPORT TABLESPACE; mysql> set FOREIGN_KEY_CHECKS=1; mysql…
