What does working with large data sets in mySQL teach you ? Of course you have to learn a lot … when working with large data things in MySQL is patience and careful planning. Both of which relate two single property of large data sets – it… for small data set may not apply to large data set so you need to re-test your “final design” again with large set…
Post: Testing MySQL column stores
August 16, 2010 By 15 Comments
… had the opportunity to do some testing on a large data set against two MySQL column-store storage engines. I’d like to… focused on testing a total of 29 queries on the large data set. I compared a number of different factors between the… of results of queries over the large data set Speed of results of queries over the large data set Basic security aspects The report…
Post: Upcoming Webinar "Managing Big Data with Percona Server, XtraBackup and Tungsten"
February 2, 2011 By 3 Comments
… Percona Webinar with full description: Big data is a big problem for growing SaaS businesses and large web applications. In this webinar… provisioning of large data sets, and how to replicate scalably and safely using Tungsten Replicator with parallel apply. Bring your big data questions…
Post: MySQL Indexing Best Practices: Webinar Questions Followup
August 16, 2012 By 4 Comments
… be able to be used, which can be important for large, heavily written tables. Q: in trick #1 will “WHERE a… MySQL can avoid temporary table or filesort for group by by this column. This works because by scanning data in index order MySQL gets data in already sorted order and looks at “one…
Post: Why MySQL could be slow with large tables ?
June 9, 2006 By 141 Comments
… should mention one more MySQL limitation which requires you to be extra careful working with large data sets. In MySQL single query runs as single thread (with exeption of MySQL Cluster) and MySQL issues IO requests…
Post: Shard-Query turbo charges Infobright community edition (ICE)
May 6, 2011 By 23 Comments
…respectively. There are nearly 400 major airports included in the data set. mysql> select count(*) from dim_airport; +———-+ | count(*) | +———-+ | 396 | +———-+ 1 … and very large data sets may be processed. As each machine examines only a small subset of the data, performance can …
Post: High-Performance Click Analysis with MySQL
December 22, 2008 By 13 Comments
… character data; try to make your rows fixed-length. One reason denormalization is important is that nested-loop joins on large data sets are very expensive. If MySQL supported sort-merge or hash joins, you… pretty much inevitable: if you do this kind of data processing in MySQL, you’re going to end up heavily I/O…
Post: What to tune in MySQL Server after installation
September 29, 2006 By 118 Comments
… even with large data set but it will crawl with default innodb_buffer_pool_size. Also Innodb buffer pool caches both data and…_file_size Very important for write intensive workloads especially for large data sets. Larger sizes offer better performance but increase recovery times… you can lose transactions even in case MySQL Server crashes. Value 2 only cause data loss with full OS crash. table_cache…
Post: Data mart or data warehouse?
July 15, 2010 By 14 Comments
… with and without aggregation over multiple MySQL storage engines at various data scales. What is a data warehouse? It turns out that this… where they maintain a large historical data warehouse, but they also build data marts for OLAP analysis from the warehouse data. A different approach…
Post: State of MySQL Market and will Replication live ?
April 9, 2008 By 29 Comments
… performance problems (like scaling Writes with replication or dealing with large data sets). Web crowd simplicity and really had a little choice… scalability issues MySQL could not solve well. There are inhouse and opensource solutions for tasks for large scale file storage, queuing, data processing… see as response to these requirements ? From MySQL side we have further development of MySQL Cluster to be more usable for web…
