May 25, 2012

Post: Data mart or data warehouse?

…aggregation process. Comparing the performance of OLAP with and without aggregation over multiple MySQL storage engines at various data scales….commercial database software supports hash joins, bitmap indexes, table partitioning, parallel query execution, clustered tables and materialized views. …

Post: Shard-Query adds parallelism to queries

… range of records. This table is partitioned by month which means that MySQL can use partition pruning to reduce the amount of data… that Shard-Query performs better is that it turns the OLAP query into something more like OLTP. Instead of getting one… I was talking about. Even though the data is partitioned, MySQL will examine each partition serially. In the end, this means that things…

Comment: Top 5 Wishes for MySQL

… from Oracle and SQL Server background, where parallel query and partition give you the performance for multiple CPUs and fast IO… large Data warehouse with 16 CPU cores with MySQL. Now I realize that MySQL is just not there in terms of parallel queries, which are so fundimental to ETL process and OLAP processing. Hope MySQL catch up with Oracle and SQL Server soon. Love…

Comment: Shard-Query adds parallelism to queries

… doing olap cubes? Also, how hard would it be to modify shard-query to work with sqlite3 db’s vs. mysql. I… load/performance for doing sqlite would be ok if i partition the tables often enough, since queries would be read-only…