June 19, 2013

Post: Analyzing air traffic performance with InfoBright and MonetDB

… ( I really wish developers improve documentation), but finally I ended up with next load statement: /usr/local/monetdb/bin/mclient -lsql… FROM ontime WHERE DepDelay>10 AND YearD BETWEEN 2000 AND 2008 GROUP BY DayOfWeek ORDER BY c DESC Result: [ 5, 1816486 ] [ 4, 1665603… on more than 10 mins! -Q6: Let’s try the same query for wide range of years 2000-2008: Result is: [ “EV”, 443798…

Post: Shard-Query turbo charges Infobright community edition (ICE)

… dim_date using (date_id) WHERE DepDelay>10 AND Year BETWEEN 2000 AND 2008 GROUP BY DayOfWeek ORDER BY c DESC; — Q3….airport_id WHERE DepDelay>10 AND Year BETWEEN 2000 AND 2008 GROUP BY 1 ORDER BY c LIMIT 10; The next queries show…. There are benefits with both “scale-up” and “scale-out”, but once again, the “scale-out” results are the most striking. — Q4…

Post: Shard-Query adds parallelism to queries

… runs the SQL via ShardQuery and it prints the results. Test #1 This set of queries tests the … ‘2008-12-31′ GROUP BY Origin ORDER BY c DESC LIMIT 10; Q4 – SELECT carrier, count(*) FROM ontime WHERE DepDelay>10…those queries though, and I’ll post a follow-up when I do. — Full Disclosure — This is a …

Post: How Percona does a MySQL Performance Audit

… #1 SMP Tue Apr 29 13:16:15 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux [percona…path/to/slow.log By default, this outputs the top 10 most expensive queries, in total execution time. By the… we can frequently help customers set up much more efficiently and with better results, due to our knowledge of what…

Post: SSD, XFS, LVM, fsync, write cache, barrier and lost transactions

… on SSD outperforms RAID 10, but recently I faced issue which can make previous results inconsistent. In short …, and I did not expect this question poping up again. Long story is: I started with puting… LVM ignores write barriers (see http://dammit.lt/2008/11/03/xfs-write-barriers/ ), but again with …

Comment: Air traffic queries in LucidDB

…any opportunity and help to improve any feature/performance results. As you noted in your blog, LucidDB is … of data and size. I loaded years 1998 to 2008 since your queries where limited to that (although …you loaded another 10 years? However, even there, I’d only expect to see the size up to 5-6GB…