Shard-Query is an open source tool kit which helps improve the performance of queries against a MySQL database by distributing the work over multiple machines and/or multiple cores. This is similar to…
Post: Using any general purpose computer as a special purpose SIMD computer
May 16, 2011 By 6 Comments
… example, just like the MySQL client. This will be a linear operation because Shard-Query has no idea how to add parallelism in this case… one query. If your database system can not provide native parallelism, then performance will be poor. — SQL TO SEND TO SHARDS: Array ( [0] => SELECT…
Post: Distributed Set Processing with Shard-Query
May 14, 2011 By 27 Comments
…to understand about SQL is that it is declarative. That is, you tell the database what you want but not how to…MySQL storage nodes are supported. Amdahl’s law applies to the distributed processing. The results from the slowest node will place a…) flight_delayed`) — SQL TO SEND TO SHARDS Array ( [0] …
Post: Upgrading MySQL
January 5, 2010 By 23 Comments
…MySQL always was very good maintaining on disk binary compatibility between version and so you can run MySQL 5.0 database with MySQL…a bit so if something happens (like MySQL crashes) you have only one/few shard to deal with. P.S Happy New Year to…
Post: Is your MySQL Application having Busy IO by Oracle Measures ?
January 8, 2012 By 1 Comment
…to mention what James calls “Busy” Oracle database application when it comes to…a lot better performance with multiple MySQL instances on powerful storage. When you move to multiple instances and you have to “shard…
Post: Finding your MySQL High-Availability solution – The questions
October 16, 2009 By 36 Comments
…, let’s move on! How to determine which MySQL High-Availability solution is best? What is really tricky with MySQL is the number of… sharding environment, if you are planning for a growth that will need sharding (splitting the database over multiple servers), then you might need to take a…
Post: MySQL performance on EC2/EBS versus RDS
August 4, 2011 By 10 Comments
…MySQL database. When you do, the limitations on the core counts and effective CPU speeds can be a…a big database in the Amazon cloud platform, bigger than a single instance can hold or with more write activity, you need to plan to shard…
Post: MySQL-Memcached or NOSQL Tokyo Tyrant - part 3
October 19, 2009 By 25 Comments
…to MySQL and Memcached, and later on other NoSQL solutions. Tokyo actually allows you to use several types of databases…’s not to say we could not shard it based on a hash,…a relational database. Before building your next application try and understand whether an RDBMS is really needed or not. How…
Post: Aligning IO on a hard disk RAID – the Benchmarks
June 9, 2011 By 11 Comments
…to IO alignment yourself. In this case offset is correct, but file system is unaware how to…to databases – random reads and random writes – IO alignment on a 4-disk RAID10 with standard 64k stripe element size makes a…
Post: MongoDB Approach to Availability
April 30, 2010 By 2 Comments
…to MyISAM database will need to be repaired if it crashes. Still I find behavior somewhat similar – you’re not expected to run MySQL…a time for them to stabilize as well as later develop tools around them. How to…
