June 19, 2013

Post: Aligning IO on a hard disk RAID – the Theory

… RAID with 256k stripe element size and a misalignment in partition table – partition /dev/sdb1 starts 11 sectors ahead of the stripe… Model: LSI MegaRAID 8704EM2 (scsi) Disk /dev/sda: 2339840000s Sector size (logical/physical): 512B/512B Partition Table: msdos Number Start End Size… system boot disk you are working on, you may not need partition table at all – you can just use the whole raw /dev…

Post: Aligning IO on a hard disk RAID – the Benchmarks

…MHz (0.8 ns) DIMM {OUT OF SPEC} Other … # Disk Schedulers And Queue Size ############################# sda | [deadline] 128 # RAID Controller ############################################…happened – for XFS file system on a raw partition I was using full partition size which was slightly over 1TB in…

Comment: Evaluating IO subsystem performance for MySQL Needs

… the OS device, to the RAID controller or to the disk drive ? Buffered or Unbuffered. If you have buffered writes which… see how close we get. Even if you test raw RAID partition you’re not testing drives you’re testing RAID controller…

Post: RAID throughput on FusionIO

… FusionIO cards RAID1 over 2 RAID0 partitions (4 cards in total) RAID0 over 2 RAID1 partitions (4 cards in total) special RAID10… runs, and raw results are below. As expected RAID1 over 2 disks shows hit on write throughput comparing to single disk, but RAID10… look into is different page sizes. Raw results (in requests / seconds, more is better): single disk read/112765.49 read/1631604.86…

Post: Shard-Query EC2 images available

… data entirely in memory. This frees disk to use on-disk temporary storage for hash joins and other…/ $ ./run_query < queries.sql | tee raw |./pivot_results & [1] 12359 $ tail -f ./raw — Q1 … At the end, you…, get a good plan optimizer-prune-level=0 partition=ON port=3306 read-buffer-size=512K read…

Post: Star Schema Bechmark: InfoBright, InfiniDB and LucidDB

…= 1000, which gave me 610GB of data in raw format and loaded into each engine. There … experts recommended me to extended swap partition to 128GB, but my partitions layout was not really prepared for,…available CPU cores full IO bandwidth reading from disk. You can see more details on InfiniDB …

Post: RAID and Scale Out Discussions

… than direct disks. For example for BoardReader now indexing almost billion of forum posts we decided to go ahead with raw drives… used for OS hard drive. Indeed using RAID for OS partition (software) is what we use even for low end boxes… inexpensive servers, basically moving redundancy one way up from the disk. It however would be rather expensive and can be only…