June 19, 2013

Post: Recovery after DROP & CREATE

…/src/recovery-tool/s_tools/dumps/default/SYS_INDEXES‘ REPLACE INTO TABLE `SYS_INDEXES` FIELDS TERMINATED BY ‘\t’ OPTIONALLY ENCLOSED BY ‘”‘ LINES…: PK len (compressed ulint, 1-5 bytes) PK data old values: n_fields (compressed ulint, 1-5 bytes) field_no (compressed ulint, 1-5 bytes) field_len (compressed ulint, 1-5 bytes…

Comment: Full text search for all MySQL Storage Engines

… fast and efficient way to compress the vectors. Some realworld stats for above engine: 1 million indexed posts (raw size about 750… MB index. The average size of the LZF compressed vectors are 169 bytes (compared to 12.5 kbyte (100kbit) if not compressed), where the largest compressed vector is 12501 bytes and the smallest compressed vector is 2 bytes. More…

Comment: Full text search for all MySQL Storage Engines

… per indexed post. By using bitvectors this has been limited down to 100bit (12.5 bytes) which also can be compressed with LZF since its sparse vectors (actually you can use any compression algorithm you like but I… means that even without compression the ratio it is approx 64:1 between using a regular reversed index and the vectorbased storage…

Post: Real-Life Use Case for "Barracuda" InnoDB File Format

… I’d like to share some real-life example how compression in InnoDB plugin could be useful for large warehousing tasks… optimizations and I’ve tried to convert this table using COMPRESSED row format. This time conversion took 1,5 hours and… index pages compression (by default it is trying to compress 16kb pages down to 8kb) new innodb plugin performs TEXT/BLOB/VARCHAR fields compression

Post: My Innodb Feature wishes

… caused by the fact Innodb does not have prefix compression for its indexes, as MyISAM has which in certain cases makes them 10 times + larger. Heikki plans to have gzip like page compression but it would only give up to 2 times space compression. Insert buffer for delete. For…

Post: Shard-Query EC2 images available

…_row_length: 241 Data_length: 1616904192 Max_data_length: 0 Index_length: 539279360 Data_free: 4194304 Auto_increment: NULL Create_time… is the excellent compression that RLE techniques provide. I have not loaded InnoDB compressed tables yet but since InnoDB compression is not RLE, I doubt it will have the same impact. For large datasets effective compression

Post: Falcon Storage Engine Design Review

… which people do quite frequently with MySQL :) [+] Compact Indexes Compact Indexes are great. Huge indexes is where large portion of Innodb performance problems…, clustered by (user_id,message_id). [+] Row compression Falcon uses some nice fast row compression methods, for example using only as many…

Post: Blob Storage in Innodb

… page – you can build prefix indexes on blobs which are often stored outside the page. COMPRESSED row format is similar to DYNAMIC… strategy storing BLOBs completely off page. It however will always compress blobs which do not fit to the row page, even if KEY_BLOCK_SIZE is not specified and compression for normal data and index pages is not enabled. If you’re interested…

Post: InnoDB page sizes: plans and ideas

… ? For InnoDB compression. Right now if you use 16K and trying to compress, the only good choice is to compress to 8K pages (which gives you only 2:1 compress ratio), and… sizes with ability to set parameter per table and per index would make InnoDB really flexible for different type of use…

Comment: Blob Storage in Innodb

… even larger blobs which can use less external pages. When compressed. Check this out: mysql> create table comptest(b mediumblob); Query…: 10 Row_format: Compressed Rows: 1 Avg_row_length: 32768 Data_length: 32768 Max_data_length: 0 Index_length: 0 Data_free…_options: row_format=COMPRESSED Comment: 1 row in set (0.00 sec) In this this is highly compressible long blob gets some…