… out an important use case for PARTITIONing (“uneven reads”, Re: #1); let me rephrase the use case — * The entire table is… single-row writes are likely to be slower in PARTITIONed tables unless you include something to facilitate pruning. A billion rows in a… would be about 4 levels. A “point query” in a billion-row (non-partitioned) table will, at worst, hit the disk only…
Comment: Percona Server 5.5.30 with TokuDB for MySQL
April 28, 2013 By 26 Comments
… TokuDB: “ERROR 1030 (HY000): Got error -1 from storage engine” The table has approximately 1.6 billion rows and I used “ALTER TABLE ENGINE…
Post: Benchmarking single-row insert performance on Amazon EC2
May 16, 2012 By 17 Comments
… tool iiBench which has been developed by Tokutek. Though the “1 billion row insert challenge” for which this tool was originally built is… partitioning scheme such that every partition would hold 100 million rows. Table Structure The table structure of the table with no… each instance of iiBench writing 200 million single row inserts, for a total of 1 billion rows. I ran the test both with the…
Comment: Benchmarking single-row insert performance on Amazon EC2
May 16, 2012 By 17 Comments
… main memory. Each row is on the order of 30 bytes in the primary table, and so a billion rows is about 30GB… IOstat. Tim’s measurements (http://www.tokutek.com/2012/01/1-billion-insertions-%E2%80%93-the-wait-is-over/) on a… started, today the challenge would be to index 10B rows, not 1B rows. And it’s still a good challenge. The URL…
Post: Beware of MySQL Data Truncation
February 7, 2009 By 4 Comments
… time goes and you see you may get over 4 billions of articles you change the type for article_id to… values(4300000000,1); Query OK, 1 row affected, 1 warning (0.00 sec) mysql> insert into article_comment values(4300000001,1); Query OK, 1 row affected, 1 warning (0.00 sec) mysql> insert into article_comment values(4300000002,1); Query OK, 1 row affected, 1 warning…
Post: Why MySQL could be slow with large tables ?
June 9, 2006 By 141 Comments
…, Yahoo, LiveJournal,Technocarati MySQL has installations with many billions of rows and delivers great performance. What could be the reason ? …: mysql> select count(pad) from large; +————+ | count(pad) | +————+ | 31457280 | +————+ 1 row in set (4 min 58.63 sec) mysql> select…
Comment: Star Schema Bechmark: InfoBright, InfiniDB and LucidDB
February 19, 2010 By 48 Comments
…; load a SF-10,000 and a SF-1,000 (60 billion and 6 billion facts respectively) into one InfiniDB instance on a….infinidb.org/myblog-admin/mysql-parallel-query-processing-of-60-billion-rows-via-infinidb.html . Thanks – Jim Tommaney
Comment: How to find wrong indexing with glance view
August 23, 2008 By 27 Comments
… even in this case compound index quickly returns a few rows. Enough about intersections. About booleans. has_foto? How many of… is mandatory, but it can select few rows or many that depends. Final set? 1) (City, Age, Gender) or (City, Gender, Age… long indexes. Let’s consider you’re superb and have 1 billion of users. If you’re smart enough and read mysql…
Post: Sphinx: Going Beyond full text search
July 23, 2007 By 18 Comments
… using this combination to build search against over 1 billion of forum posts totaling over 1.5TB of data handling hundreds of thousands… up data stored quite significantly, requiring in average of 6 rows for each link and it does not solve all the… all URLs to search keywords and now these 6 rows become simply one row in sphinx index with 6 “keywords” – specially crafter…
Post: New OLAP Wikistat benchmark: Introduction and call for feedbacks
January 28, 2010 By 16 Comments
…: 724.550.811 rows. data size: 40476M Table datesinfo: 9624 rows, one entry represents 1 hour Table projects: 2025 rows Table pagestats Data for 2009-06: # 3.453.013.109 rows / size….375.618 rows / size 68152M So with two months of stats we have about 172GB of data with about 7 billion rows in…
