… the insertions easy. Basically you fill in 100 million rows, then start a new partition and fill that in. During the time…’s measurements (http://www.tokutek.com/2012/01/1-billion-insertions-%E2%80%93-the-wait-is-over/) on a newer… prediction that at 400M rows and 55GB RAM, Inno would hit a memory wall. Given that Memory sizes are perhaps 10 times…
Post: Predicting how long data load would take
May 24, 2007 By 12 Comments
… this question asked many times during last week, and there is really no easy answer… is very fast and Innodb can use insert buffer for them. Data Insert Order It is well known it is… affect load speed which makes it extremely hard to predict. Especially fact load can slow down dramatically as amount…
Post: Just do the math!
July 6, 2009 By 4 Comments
…find things not working any more with response times for individual queries taking half an hour or…one – scan the table, when for each row insert (or update) row in the temporary heap table…. conditions is very important as it allows to predict how performance will change with data size, cardinality…
Post: Using Flexviews - part two, change data capture
March 25, 2011 By 11 Comments
… data can significantly improve query response times compared to accessing the non-aggregated … the ‘mysqlbinlog’ utility and it processes the predictable output of this program. mysqlbinlog will… automatically be captured. Insert data in one transaction (two rows): mysql> insert into test.demo …
Post: Statistics of InnoDB tables and indexes available in xtrabackup
September 14, 2009 By 6 Comments
… lot of cases we insert into the primary key in order which makes things very predictable, but the inserts into the secondary key…, data=545126673 bytes, data/pages=96% As you see this time it takes 34383 pages (compare to 43255 in previous statistics… to see how it will grow with further inserts, and I also suspect random INSERTS into so dense space going to be…
Post: Data mart or data warehouse?
July 15, 2010 By 13 Comments
… from the source system(s) and then cleaned up and inserted into the data warehouse with ETL tools. This process is… years, months, quarters, or other time dimension attributes. This aids in identifying historical trends and making predictions about future trends. Data is… in each category. These types of warehouses are almost always “insert only”. Data is very likely never updated or deleted in…
Post: Commodity Hardware, Commodity Software and Commodity People
June 15, 2007 By 9 Comments
… to the errors. Look at early MySQL versions – if you insert too long data it would just strip it but continue… Services Do I see MySQL replaced in its space any time soon ? I do not think so. I do not think… hardware to offer quick response time, but only for short time frame. Anyway it is hard to predict the future so it would…
