… 7 million records: mysql> select count(*) from paintings where title != ltrim_junk(title); +———-+ | count(*) | +———-+ | 101533 | +———-+ 1 row in set (6.82 sec) mysql> select… case like this one where we have to process many records constantly and every second counts, UDF can really save your…
Post: How to find MySQL queries worth optimizing ?
September 11, 2012 By 6 Comments
… if I index the table I get the following record in the slow query log: # Time: 120911 17:18:… are found and returned up to the top level MySQL part for processing are counted the Rows_examined remains … k; This only sends 2 rows while scanning 10 million, while we can’t really optimize this query in …
Comment: How to find wrong indexing with glance view
August 22, 2008 By 27 Comments
… moves from millions to 20 records, it makes all the difference. Then your database doesn’t have to walk over a million records to find those 20 records. One other thought, if your not working with millions of records, you may have better results just by tweaking the MySQL config…
Post: MySQL-Memcached or NOSQL Tokyo Tyrant - part 1
October 15, 2009 By 16 Comments
… record 1, cache record 500,001 …. get record 1, miss, read from disk, expunge record 500,001, cache record… application I can then compare using MySQL to using MySQL + Memcached, and then to other solutions…application selects a random # between 1 and 2 Million and looks up the result via that …
Comment: What to tune in MySQL Server after installation
October 13, 2006 By 118 Comments
… these days with MySQL. I have a table that has 3.3 million records (size is around 500 MB) that stores records of members. Now I need to update the records of this table by reading data from a file that contains 1 million…
Comment: Handling big result sets
June 27, 2006 By 13 Comments
…: 1000000. execution time: 24.53382897377 s mysql_unbuffered_query: (same code, only changing mysql_query to mysql_unbuffered_query) Number of rows: 1000000… 10+ million records in there. The query I used: SELECT * FROM `current` LIMIT 1000000; I had to limit it to 1 million because it didn’t really like the whole 10 million 
(The waiting on the result…
Comment: MySQL Partitioning - can save you or kill you
July 2, 2012 By 45 Comments
… mind your suggestions about explain and force index use. The mysql 5.1 Manual Section 18.4 says –> This section discusses… very frequently. Deletion from MyISAM/InnoDb would happen everyday for records older than last 60 days. 50 users would simultaneously access…) – 4 secs for Query 1. Total Disk space used: 800 million records – 95 GBs.
Comment: When is it a time to upgrade memory ?
December 9, 2009 By 11 Comments
… I have few reading queries but on large tables (~10 millions rows) and a lot lot of insertions queries on these… 4Go but the whole database size is almost 8Go (~60 millions records). This database contains some real-time information, so if the… is my.cnf: [mysqld] datadir=/var/lib/mysql socket=/var/lib/mysql/mysql.sock user=mysql max_connections=600 connect_timeout=30 wait_timeout…
Post: High-Performance Click Analysis with MySQL
December 22, 2008 By 13 Comments
…re aggregating per-day, an ad that gets a million impressions takes one row, and an ad that gets… You can have the clicks column record the total, and the blue_clicks column record only blue clicks; to find…that work by either using MySQL 5.1′s row-based replication, or in MySQL 5.0 and earlier, doing…
Post: Using any general purpose computer as a special purpose SIMD computer
May 16, 2011 By 5 Comments
… document size significantly to over 3 million “words” by duplicating the entire set multiple times. mysql> load data infile ‘/tmp/words’ into….41 sec) Records: 3088896 Duplicates: 0 Warnings: 0 Here is the serial version as run by the native database interface (MySQL): mysql> select…
