… pt-upgrade a try. It also reads every type of log now (slow, general, binary, and tcpdump), so you shouldn’t… its primary objective: analyzing MySQL query logs. So the ability to parse memcached, Postgres, Apache, and other logs was removed. We also removed…
Post: Just do the math!
July 6, 2009 By 4 Comments
… reports from your apache log files – how many distinct visitors hit the page and stuff like that. You picked full logs because they… ? Say you have query like “SELECT page,count(*) cnt FROM logs GROUP BY page ORDER BY cnt DESC LIMIT 100″ to…. For MyISAM table and longer rows as you see in Apache logs I’d estimate 500K rows/sec scanned if data is…
Post: Detailed review of Tokutek storage engine
April 28, 2009 By 21 Comments
… for log analyzing and log reporting queries. By log analyzing I mean any kind of log producing application, it can be from simple apache logs put into mysql, application performance logs to more complex log like clicks…
Comment: Just do the math!
July 11, 2009 By 4 Comments
… to care to throw in the data (like from the apache log in realtime). Compared to today where I most likely would… of the aggregation on my own with 2 inserts per log line instead of just 1 (one to the large log db and one to the aggregated db). If im not …
Comment: How many partitions can you have ?
December 5, 2009 By 19 Comments
… dropping a slightly related question, I’m planning on having Apache log to MySQL for a shared web platform that will have…’s about the only safe and consistent way to achieve logging given quirks of the platform. I’ve been intending to…
Post: High-Performance Click Analysis with MySQL
December 22, 2008 By 13 Comments
…, pre-aggregate. Suppose your data is coming from some Apache log or similar source. Write a script to rip through… that with LOAD DATA INFILE. Keep those big fat log files out of the database. The database is usually…
Post: Lighttpd as reverse proxy
June 17, 2008 By 28 Comments
…/speedup-your-lamp-stack-with-lighttpd/ ) , redirect dynamic requests to apache and handle static files by itself. I just gathered step… /etc/lighttpd/lighttpd.conf Create directory to store log files, e.g. /var/log/lighttpd. Despite it looks simple, lighttpd may just… this file with htpasswd utility from apache. and finally make changes related to proxy 1. Move apache from 80 port to another…
Post: Speedup your LAMP stack with LigHTTPD
May 21, 2006 By 14 Comments
… changes in your application if you used apache specific modules – ie mod_rewrite, .htaccess, apache specific environment variables etc. So this is… efficiency dramatically). Such solution also typically allow you to relieve Apache from serving static content – Proxy may be configured to handle… itself. The tiny but annoying with such configuration could be logging. Instead of real IP of your clients you would see…
Post: How Percona does a MySQL Performance Audit
November 24, 2008 By 17 Comments
… extensive than this article can cover, and might wander into Apache, networking config, caching layers, etc. Wherever the problem is, we… the website is slow; assume also I’ve checked out Apache and network config, etc, and I don’t see anything…/my.cnf –pid-file=/var/run/mysqld/mysqld.pid –log-error=/var/log/mysqld.log mysql 3172 3137 78 Nov19 ? 1-11:17…
Post: mk-query-digest, query comments and the query cache
… query times, etc, and automatically places this information into the Apache environment. It also includes support for “augmenting” SQL queries with… comment. This information can then be cross-referenced between MySQL logs and Apache logs. select 1 — File: myfile.php Line: 25 Function: myFunc…