No Query Optimization
Database CPUs were red hot
I/O was not the bottleneck
All data easily fit in 1GB of RAM
Disks only spun for replication
Slow query log was very revealing!
Set threshold to 1 second
Log filled quicky
Some tables were missing key indexes
Some queries were always run twice