Hacker News new | ask | show | jobs
by webvet 4659 days ago
>I can't really see how your code or queries could cause mysql or apache to gradually slow down and then speed up...

Actually, we've ascertained that it is not the code or queries that cause this per se, but it is the traffic patterns - human visitors + SE crawlers... at times, there are (natural) traffic bursts and that's when the server starts choking.

apache/mysql - stock distros, with some config tweaks, mainly in my.cnf.

>what happens if you just kill one or the other?

Good call. Actually, restarting just apache does the trick most of the times. What we suspect is, abrupt flooding in http requests causes MySQL to slow down which causes http requests to get queued up and finally choke the service.

2 comments

Ok, I still think you probably need to spend some money on better hardware, but here are a few ideas for eeking out some more performance from your existing setup:

- Limit the max apache child processes/threads to what your server can easily handle. That way during busy periods people will get an occasional error connecting to your server (or wait a while), but at least mysql won't be thrashing your server so it might improve overall performance during the busy times.

- Figure out which queries are using the most cpu time and optimize those.

- Have a look at your most frequently accessed pages and see if you can optimize database access in those pages.

However if your users are still sometimes getting error messages accessing your site you have to ask yourself whether that is going to hurt your business.

Are you sure you have a database connection pool in place? Ensure the # of active connections remain constant no matter how many http requests are coming in.