[IMC-Boston-Editorial] BIMC site down

[Jonathan D. Proulx]

On Thu, Aug 03, 2006 at 11:38:15AM -0700, Sofia JarrinT wrote:
:hi Jon!
:  
:  Just FYI that our site's down. Hope it wasn't hacked... 

Not down. When yahoo spiders us they do it very poorly and take up all
available connection slots, this combined with some bugs in Dada that
make it keep asking for non existant pages without getting a 404 error
means life sucks for us when they do this.

I'm not sure that's what happened (since we don't log IPs) but when I
first looked things were slow and the web server and database server
were reallyt busy and now they're not, which is consistent with the
spider problem.

We can block yahoo with a robots.txt file, but I presume we do want
them to index us.

-Jon