Please don't scrape me

Saturday, December 19, 2009

I spent some time today going through my server logs, trying to figure out why my CPU usage has gone up 200% this week. I found that someone has been running a script to grab the En Garde ranking scores every two minutes. I'm not sure why anyone would want to do such a thing, except maybe to redisplay them somewhere else.

Please don't scrape data from this site like that. If you do need statistics please contact me first; maybe we can work something out.

Whoever was doing the scraping has been banned from the site. So if you're seeing a bunch of "Access Denied" when you try to get to, send me an email or IM.



Post a Comment