From: David Morton <mortonda@...>
Date: 2004-08-21T14:03:37+09:00
Subject: Re: ruby-doc.org content snarfing

James Britt wrote:
> this, and if it were simply due to popularity I'd be thrilled.  But it 
> appears that someone has been running wget and snarfing the site wholesale.

Not sure if this is the problem, but I noticed that 
http://www.ruby-doc.org/robots.txt doesn't exist. Is it getting hit by 
search bots?