From: "Nicolas Desprès" <nicolas.despres@...>
Date: 2006-10-14T01:58:04+09:00
Subject: robots.txt protocol support for Ruby

Hi there,

I'm looking for a ruby gem supporting the robots.txt protocol such as
described at:

http://en.wikipedia.org/wiki/Robots.txt
http://www.robotstxt.org/
http://www.conman.org/people/spc/robots2.html

I've found this one:

http://groups.google.com/group/comp.lang.ruby/msg/16f16935bf83c8c6?dmode=source&output=gplain

on comp.lang.ruby but it doesn't support it totally.
Any other pointer is welcomed.

Cheers,

-- 
Nicolas Despr�s