From: James Britt <james_b@...>
Date: 2005-11-29T05:51:23+09:00
Subject: Re: Problem fetching web-page

Gregory Brown wrote:
> On 11/28/05, James Mulholland <james.mulholland@gmail.com> wrote:
> 
> 
>>That looks like (I'm guessing) some kind of return message from a
>>load-balancer or other proxy. I've tried this from 3 different systems
>>(which use different ISPs) so I don't think it's my system.
> 
> 
> Using open-uri, this is what I get:
> 


When I launch the Web 2.0 Validator (web2.0validator.com), I pointed it 
at digg.com (among other sites) and it rejected the request.

I changed the user agent sent in the request headers, and the requests 
were fine after that.


James Britt

-- 

http://www.ruby-doc.org       - Ruby Help & Documentation
http://www.artima.com/rubycs/ - Ruby Code & Style: Writers wanted
http://www.rubystuff.com      - The Ruby Store for Ruby Stuff
http://www.jamesbritt.com     - Playing with Better Toys
http://www.30secondrule.com   - Building Better Tools