From: James Mulholland <james.mulholland@...>
Date: 2005-11-29T06:07:12+09:00
Subject: Re: Problem fetching web-page

> I changed the user agent sent in the request headers, and the requests
> were fine after that.

Precisely that -- thanks! Seems like changing the UA to anything (I
chose the well-known "foobar" browser for my first test :) will do the
trick:

print( http.get( '/', "User-Agent" => "foobar" ).body )

Thanks again.

--
James M


On 11/28/05, James Britt <james_b@neurogami.com> wrote:
> Gregory Brown wrote:
> > On 11/28/05, James Mulholland <james.mulholland@gmail.com> wrote:
> >
> >
> >>That looks like (I'm guessing) some kind of return message from a
> >>load-balancer or other proxy. I've tried this from 3 different systems
> >>(which use different ISPs) so I don't think it's my system.
> >
> >
> > Using open-uri, this is what I get:
> >
>
>
> When I launch the Web 2.0 Validator (web2.0validator.com), I pointed it
> at digg.com (among other sites) and it rejected the request.
>
> I changed the user agent sent in the request headers, and the requests
> were fine after that.
>
>
> James Britt
>
> --
>
> http://www.ruby-doc.org       - Ruby Help & Documentation
> http://www.artima.com/rubycs/ - Ruby Code & Style: Writers wanted
> http://www.rubystuff.com      - The Ruby Store for Ruby Stuff
> http://www.jamesbritt.com     - Playing with Better Toys
> http://www.30secondrule.com   - Building Better Tools
>
>