From: Davide Benini <nutsmuggler@...>
Date: 2008-09-11T18:55:27+09:00
Subject: Re: How to check if a webpage exists

Ok folks, I probably see what's wrong.
The latest example works

begin
  puts open("http://www.does.not.exist.sdadasdas.com",:proxy=>true).read
  p "i'm ok"
rescue => e
  p "sorry can't do"
  p "error is: #{e}"
end

I get "sorry can't do" "error is: 400 Bad Request".

But if I do this

begin
  puts open("http://www.jhkhjhkj.com",:proxy=>true).read
  p "i'm ok"
rescue => e
  p "sorry can't do"
  p "error is: #{e}"
end
 I get
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" 
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"><html 
xmlns="http://www.w3.org/1999/xhtml"><style 
type="text/css">body{font-family:Arial, Helvetica, FreeSans, 
sans-serif;font-size:16px;color:#333;margin:10px 0 0 
0;padding:0}a{color:#333;outline:0}a:hover{text-

etc etc

This is a page that my (!%&%&!) ISP loads when no page is encountered. 
So the problem is that open gets a page from a redirect, right?
The problem is that my rails application, a kind of spider, is supposed 
to load a number of pages; if one server gets down, I don't want it to 
be get stuck. Moreover, when the app will run online, my hosting server 
might react in a different way. Is there a way to make sure the page 
loaded is the page I asked for, not an error, a redirect or anything 
else?
What do you suggest?
Davide
Davide
-- 
Posted via http://www.ruby-forum.com/.