From: Konrad Meyer <konrad@...>
Date: 2007-12-15T10:14:24+09:00
Subject: Re: [noob] Parsing problems using https and redirects

--nextPart8621956.b1nWXNgsuY
Content-Type: text/plain;
  charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

Quoth Ramiro Diaz Trepat:
> Hello list,
>    I have to develop a simple script to parse some parts of a web site an=
d I
> thought it could be a good opportunity to start trying Ruby.
>    I found that there are two network libraries that I could supposedly u=
se
> to retrieve the contents of the web site: open-uri and net-http.
>=20
> *First problem*
>    This web site is accessed only with https and has a self issued
> certificate.  This has made it impossible so far for me to access the
> contents of the web site.
>    Simple examples from the Hpricot html parsing library like this one:
>=20
> require 'hpricot'
> require 'open-uri'
> doc =3D Hpricot(open("https://xxxxxx"))
>=20
>    will not work because the open will fail because of problems due to
> https.
>=20
> *Second problem*
>    I need to know also how to handle redirection and cookies.  But to be
> fair, I still can do some further reading myself on these issues.
>=20
>    Thank you very much.

2) Look at mechanize.

1) Look at http-access2 (or whatever it's been renamed to).

Regards,
=2D-=20
Konrad Meyer <konrad@tylerc.org> http://konrad.sobertillnoon.com/

--nextPart8621956.b1nWXNgsuY
Content-Type: application/pgp-signature; name=signature.asc 
Content-Description: This is a digitally signed message part.

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.7 (GNU/Linux)

iD8DBQBHYypyCHB0oCiR2cwRAviJAJwMBAsitEZwBclDnoxEMFXiKqX5UwCbBkcn
fuvlH8dFdUkvVwg4reEwLYk=
=Gtvr
-----END PGP SIGNATURE-----

--nextPart8621956.b1nWXNgsuY--