From: Piyush Ranjan <piyush.pr@...>
Date: 2010-12-04T06:30:10+09:00
Subject: Re: Screen scraping an aspx site with Mechanize

--0016e6db2bf4fffaba0496883da9
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Even though you can probably do this with mechanize, I'd advice against it.

Aspx website keep lots of data in view state params and other things. Use
either
1. celerity in jruby or
2.  watir or selenium.

You can also dump mechanize and use only nokogiri to parse and post to the
https://portal.if.se/kopforsakring/ProductList.aspx?linkID=3D4 with all the
form data. That could be messy, though.

My 2 cents

Piyush

On Thu, Dec 2, 2010 at 10:49 PM, Sofie Willander <sofiewil@kth.se> wrote:

> Hi,
>
> I've been googleing for over a week now, but I can't find out how to
> screen scrape an aspx-site with Mechanize (and I must use mechanize).
>
> The site (https://portal.if.se/kopforsakring/ProductList.aspx?linkID=3D4)
> contains a button with the text "Bil" that I want to click, and after
> that click the continue button (green one with the text "Forts=E4tt").
>
> I've tried using Firebug to find viewstate, but I don't know what to do
> with it once I've found it.
>
> Am I one the right track?
> Can anybody help me?
>
> --
> Posted via http://www.ruby-forum.com/.
>

--0016e6db2bf4fffaba0496883da9--