From: Greg Hauptmann Date: 2008-04-27T06:28:52+09:00 Subject: Re: help re recording/replaying (i.e. automating) HTTP interactions to a web-site??? PS. 4th question Peter I forgot: • does it support downloading a file (eg csv file, account transactions) On 4/27/08, Greg Hauptmann wrote: > sounds good, it support: > • https? > • cookies? > • building in some intelligence? (say when the link for step N will > change over time but you can write an algorithm for it) > > thanks > > On 4/26/08, Peter Szinek wrote: > > Greg, > > > > Have you looked into (Fire)Watir? > > > > I am just releasing a new version of scRUBYt! (a web scraping > > framework) where it will be possible to use FireWatir as the agent for > > navigation/scraping, so you can write a simple but powerful DSL (stuff > > like 'click_link', 'fill_textfield' etc) which is executed through > > Firefox and is very well suited for scenarios you just described. Drop > > me a line if you are interested. > > > > But of course plain (Fire)Watir would do, too. > > > > Cheers, > > Peter > > ___ > > http://www.rubyrailways.com > > http://scrubyt.org > > > > On Apr 26, 2008, at 10:47 AM, Greg Hauptmann wrote: > > > > > Hi, > > > > > > Actually can anyone recommend a good technique / software / plugin > > > that would assist if I wanted to effectively (a) record my interaction > > > with my bank at the HTTP level, then (b) use this to automate that > > > behavior in my RoR application to automate pulling down daily account > > > details? > > > > > > The best I can think of at the moment is: (a) Firefox Live HTTP > > > Headers plugin then (b) manually write Ruby code that sends these out > > > and waits for the response & check it before proceeding to the next > > > http request. I'm thinking someone probably has a better way, or > > > plugin, to handle at least part (b)? > > > > > > Tks > > > > > > > >