From: Adam Akhtar Date: 2008-08-17T01:13:46+09:00 Subject: Re: firefox html, my downloaded html and firebug html different? Thank you everyone for your help so far. I tackled the problem by not viewing firefox source or firebugs, instead i just saved and viewed the html code downloaded via open(a_url) with open-uri. I wasnt sure if this did any `tidy up` like firefox or firebug but after various trys i could be confident that what it downloaded was the real deal. That meant though that id have to view the html in something like notepad and it aint easy to read. I really wish I could rely on the code firebug displays as its so easy to find the areas you need to restrict your searches to. As a side note is there a plugin or libary that sits in between your code and the targets webpage. The plugin would `clean` the code as its downloaded? Perhaps in an identical way to firebug? The upside would be that it would be easier to grab what you want as there would be more regular structure, downside i guess would be longer run times. Just a thought though. Ive used hpricot a while ago and it wasnt so great on badly designed webpages so i ended up resorting to regexps. But if i find a nice website i think ill give it another try! -- Posted via http://www.ruby-forum.com/.