From: Konrad Meyer Date: 2007-09-18T04:26:50+09:00 Subject: Re: Screen Scraping Advice --nextPart70006898.XZClvLpk8L Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Quoth Chuck Dawit: > John Joyce wrote: > > On Sep 17, 2007, at 12:25 PM, Charles Pareto wrote: > >=20 > >> equipment. So I started by downloading the DNS list of all domain =20 > >> Posted via http://www.ruby-forum.com/. > >> > > Doesn't sound like much scraping, just searching text for a string. > > You could even do a lot of that work with Google. > > but just download the file and search for a string. create a data > > file of your own that tells you what line you found the string. > > Scraping is really for getting data from other sites, using the DOM > > structure they have to get (for example) the weather report. >=20 >=20 > Well, I disagree. Once I have all the websites with Cisco in its domain=20 > name and I look through them, there are lots of pages that won't show me= =20 > info unless I do a search within that page itself. (ex. usedcisco.com)=20 > To search for specific items on this website I would have to use the=20 > search bar located within its page to search for say "WIC-1T" and then=20 > search for a price below a specific amount for that item. Do a search on froogle for "cisco productname" with the max price set at 60% MSRP. Should turn up a few hits. HTH, =2D-=20 Konrad Meyer http://konrad.sobertillnoon.com/ --nextPart70006898.XZClvLpk8L Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (GNU/Linux) iD8DBQBG7tT2CHB0oCiR2cwRAkSTAKCBidojLcTIOPFVe7RXTK7a+E+RvgCgy4bW WL0lg6K5kV5r6PbMs8CimsA= =HOjz -----END PGP SIGNATURE----- --nextPart70006898.XZClvLpk8L--