From: John W Higgins <wishdev@...>
Date: 2009-10-22T12:33:00+09:00
Subject: Re: memory leak

--001636d352886c25eb04767dc0ca
Content-Type: text/plain; charset=ISO-8859-1

Evening Rob,

May I ask why you need threads and that level of complication? Are you
really that sensitive towards speed that it really matters if you simply
forked processes that died after 100 downloads and just started another
worker? It would seem to be easier to use a nice simple independant message
queue and just fire up workers that grab messages and download away.

I know it's not the sexy option but what exactly are you gaining by using
threads here? Much easier to get a nice single threaded worker tuned up and
tight then what you appear to be going through here. In fact - I might argue
that you would be better with a downloader and separater parser processes
that worked independantly via messages.

Just a thought....

John

--001636d352886c25eb04767dc0ca--