From: Matt Harrison <iwasinnamuknow@...>
Date: 2010-06-23T01:07:32+09:00
Subject: limiting download size with net::http

Hi list,

I got bored so I'm writing a little web spider in ruby. I've got several features
planned like content type limits etc, but I'm stuck with the size limit.

If I check against content_length from the headers of the response object, it's
already downloaded the body. How can I check and exclude based on the content_length
before the whole body is downloaded?

Thanks