From: Thufir Date: 2009-11-15T17:45:14+09:00 Subject: Re: scrape html gives partial result On Nov 13, 8:33 pm, Marnen Laibow-Koser wrote: [...] > > In terms of design, I'm considering the pros/cons for breaking of the > > html to another table. [...] > It depends on the conceptual structure of the > application.  I doubt that > performance would be enough of an issue to worry about. Yeah, figured as much. Partly as an exercise, I'll try for a base model of "items" with a related model of "pages." [...] > > Also, I don't want to accidentally re-fetch the html > > and end up with a > > bunch of 404 error pages [...] > Do you need a boolean?  Just test whether the HTML field is null. Ah, right. -Thufir