From: Mark Wilden <mark@...>
Date: 2007-08-30T00:30:06+09:00
Subject: Re: Conducting Regular Expressions on a text file

On Aug 27, 6:53 pm, "Logan Capaldo" <logancapa...@gmail.com> wrote:
>
> To handle those really big files where you simply cannot afford to
> have two copies simultaneously, or don;t have the address space to map
> the whole file into memory with mmap, you can read in fixed sized
> chunks, modify them in memory and then write them back out. It's a bit
> more complicated than "fixed sized" chunks since the transformed text
> may be smaller of larger than the original chunk.

The other thing to watch out for is if the search text spans chunks.

///ark