[edoo]

Using mmap with the right flags should let you load and process huge files as well as if they were in ram.