The main index should be able to grow larger than what fits into memory

The main index should be able to grow very large without running out of memory. This means we have to be able to page ranges in and out. We should look into existing libraries for this, as there may be something out there. Note that whatever we use has to be able to handle inserting elements out of order, so something like FST is no good here.