A python package that can fast random access any lines in a large file without high memory cost.
LineCache caches the line position of a file in the memory. Everytime it access a line, it will seek to the related postion and readline(). Noticing that it may cost some time when you first cache lines of a file.
from linecache_light import LineCache
linecache = LineCache(‘a.txt’, cache_suffix=’.cache’)
num_lines = len(linecache)
line_0 = linecache
line_100 = linecache
line_indexing = linecache[-1]