Sort large CSV files on disk rather than in memory
Project DescriptionRelease History Download Files
Sort a CSV file on disk to save memory. The merge sort algorithm is used to break up the original file into smaller chunks, sort these in memory, and then merge these sorted files.
>>> from csvsort import csvsort >>> # sort this CSV on the 5th and 3rd columns (columns are 0 indexed) >>> csvsort('test1.csv', [4,2]) >>> # sort this CSV with no header on 4th column and save results to separate file >>> csvsort('test2.csv', , output_file='test3.csv', has_header=False) >>> # sort this TSV on the first column and use a maximum of 10MB per split >>> csvsort('test3.tsv', , max_size=10, delimiter='\t')
$ pip install csvsort