A tool to convert CSVs to Parquet files
Project description
csv2parquet
Convert a CSV to a parquet file. You may also find sqlite-parquet-vtable useful.
Installing
If you just want to use the tool, install it and its dependencies via pip:
sudo pip install pyarrow csv2parquet
If you want to clone the repo and work on the tool, install its dependencies via pipenv:
pipenv install
Usage
Next, create some Parquet files. The tool supports CSV and TSV files.
csv2parquet file.csv [--rows NNN] [--row-group-size NNN] [--output output.parquet] [--codec CODEC]
where CODEC is one of snappy, gzip, brotli or none
Testing
pylint csv2parquet
pytest
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
csv2parquet-0.0.3.tar.gz
(3.3 kB
view hashes)
Built Distribution
Close
Hashes for csv2parquet-0.0.3-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 79675ac65752f16321de267368e06a1a721ae1df1643c41bb498a7601ff9c756 |
|
| MD5 | 4ea45f09375b99c9ad11598eb50052ad |
|
| BLAKE2b-256 | 241cad0ee89fd632ecf177adb28509f96563478817afee4ae8df284e47fe9c49 |
