A tool to convert CSVs to Parquet files
Project description
csv2parquet
Convert a CSV to a parquet file. You may also find sqlite-parquet-vtable useful.
Installing
If you just want to use the tool, install it and its dependencies via pip:
sudo pip install pyarrow csv2parquet
If you want to clone the repo and work on the tool, install its dependencies via pipenv:
pipenv install
Usage
Next, create some Parquet files. The tool supports CSV and TSV files.
csv2parquet file.csv [--row-group-size NNN] [--output output.parquet] [--codec CODEC]
where CODEC
is one of snappy
, gzip
, brotli
or none
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
csv2parquet-0.0.2.tar.gz
(2.4 kB
view hashes)
Built Distribution
Close
Hashes for csv2parquet-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3799e5c246a35b096a95acc2dfc4f9379d333659603ab671cea68d26beffcd02 |
|
MD5 | 3a62af9e3bc4423ca8ccd1a1c4acae9b |
|
BLAKE2b-256 | 60684e5279b64adf0e80ec76ca81decdc066d556092711a154e7902f8e61acce |