dataframe-io
Read and write dataframes from and to any storage.
- Documentation: https://chr1st1ank.github.io/dataframe-io/
- License: Apache-2.0
- Status: Initial development
Features
Dataframes types supported:
- pandas DataFrame
- Python dictionary
Supported storage backends:
- Parquet files
- PostgreSQL database
More backends will come. Open an issue if you are interested in a particular backend.
Implementation status for reading data:
| Storage | Select columns | Filter rows | Max rows | Sampling | Drop duplicates |
|---|---|---|---|---|---|
| Parquet files | ✔️ | ✔️ | ✔️ | ✔️ | ✔ ¹ |
| PostgreSQL | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ |
¹ only for pandas DataFrames
Implementation status for writing data:
| Storage | write append | write replace |
|---|---|---|
| Parquet files | ✔️ | ✔️ |
| PostgreSQL | ✔️ | ✔️ |
Installation
pip install dframeio
# Including pyarrow to read/write parquet files:
pip install dframeio[parquet]
# Including PostgreSQL support:
pip install dframeio[postgres]
Show installed backends:
>>> import dframeio
>>> dframeio.backends
[<class 'dframeio.parquet.ParquetBackend'>]
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dframeio-0.3.0.tar.gz
(932.5 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
dframeio-0.3.0-py3-none-any.whl
(16.8 kB
view details)
File details
Details for the file dframeio-0.3.0.tar.gz.
File metadata
- Download URL: dframeio-0.3.0.tar.gz
- Upload date:
- Size: 932.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
poetry/1.1.11 CPython/3.9.7 Linux/5.11.0-1020-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
bbe00ccb68ad5bb33785d5dd5e8a30015a3c70792e230e50fca276ed9c5ad934
|
|
| MD5 |
15a2d89f4cf17393d028e358e38ed8b3
|
|
| BLAKE2b-256 |
bd860e5f0ebd1bd95e0527b247315739048392efe9ab79117ac92135d68e2c54
|
File details
Details for the file dframeio-0.3.0-py3-none-any.whl.
File metadata
- Download URL: dframeio-0.3.0-py3-none-any.whl
- Upload date:
- Size: 16.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
poetry/1.1.11 CPython/3.9.7 Linux/5.11.0-1020-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f457dc56f02e6b188c4f5337e5bccde16cee51527ddeb8dae25188d0409aa6b8
|
|
| MD5 |
0a40d4886a671ab6f6e167e1d2e18996
|
|
| BLAKE2b-256 |
06bfc98a92e0719fca7337133fbd7abbcb93be2cda3120cc29ae22a6e66d9743
|
