A Python datalake client.
Project description
Ness
A Python datalake client.
Requirements
Installation
Using Conda:
conda install -c conda-forge pyarrow ness
Using Pip:
pip install pyarrow ness
Quickstart
import ness
dl = ness.dl(bucket="mybucket", name="mydatalake")
df = dl.read("mytable")
Sync
# Sync all tables
df = dl.sync()
# Sync a single table
df = dl.sync("mytable")
Format
Specify the input data source format, the default format is parquet
:
import ness
dl = ness.dl(bucket="mybucket", name="mydatalake", format="csv")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ness-0.0.1a1.tar.gz
(3.5 kB
view hashes)
Built Distribution
ness-0.0.1a1-py3-none-any.whl
(4.7 kB
view hashes)