Skip to main content

v3iofs

License

An fsspec driver for v3io.

Examples

Python

>>> from v3iofs import V3ioFS  # Will register 'v3io' protocol in ffspec
>>> fs = V3ioFS('api.app.yh48.iguazio-cd2.com', v3io_access_key='s3cr3t')
>>> fs.ls('/container/path')

Pandas

# Use V3IO_ACCESS_KEY & V3IO_API from environment
>> df = pd.read_csv('v3io://container/path/to/file.csv')

Dask

>>> from v3iofs import V3ioFS
>>> from dask import bag

# Use V3IO_ACCESS_KEY & V3IO_API from environment
>>> url = 'v3io://container/path'
>>> file = bag.read_text(url)
>>> data, _ = file.compute()

# Pass key in storage_options
>>> storage_options={
...     'v3io_api': 'webapi.app.iguazio.com',
...     'v3io_access_key': 's3cr3t',
... }
>>> file = bag.read_text(url, storage_options=storage_options)
>>> data, _ = file.compute()

Development

Testing

You need to set V3IO_ACCESS_KEY and V3IO_API environment variables. Then run make test to run the tests.

Environment

Deployment requirements are in requirements.txt and development requirements are in dev-requirements.txt.

$ python -m venv venv
$ ./venv/bin/python -m pip install -r dev-requirements.txt

Metadata

Release files for v3iofs 0.1.18

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for v3iofs 0.1.18
File Size Uploaded
v3iofs-0.1.18.tar.gz 18.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for v3iofs 0.1.18
File Interpreter ABI Platform
v3iofs-0.1.18-py3-none-any.whl Python 3 none any Details

Total release size: 32.8 kB

Release files / v3iofs-0.1.18.tar.gz

Download URL v3iofs-0.1.18.tar.gz
Size 18.7 kB
Tags Source
SHA-256 checksum
How to use checksums
dc52cda02573bcab5d6fd5919753c24321f50b150a44681790ae5797ac10a648
BLAKE2b-256 checksum
How to use checksums
a3173f07723ca482ea8112616e5e55b90cda12ecd22f1a96dc7a7e1de371a531
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.11.7

Release files / v3iofs-0.1.18-py3-none-any.whl

Download URL v3iofs-0.1.18-py3-none-any.whl
Size 14.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
b628588905becd70f546e700c1ec06c027cb001fe58e2a56ab1be840fd4ec5fd
BLAKE2b-256 checksum
How to use checksums
44153468d00138ff1d087ffb72766b26dd334b3c79a573f3076f5192f565b1b4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.11.7

Release history Release notifications | RSS feed

This release

0.1.18 This release

2 release files

0.1.17

2 release files

0.1.11

2 release files

0.1.10

2 release files

0.1.9

2 release files

0.1.8

1 release file

0.1.7

1 release file

0.1.6

1 release file

0.1.5

1 release file

0.1.4

1 release file

0.1.3

1 release file

0.1.2

1 release file

0.1.0

1 release file

0.0.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page