Skip to main content

v3iofs

License

An fsspec driver for v3io.

Examples

Python

>>> from v3iofs import V3ioFS  # Will register 'v3io' protocol in ffspec
>>> fs = V3ioFS('api.app.yh48.iguazio-cd2.com', v3io_access_key='s3cr3t')
>>> fs.ls('/container/path')

Pandas

# Use V3IO_ACCESS_KEY & V3IO_API from environment
>> df = pd.read_csv('v3io://container/path/to/file.csv')

Dask

>>> from v3iofs import V3ioFS
>>> from dask import bag

# Use V3IO_ACCESS_KEY & V3IO_API from environment
>>> url = 'v3io://container/path'
>>> file = bag.read_text(url)
>>> data, _ = file.compute()

# Pass key in storage_options
>>> storage_options={
...     'v3io_api': 'webapi.app.iguazio.com',
...     'v3io_access_key': 's3cr3t',
... }
>>> file = bag.read_text(url, storage_options=storage_options)
>>> data, _ = file.compute()

Development

Testing

You need to set V3IO_ACCESS_KEY and V3IO_API environment variables. Then run make test to run the tests.

Environment

Deployment requirements are in requirements.txt and development requirements are in dev-requirements.txt.

$ python -m venv venv
$ ./venv/bin/python -m pip install -r dev-requirements.txt

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

v3iofs-0.1.18.tar.gz (18.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

v3iofs-0.1.18-py3-none-any.whl (14.1 kB view details)

Uploaded Python 3

File details

Details for the file v3iofs-0.1.18.tar.gz.

File metadata

  • Download URL: v3iofs-0.1.18.tar.gz
  • Upload date:
  • Size: 18.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.7

File hashes

Hashes for v3iofs-0.1.18.tar.gz
Algorithm Hash digest
SHA256 dc52cda02573bcab5d6fd5919753c24321f50b150a44681790ae5797ac10a648
MD5 5b8563207f0d7388279212d9b10d60f2
BLAKE2b-256 a3173f07723ca482ea8112616e5e55b90cda12ecd22f1a96dc7a7e1de371a531

See more details on using hashes here.

File details

Details for the file v3iofs-0.1.18-py3-none-any.whl.

File metadata

  • Download URL: v3iofs-0.1.18-py3-none-any.whl
  • Upload date:
  • Size: 14.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.7

File hashes

Hashes for v3iofs-0.1.18-py3-none-any.whl
Algorithm Hash digest
SHA256 b628588905becd70f546e700c1ec06c027cb001fe58e2a56ab1be840fd4ec5fd
MD5 38b428d48d8a165110f3e922375902ba
BLAKE2b-256 44153468d00138ff1d087ffb72766b26dd334b3c79a573f3076f5192f565b1b4

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.1.18 This release

2 files

0.1.17

2 files

0.1.16

2 files

0.1.15

2 files

0.1.14

2 files

0.1.13

2 files

0.1.12

2 files

0.1.11

2 files

0.1.10

2 files

0.1.9

2 files

0.1.8

1 file

0.1.7

1 file

0.1.6

1 file

0.1.5

1 file

0.1.4

1 file

0.1.3

1 file

0.1.2

1 file

0.1.0

1 file

0.0.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page