Skip to main content

Apache OpenDAL™ Python Binding

Project description

Apache OpenDAL™ Python Binding

PyPI Website

Documentation: main

This package intends to build a native python binding for Apache OpenDAL.

Installation

pip install opendal

Usage

fs service example:

import opendal

op = opendal.Operator("fs", root="/tmp")
op.write("test.txt", b"Hello World")
print(op.read("test.txt"))
print(op.stat("test.txt").content_length)

Or using the async API:

import asyncio

async def main():
    op = opendal.AsyncOperator("fs", root="/tmp")
    await op.write("test.txt", b"Hello World")
    print(await op.read("test.txt"))

asyncio.run(main())

s3 service example:

import opendal

op = opendal.Operator("s3", root="/tmp", bucket="your_bucket_name", region="your_region")
op.write("test.txt", b"Hello World")
print(op.read("test.txt"))
print(op.stat("test.txt").content_length)

Or using the async API:

import asyncio

async def main():
    op = opendal.AsyncOperator("s3", root="/tmp", bucket="your_bucket_name", region="your_region")
    await op.write("test.txt", b"Hello World")
    print(await op.read("test.txt"))

asyncio.run(main())

Development

Setup virtualenv:

python -m venv venv

Activate venv:

source venv/bin/activate

Install maturin:

pip install maturin

Build bindings:

maturin develop

Run some tests:

maturin develop -E test
# To run `test_write.py` and use `fs` operator
OPENDAL_TEST=fs OPENDAL_FS_ROOT=/tmp pytest -vk test_write

Build API docs:

maturin develop -E docs
pdoc -t ./template opendal

License and Trademarks

Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0

Apache OpenDAL, OpenDAL, and Apache are either registered trademarks or trademarks of the Apache Software Foundation.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

opendal-0.45.1.tar.gz (674.2 kB view hashes)

Uploaded Source

Built Distributions

opendal-0.45.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (62.8 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

opendal-0.45.1-pp310-pypy310_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (62.0 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ ARMv7l

opendal-0.45.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (63.3 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

opendal-0.45.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (62.8 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

opendal-0.45.1-pp39-pypy39_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (62.0 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ ARMv7l

opendal-0.45.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (63.3 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

opendal-0.45.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (62.8 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

opendal-0.45.1-pp38-pypy38_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (62.0 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ ARMv7l

opendal-0.45.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (63.3 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

opendal-0.45.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (62.8 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

opendal-0.45.1-pp37-pypy37_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (62.0 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ ARMv7l

opendal-0.45.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (63.3 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ ARM64

opendal-0.45.1-cp312-none-win_amd64.whl (16.0 MB view hashes)

Uploaded CPython 3.12 Windows x86-64

opendal-0.45.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (62.8 MB view hashes)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

opendal-0.45.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (62.0 MB view hashes)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARMv7l

opendal-0.45.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (63.3 MB view hashes)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARM64

opendal-0.45.1-cp312-cp312-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl (38.0 MB view hashes)

Uploaded CPython 3.12 macOS 10.12+ universal2 (ARM64, x86-64) macOS 10.12+ x86-64 macOS 11.0+ ARM64

opendal-0.45.1-cp311-none-win_amd64.whl (16.1 MB view hashes)

Uploaded CPython 3.11 Windows x86-64

opendal-0.45.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (62.8 MB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

opendal-0.45.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (62.0 MB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARMv7l

opendal-0.45.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (63.3 MB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARM64

opendal-0.45.1-cp311-cp311-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl (38.0 MB view hashes)

Uploaded CPython 3.11 macOS 10.12+ universal2 (ARM64, x86-64) macOS 10.12+ x86-64 macOS 11.0+ ARM64

opendal-0.45.1-cp310-none-win_amd64.whl (16.1 MB view hashes)

Uploaded CPython 3.10 Windows x86-64

opendal-0.45.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (62.8 MB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

opendal-0.45.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (62.0 MB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARMv7l

opendal-0.45.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (63.3 MB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARM64

opendal-0.45.1-cp310-cp310-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl (38.0 MB view hashes)

Uploaded CPython 3.10 macOS 10.12+ universal2 (ARM64, x86-64) macOS 10.12+ x86-64 macOS 11.0+ ARM64

opendal-0.45.1-cp39-none-win_amd64.whl (16.1 MB view hashes)

Uploaded CPython 3.9 Windows x86-64

opendal-0.45.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (62.8 MB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

opendal-0.45.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (62.0 MB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARMv7l

opendal-0.45.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (63.3 MB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARM64

opendal-0.45.1-cp39-cp39-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl (38.0 MB view hashes)

Uploaded CPython 3.9 macOS 10.12+ universal2 (ARM64, x86-64) macOS 10.12+ x86-64 macOS 11.0+ ARM64

opendal-0.45.1-cp38-none-win_amd64.whl (16.1 MB view hashes)

Uploaded CPython 3.8 Windows x86-64

opendal-0.45.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (62.8 MB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

opendal-0.45.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (62.0 MB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARMv7l

opendal-0.45.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (63.3 MB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARM64

opendal-0.45.1-cp38-cp38-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl (38.0 MB view hashes)

Uploaded CPython 3.8 macOS 10.12+ universal2 (ARM64, x86-64) macOS 10.12+ x86-64 macOS 11.0+ ARM64

opendal-0.45.1-cp37-none-win_amd64.whl (16.1 MB view hashes)

Uploaded CPython 3.7 Windows x86-64

opendal-0.45.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (62.8 MB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

opendal-0.45.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (62.0 MB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARMv7l

opendal-0.45.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (63.3 MB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARM64

opendal-0.45.1-cp37-cp37m-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl (38.0 MB view hashes)

Uploaded CPython 3.7m macOS 10.12+ universal2 (ARM64, x86-64) macOS 10.12+ x86-64 macOS 11.0+ ARM64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page