Skip to main content

This library allows you to retrieve BytesIO objects from various sources asynchronously. Whether you're dealing with cloud storage, HTTP endpoints, FTP servers, or local files.

Project description

๐Ÿš€ aiodoc: Async ByteIO Retrieval from Any Source ๐Ÿชฃ

Welcome to aiodoc! ๐ŸŽ‰ This library allows you to retrieve BytesIO objects from various sources asynchronously. Whether you're dealing with cloud storage, HTTP endpoints, FTP servers, or local files, aiodoc has got you covered! ๐ŸŒ

๐ŸŽฏ Key Features

  • Async all the way ๐ŸŒŸ: Perform all file operations asynchronously to keep your application responsive.
  • Retrieve from any source ๐Ÿ”Œ: Supports AWS S3, MinIO, Google Cloud Storage, HTTP, FTP, Redis, Memcached, and even local file systems.
  • Unified API ๐Ÿคน: A simple, easy-to-use interface for interacting with any storage system.

๐Ÿ’ผ Supported Providers

  • ๐Ÿ˜ AWS S3 via aiobotocore ๐Ÿš€
  • ๐Ÿฆ’ MinIO using minio-py ๐Ÿ› ๏ธ
  • โ˜๏ธ Google Cloud Storage with google-cloud-storage ๐ŸŽฉ
  • ๐ŸŒ HTTP with httpx ๐ŸŒ
  • ๐Ÿ“‚ Local file system with aiofile ๐Ÿ—‚๏ธ
  • ๐Ÿง  Memcached using aiomemcached ๐Ÿงณ
  • ๐Ÿ”ฅ Redis via aioredis ๐Ÿ”ฅ
  • ๐Ÿ”— FTP with aioftp ๐Ÿ“ก

๐ŸŽ’ How to Install

  1. Clone the repo:

    git clone https://github.com/your-repo/aiodoc.git
    
  2. Install dependencies:

    pip install -r requirements.txt
    
  3. Done! ๐ŸŽ‰ Now you're ready to use aiodoc for all your asynchronous file needs.

๐Ÿ› ๏ธ Usage

๐ŸŽฉ Create Your Provider

You can set up and use different providers based on your needs.

๐Ÿ˜ AWS S3 Example

from aiobotocore.session import AioSession
from aiodoc import S3Provider

# Initialize S3 provider
session = AioSession()
s3_provider = S3Provider(session)

# Retrieve a file as a BytesIO object
file_bytes = await s3_provider.download("my-bucket", "my-file.txt")

โ˜๏ธ Google Cloud Storage Example

from google.cloud import storage
from aiodoc import GCPProvider

# Initialize GCP provider
client = storage.Client()
gcp_provider = GCPProvider(client)

# Retrieve a file as a BytesIO object
file_bytes = await gcp_provider.download("my-bucket", "my-file.txt")

๐Ÿ“‚ Local File System Example

from aiodoc import FileProvider

# Initialize File provider
file_provider = FileProvider()

# Retrieve a file as a BytesIO object
file_bytes = await file_provider.download("bucket", "/path/to/file.txt")

๐Ÿ”ฅ Redis Example

from aioredis import Redis
from aiodoc import RedisProvider

# Initialize Redis provider
redis_client = await Redis.create()
redis_provider = RedisProvider(redis_client)

# Retrieve a file as a BytesIO object
file_bytes = await redis_provider.download("bucket", "file-key")

๐Ÿ› ๏ธ Available Operations

  • Upload ๐Ÿ†™: Upload a BytesIO object to any provider.
  • Download โฌ‡๏ธ: Retrieve a BytesIO object from any provider.
  • List Files ๐Ÿ“œ: List files (where supported).
  • Delete File โŒ: Delete a file (where supported).

๐Ÿค Contributing

Feel free to submit issues or pull requests if you'd like to contribute!

๐Ÿ“ License

This project is licensed under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aiodoc-0.1.2.tar.gz (6.1 kB view details)

Uploaded Source

Built Distribution

aiodoc-0.1.2-py3-none-any.whl (9.2 kB view details)

Uploaded Python 3

File details

Details for the file aiodoc-0.1.2.tar.gz.

File metadata

  • Download URL: aiodoc-0.1.2.tar.gz
  • Upload date:
  • Size: 6.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for aiodoc-0.1.2.tar.gz
Algorithm Hash digest
SHA256 972b94ba172de0032b285e1385ec37806015d437293a0d067b12954a3b488b49
MD5 fedc09458f58b5c2521803e206458f13
BLAKE2b-256 76fe9ffa249ac90c72a5362de1ff7420a3d97f95a77a4b2435bf8aadefb72ba1

See more details on using hashes here.

File details

Details for the file aiodoc-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: aiodoc-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 9.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for aiodoc-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 3f6cd6754b355150607f3637ee967093180a927e86db3b23f9c8211f72f604f1
MD5 d4e254797a5f9e543d67621699edc7be
BLAKE2b-256 e85dde38cf789f016bf68b75b0b4c839d969c1c69ba8c8fa003f4cac764ee9dd

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page