Skip to main content

S3 File or Directory Loader

This loader parses any file stored on S3, or the entire Bucket (with an optional prefix filter) if no particular file is specified. When initializing S3Reader, you may pass in your AWS Access Key. If none are found, the loader assumes they are stored in ~/.aws/credentials.

All files are parsed with SimpleDirectoryReader. Hence, you may also specify a custom file_extractor, relying on any of the loaders in this library (or your own)!

Installation

pip install llama-index-readers-s3

Usage

To use this loader, you need to pass in the name of your S3 Bucket. After that, if you want to just parse a single file, pass in its key. Note that if the file is nested in a subdirectory, the key should contain that, so like subdirectory/input.txt.

Otherwise, you may specify a prefix if you only want to parse certain files in the Bucket, or a subdirectory. AWS Access Key credentials may either be passed in during initialization or stored locally (see above).

loader = S3Reader(
    bucket="scrabble-dictionary",
    key="dictionary.txt",
    aws_access_id="[ACCESS_KEY_ID]",
    aws_access_secret="[ACCESS_KEY_SECRET]",
)
documents = loader.load_data()

This loader is designed to be used as a way to load data into LlamaIndex.

Metadata

Release files for llama-index-readers-s3 0.8.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for llama-index-readers-s3 0.8.0
File Size Uploaded Provenance Actions
llama_index_readers_s3-0.8.0.tar.gz 5.9 kB Without provenance Details for llama_index_readers_s3-0.8.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for llama-index-readers-s3 0.8.0
File Interpreter ABI Platform Actions
llama_index_readers_s3-0.8.0-py3-none-any.whl Python 3 none any Details for llama_index_readers_s3-0.8.0-py3-none-any.whl

Total release size: 11.3 kB

Release files / llama_index_readers_s3-0.8.0.tar.gz

Download URL llama_index_readers_s3-0.8.0.tar.gz
Size 5.9 kB
Tags Source
SHA-256 checksum
How to use checksums
f7ff66396e138af767a423ace27ed4db97f661ec4a572d1d3d08a867486041a9
BLAKE2b-256 checksum
How to use checksums
9cf63c2713eb11892c872b18b33f841290fb1840c667fa682525a827ff5f59fd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.8 {"installer":{"name":"uv","version":"0.13.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / llama_index_readers_s3-0.8.0-py3-none-any.whl

Download URL llama_index_readers_s3-0.8.0-py3-none-any.whl
Size 5.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
7df5b87663ce1dc08807fe7151b1b7cb6a633cda09963e8ae89362560ef5382f
BLAKE2b-256 checksum
How to use checksums
96e5bc45c440b943c4094b008ff23fb37651761faf018bb6f96e8f2acdeb5889
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.8 {"installer":{"name":"uv","version":"0.13.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Security for llama-index-readers-s3 0.8.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page