Skip to main content

langchain-s3-text-loaders

AWS S3 directory and file loaders for text files, for instance text, html, xml, json, etc.

Inspired by langchain-community's S3FileLoader and S3DirectoryLoader, langchain_s3_text_loaders provides loaders optimized for text e.g. plain text, html, xml, json, etc.

Install

pip install langchain-s3-text-loaders

Usage

from langchain_s3_text_loaders import S3DirectoryLoader
s3_dir = S3DirectoryLoader(bucket="my-bucket", prefix="my_prefix")
docs = s3_dir.load()

Advanced Usage

from langchain_s3_text_loaders import S3DirectoryLoader
s3_dir = S3DirectoryLoader(
    bucket: str,
    prefix: str = "",
    batch_size=50, # number of concurrent s3 downloads
    region_name: Optional[str] = None,
    api_version: Optional[str] = None,
    use_ssl: Optional[bool] = True,
    verify: Union[str, bool, None] = None,
    endpoint_url: Optional[str] = None,
    aws_access_key_id: Optional[str] = None,
    aws_secret_access_key: Optional[str] = None,
    aws_session_token: Optional[str] = None,
    boto_config: Optional[botocore.client.Config] = None,
    )
docs = s3_dir.load()

License

MIT

Metadata

Release files for langchain-s3-text-loaders 0.8.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for langchain-s3-text-loaders 0.8.3
File Size Uploaded Provenance Actions
langchain_s3_text_loaders-0.8.3.tar.gz 5.0 kB With provenance Details for langchain_s3_text_loaders-0.8.3.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for langchain-s3-text-loaders 0.8.3
File Interpreter ABI Platform Actions
langchain_s3_text_loaders-0.8.3-py3-none-any.whl Python 3 none any Details for langchain_s3_text_loaders-0.8.3-py3-none-any.whl

Total release size: 11.8 kB

Release files / langchain_s3_text_loaders-0.8.3.tar.gz

Download URL langchain_s3_text_loaders-0.8.3.tar.gz
Size 5.0 kB
Tags Source
SHA-256 checksum
How to use checksums
71b634b89d4ca74b79777bbc6aee4e33e902444c01e727aca37f00291f62765e
BLAKE2b-256 checksum
How to use checksums
b4991af6bcd9286fac94d0161076ef5ab33112e639df0d3b14c5aa0548ccec91
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.0.1 CPython/3.12.8

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Dec 30, 2024.

Transparency log

Release files / langchain_s3_text_loaders-0.8.3-py3-none-any.whl

Download URL langchain_s3_text_loaders-0.8.3-py3-none-any.whl
Size 6.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
46676905ba4c93f46585a2bba5a178df236d5c171565007af202c41aa33ad831
BLAKE2b-256 checksum
How to use checksums
fbfd02d88d37d5b570b208aea8bed68257f4a89729df5a3f6304e0aa1b95fd2a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.0.1 CPython/3.12.8

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Dec 30, 2024.

Transparency log

Security for langchain-s3-text-loaders 0.8.3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for langchain_s3_text_loaders-0.8.3.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Dec 30, 2024.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page