Skip to main content

Read files from S3 as defined by a key prefix and map them by lines to a set of optionally gzip compressed output files in S3, with the output files limited by (pre-compressed) file size. The string “{}” in the output key will be substituted with the (zero-based) index of the output files.

s3lncoll: Line stream s3 files into ~uniform lumps in S3

Usage: s3lncoll {{arguments}} {{options}}

Arguments:
  from [text]  S3 URL prefix to clump
    to [text]    S3 URL for target clump ('{}' will be the count)

    Options:
      -h, --help             Show this help message and exit
      -H, --HELP             Help for all sub-commands
      -D, --debug            Enable debug logging
      -d, --delete           Delete source files/keys
      -j, --json             Validate each line as JSONM
      -q, --quiet            Be quiet, be vewy vewy quiet
      -V, --version          Report installed version
      -z, --compress         Ccompress (gzip) the target(s)
      -b, --blocksize [int]  Maximum size of pre-compressed output files in bytes. (default: 1048576)

Metadata

Release files for s3lncoll 0.1.post11

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for s3lncoll 0.1.post11
File Size Uploaded Provenance Actions
s3lncoll-0.1.post11.tar.gz 23.9 kB Without provenance Details for s3lncoll-0.1.post11.tar.gz

Release files / s3lncoll-0.1.post11.tar.gz

Download URL s3lncoll-0.1.post11.tar.gz
Size 23.9 kB
Tags Source
SHA-256 checksum
How to use checksums
89593d71669d28e4284bacb1b06359bb7b7b2561f86a97bc5e2896aa7227c4c5
BLAKE2b-256 checksum
How to use checksums
7422dfdeeac756fedb125256024800440678c1e925d3c6c044628c1aeb49ee46
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for s3lncoll 0.1.post11

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page