Skip to main content

Read parted and encrypted S3 files like a single file object

Project description

# S3Query

S3Query opens file or files in s3 file system as text file, will perform unzip if necessary. It also handles hadoop liked part-* files and treat all files within a directory as one single file.

# Example

>>> from s3query import s3open
>>> import sys
>>>
>>> with s3open("s3://s3query/data/testgz/") as fgz:
...     for line in fgz:
...         sys.stdout.write(line)
...
one
two
three
four
five
six
seven
eight
nine
>>> with s3open("s3://s3query/data/test/") as fplain:
...     for line in fplain:
...         sys.stdout.write(line)
...
one
two
three
four
five
six
seven
eight
nine

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

s3query-0.3.tar.gz (3.9 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page