No project description provided

Project description

S3 Web Cache

This is a simple package for archiving web pages (HTML) to S3. It acts as a cache serving the S3 version of the page if it exists. If not it writes a version to s3.

Quickstart

Install

pip install s3webcache

Usage

from s3webcache import S3WebCache

s3wc = S3WebCache(
    bucket_name=<BUCKET>,
    aws_access_key_id=<AWS_ACCESS_KEY_ID>,
    aws_secret_key=<AWS_SECRET_ACCESS_KEY>,
    aws_default_region=<AWS_DEFAULT_REGION>)

request = s3wc.get("https://en.wikipedia.org/wiki/Whole_Earth_Catalog")

if request.success:
    html = request.message

Project details

Release history Release notifications | RSS feed

0.2.2

Jul 5, 2019

0.2.0

Jun 28, 2019

0.1.9

Jun 28, 2019

0.1.8

Jun 28, 2019

This version

0.1.7

Apr 12, 2019

0.1.6

Apr 12, 2019

0.1.5

Apr 12, 2019

0.1.4

Apr 11, 2019

0.1.2

Apr 11, 2019

0.1.1

Apr 11, 2019

0.1.0

Apr 11, 2019

0.0.3

Apr 11, 2019

0.0.2

Apr 11, 2019

0.0.1

Apr 11, 2019

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

S3WebCache-0.1.7.tar.gz (3.0 kB view details)

Uploaded Apr 12, 2019 Source

Built Distribution

S3WebCache-0.1.7-py3-none-any.whl (4.6 kB view details)

Uploaded Apr 12, 2019 Python 3

File details

Details for the file S3WebCache-0.1.7.tar.gz.

File metadata

Download URL: S3WebCache-0.1.7.tar.gz
Upload date: Apr 12, 2019
Size: 3.0 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/41.0.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.3

File hashes

Hashes for S3WebCache-0.1.7.tar.gz
Algorithm	Hash digest
SHA256	`f2fc355f3855910e7e0b537ef53bcae526c5132edca461efbf8e8664826bb1a0`
MD5	`bb5c074223f8d211c17ae02913bd9371`
BLAKE2b-256	`28fe28d0fba577ca8e09aadb28f8c2ed55b22984e658c77680e609aa9dbc27d4`

See more details on using hashes here.

File details

Details for the file S3WebCache-0.1.7-py3-none-any.whl.

File metadata

Download URL: S3WebCache-0.1.7-py3-none-any.whl
Upload date: Apr 12, 2019
Size: 4.6 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/41.0.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.3

File hashes

Hashes for S3WebCache-0.1.7-py3-none-any.whl
Algorithm	Hash digest
SHA256	`42e8e4a9cced8b06eca0464940f29bee6ca2d4d868de2201a4c95b4b38e3b2c3`
MD5	`6d4e6641b25be01c68c928ce1db79603`
BLAKE2b-256	`4ddafd8dce947d675a68f0a320529b0434e822b50e814be3ba0a1f32dafae9d7`