No project description provided
Project description
S3 Web Cache
This is a simple package for archiving web pages (HTML) to S3. It acts as a cache serving the S3 version of the page if it exists. If not it writes a version to s3.
Quickstart
Install
pip install s3webcache
Env variable
These env variables are assumed to be set
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
- AWS_DEFAULT_REGION
Usage
from s3webcache import S3WebCache
s3wc = S3WebCache(bucket_name='myBucket')
html = s3wc.get("https://en.wikipedia.org/wiki/Whole_Earth_Catalog")
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
S3WebCache-0.1.4.tar.gz
(2.5 kB
view details)
Built Distribution
File details
Details for the file S3WebCache-0.1.4.tar.gz.
File metadata
- Download URL: S3WebCache-0.1.4.tar.gz
- Upload date:
- Size: 2.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.6.2 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b99872ab9abae83b732709f5d13239e1292c233134aae748a9842a6c59339919 |
|
| MD5 | f9a824a2a26b4c8a5f1f02fcd4396840 |
|
| BLAKE2b-256 | 4f82cc889f190a8299dc613c6957d68f500b3d9e31ef39c3c5b47e631ed18fa0 |
File details
Details for the file S3WebCache-0.1.4-py3-none-any.whl.
File metadata
- Download URL: S3WebCache-0.1.4-py3-none-any.whl
- Upload date:
- Size: 3.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.6.2 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5a70867a50e5c33ea60eec4492c83f7c34b8b4c568a33eb3031ce8851d6e2aa0 |
|
| MD5 | 6ead60191eddf85ab977e5cf7d362de5 |
|
| BLAKE2b-256 | 03ff8167d55d86fb95ccfe1bc00e63269f0a015867a442d080e41aa0fe3c20f7 |
