No project description provided
Project description
S3 Web Cache
This is a simple package for archiving web pages (HTML) to S3. It acts as a cache serving the S3 version of the page if it exists. If not it writes a version to s3.
Quickstart
Install
pip install s3webcache
Env variable
These env variables are assumed to be set
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
Usage
from s3webcache import S3WebCache
s3wc = S3WebCache(bucket_name='myBucket')
html = s3wc.get("https://en.wikipedia.org/wiki/Whole_Earth_Catalog")
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
S3WebCache-0.1.2.tar.gz
(2.5 kB
view details)
Built Distribution
File details
Details for the file S3WebCache-0.1.2.tar.gz.
File metadata
- Download URL: S3WebCache-0.1.2.tar.gz
- Upload date:
- Size: 2.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.6.2 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | ddfce37094d7e20befc23fab7630ecab22823a21b226f0818b9f2aa6ed0708e7 |
|
| MD5 | aebf32a54f7fe0bf2745b976e4d4bc43 |
|
| BLAKE2b-256 | 0a49ad2e6879ec660a7c9de24c49c159767eeb6c98377f124f80127d4fb47952 |
File details
Details for the file S3WebCache-0.1.2-py3-none-any.whl.
File metadata
- Download URL: S3WebCache-0.1.2-py3-none-any.whl
- Upload date:
- Size: 3.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.6.2 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 9c64a59ff383035da10324a2faad4d46852872f879e708d7e994a253752c6d3f |
|
| MD5 | 4abf5c40b1ed02ac6e0d412fba8876cc |
|
| BLAKE2b-256 | 57e4ac81f989bff08f097302c165c37cecfff754157f9a1014f7d0e6bde61cff |
