A Python package to submit web pages to the Wayback Machine for archiving.
Project description
Archivooor
Archivooor is a Python package for interacting with the archive.org API.
It's main purpose is to provide a convenient way to submit webpages to the Wayback Machine. Archivooor uses multithreading and automatic retries to ensure that webpages are archived successfully.
Installation and usage
Installation
Archivooor is available on PyPI:
python -m pip install archivooor
Usage
from archivooor.archiver import Archiver
from archivooor.archiver import Sitemap
archive = Archiver(s3_access_key="your_s3_access_key", s3_secret_key="your_s3_secret_key")
archive.save_pages(["https://example.com/","https://example.com/page1","https://example.com/page2"])
sitemap = Sitemap("https://www.sitemaps.org/sitemap.xml")
print(sitemap.extract_pages_from_sitemap())
License
Acknowledgements
@agude for writing the original python script this project is based on.
Donations
Ethereum | Bitcoin |
---|---|
0x6b78d3deea258914C2f4e44054d22094107407e5 | bc1qvvh8s3tt97cwy20mfdttpwqw0vgsrrceq8zkmw |
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
archivooor-0.0.7.tar.gz
(6.3 kB
view details)
Built Distribution
File details
Details for the file archivooor-0.0.7.tar.gz
.
File metadata
- Download URL: archivooor-0.0.7.tar.gz
- Upload date:
- Size: 6.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.3 CPython/3.8.18 Linux/6.5.0-1025-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | dce2e131d1648eb0965821c9b90e37f36c978cd419ec9062217710e38317172c |
|
MD5 | 58f919d2665a2e6133a21d0f87b9de13 |
|
BLAKE2b-256 | 584f7ac3c120dc816211366159e10971a9c39fc1d11b440090987f00d1542a31 |
File details
Details for the file archivooor-0.0.7-py3-none-any.whl
.
File metadata
- Download URL: archivooor-0.0.7-py3-none-any.whl
- Upload date:
- Size: 8.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.3 CPython/3.8.18 Linux/6.5.0-1025-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | bbbd5055c4a08362390ef93e69b82cdf9741ce8102c3ebfa0fed938c06888bd3 |
|
MD5 | 29b95e812880adaebd678a7ed18f6c75 |
|
BLAKE2b-256 | c01a609336485c70e44e9d04a1e664852993c3702f4cade34cc378dd4e962463 |