iacoll
iacoll will collect all the item metadata for an Internet Archive collection and store it in a LevelDB database. The database is a key/value store where the key is the unique Internet Archive item identifier, and the value is the JSON for the item metadata.
For example you can download the metadata for items in the University of Maryland's collection:
% iacoll university_maryland_cp
By default iacoll will create the LevelDB database in a directory named with the item identifier. If you would like to control this you can explicitly pass it:
% iacoll university_maryland_cp --db /path/to/my/leveldb/database
When you run iacoll repeatedly it will look at the database and only fetch newer records. If an update ever fails you may want to force a full scan:
% iacoll university_maryland_cp --fullscan
If you would like to dump the metadata as line oriented JSON you can use --dump:
% iacoll university_maryland_cp --dump > university_maryland_cp.jsonl
Install
To install iacoll you'll first need to install Python and then:
pip install iacoll
Metadata
Release files for iacoll 0.0.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| iacoll-0.0.3.tar.gz | 3.0 kB | Without provenance | Details for iacoll-0.0.3.tar.gz |
Release files / iacoll-0.0.3.tar.gz
| Download URL | iacoll-0.0.3.tar.gz |
|---|---|
| Size | 3.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
498d1c0835004b964ad810c5b4ddf20ad12e13f9277edaf62bbd08cc3efc0a6c
|
|
BLAKE2b-256 checksum How to use checksums |
163027cbad2d8e338bf9930fd8cce0783ac263b73c7ded2ae820af4b86af1820
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.4.2 requests/2.21.0 setuptools/40.6.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.6
|
Security for iacoll 0.0.3
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.