The ckanext-harvest-basket extension adds a set of custom harvesters to CKAN, making it easy to gather data from various platforms like ODS, ArcGIS, Socrata, DKAN, Junar, and more. With these harvesters, you can automatically pull datasets from different sources into your CKAN instance, helping you manage and share data more efficiently.
Key features:
- Harvesters for popular data platforms, including CKAN, ODS, ArcGIS, Socrata, DKAN, Junar and others.
- Integration with the ckanext-transmute extension, which allows you to transform datasets during the harvesting process using a harvest source configuration.
- Source checkup preview. When creating a source, the harvester will try to connect to the remote portal and harvest one dataset to check if it’s accessible.
- Anonymous user restrictions. You can disallow anonymous users from accessing harvester pages.
See the documentation for more information.
Quick start
-
Install the extension from
PyPI:pip install ckanext-harvest-basket
-
Enable the main plugin and harvesters you want to use in your CKAN configuration file (e.g.
ckan.iniorproduction.ini):ckan.plugins = ... harvest_basket arcgis_harvester socrata_harvester ...
Developer installation
To install ckanext-harvest-basket for development, activate your CKAN virtualenv and
do:
git clone https://github.com/DataShades/ckanext-harvest-basket.git
cd ckanext-harvest-basket
pip install -e '.[dev]'
Tests
To run the tests, do:
pytest --ckan-ini=test.ini
License
3 maintainers
Metadata
3 maintainers
Release files for ckanext-harvest-basket 1.5.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| ckanext_harvest_basket-1.5.6.tar.gz | 37.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| ckanext_harvest_basket-1.5.6-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 84.6 kB
Release files / ckanext_harvest_basket-1.5.6.tar.gz
| Download URL | ckanext_harvest_basket-1.5.6.tar.gz |
|---|---|
| Size | 37.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
f6633d9fea3a21e3ee6175e1c7d81586db2291c96add283d1bd79b39a36e025b
|
|
BLAKE2b-256 checksum How to use checksums |
8c5bc87740509faa826c4b7e4dc1664e3bb893e7b25457065961688102e5694f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.13
|
Release files / ckanext_harvest_basket-1.5.6-py3-none-any.whl
| Download URL | ckanext_harvest_basket-1.5.6-py3-none-any.whl |
|---|---|
| Size | 46.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
cf1700ddfc1b49d07941c86c672b0112abcfedd35d85e0920d1769ba512c8441
|
|
BLAKE2b-256 checksum How to use checksums |
352917e327eff2834d8cce65bf3422d9a46006e179960e83fd85604853e4ceb8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.13
|
