The HDX Scraper Geonode Library enables easy building of scrapers for extracting data from GeoNode servers. GeoNode is a web-based application and platform for developing geospatial information systems (GIS) and for deploying spatial data infrastructures (SDI).
For more information, please read the documentation.
This library is part of the Humanitarian Data Exchange (HDX) project. If you have humanitarian related data, please upload your datasets to HDX.
Development
Environment
Development is currently done using Python 3.13. The environment can be created with:
uv sync
This creates a .venv folder with the versions specified in the project's uv.lock file.
Pre-commit
pre-commit will be installed when syncing uv. It is run every time you make a git commit if you call it like this:
pre-commit install
With pre-commit, all code is formatted according to ruff guidelines.
To check if your changes pass pre-commit without committing, run:
pre-commit run --all-files
Packages
uv is used for package management. If
you’ve introduced a new package to the source code (i.e. anywhere in src/),
please add it to the project.dependencies section of pyproject.toml with
any known version constraints.
To add packages required only for testing, add them to the
[dependency-groups].
Any changes to the dependencies will be automatically reflected in
uv.lock with pre-commit, but you can re-generate the files without committing by
executing:
uv lock --upgrade
Project
uv is used for project management. The project can be built using:
uv build
Linting and syntax checking can be run with:
uv run ruff check
To run the tests and view coverage, execute:
uv run pytest
Documentation
The documentation, including API documentation, is generated using ReadtheDocs and
MkDocs with Material. As you change the source code, remember to update the
documentation at documentation/index.md.
1 maintainer
Metadata
1 maintainer
Release files for hdx-scraper-geonode 1.5.9
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| hdx_scraper_geonode-1.5.9.tar.gz | 122.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| hdx_scraper_geonode-1.5.9-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 135.7 kB
Release files / hdx_scraper_geonode-1.5.9.tar.gz
| Download URL | hdx_scraper_geonode-1.5.9.tar.gz |
|---|---|
| Size | 122.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
5714507ea43d9250605104b72c0ca506d6c2501f04a2f994e294743668c4f54d
|
|
BLAKE2b-256 checksum How to use checksums |
e9130a143a60b6b11faaefa27895d4059c48f90756e612ed2e88ad2fdd11b460
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
uv/0.10.9 {"installer":{"name":"uv","version":"0.10.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / hdx_scraper_geonode-1.5.9-py3-none-any.whl
| Download URL | hdx_scraper_geonode-1.5.9-py3-none-any.whl |
|---|---|
| Size | 12.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
c700d6d52c9366768282d67f715a38f8e64f49d2e582d120575ee0bb84d7ab79
|
|
BLAKE2b-256 checksum How to use checksums |
0643266b52c2dd481128def49ca2f5c19fcb40ad76ceb3e44b522ce6375bb247
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
uv/0.10.9 {"installer":{"name":"uv","version":"0.10.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
