Skip to main content

Deliver OpenStreetMap data in GeoJSON and MVT tile formats

Project description

CI

DjangoStreetMap

DjangoStreetMap is a Django application to load OSM data into a PostGIS database and deliver OSM data as MVT tiles.

Stack

  • Python 3.11+
  • Django 5.2 LTS
  • Pydantic 2
  • PostGIS 3.4+ (Postgres 16 recommended)
  • Package managed with uv

Docs

  • docs/architecture.md — tile pipeline, MvtQuery variants, SRID choices, cache protocol, how to write a new tile view.
  • docs/api.md — cheatsheet of every public symbol.
  • examples/minimal/ — runnable standalone project: make db-up install migrate import runserver → tiles at :8000/tiles/....

OpenStreetMap Vector Tiles

"A vector tile is a lightweight data format for storing geospatial vector data"

For an introduction to MVT (Mapbox Vector Tiles) see the mapbox docs. For an introduction to OSM see openstreetmap.org.

Purpose

  1. Import OSM data as Django models
  2. Expose Django models as MVT geographic format data

Tile generation is much faster when geometry is in srid=3857.

Prerequisites

You need the gdal libraries installed.

On Ubuntu:

sudo apt install binutils libproj-dev gdal-bin

Otherwise refer to the Django docs "Installing geospatial libraries".

Adding to a Project

uv add djangostreetmap

Extend INSTALLED_APPS:

INSTALLED_APPS = [
    ...,
    "django.contrib.gis",
    "djangostreetmap",
    "osmflex",
]

(Recommended) Set your cache

You likely want a fast cache for tiles (e.g. Memcached). If not configured, the default cache is used.

CACHES = {
    "default": {
        "BACKEND": "django.core.cache.backends.memcached.PyMemcacheCache",
        "LOCATION": "127.0.0.1:11211",
    }
}

Development

Set up a PostGIS container

docker run --rm -d \
    --name djsm_postgis \
    -e POSTGRES_DB=postgres \
    -e POSTGRES_USER=postgres \
    -e POSTGRES_PASSWORD=post1234 \
    -p 49155:5432 \
    postgis/postgis:16-3.4 \
    -c fsync=off -c shared_buffers=4096MB

Install dependencies

uv sync --dev

Run tests

uv run pytest

Lint / format / type-check

uv run ruff check .
uv run ruff format .
uv run mypy djangostreetmap maplibre

Pre-commit hooks

uv run pre-commit install
uv run pre-commit run --all-files

Releasing

Releases are automated via GitHub Actions (.github/workflows/release.yml) using PyPI Trusted Publishing (OIDC). To cut a release:

  1. Bump version in pyproject.toml on main; commit and merge.
  2. Tag the merged commit with the same version (no v prefix):
    git tag 0.3.0 && git push origin 0.3.0
    
  3. The workflow verifies the tag matches pyproject.toml, that the commit is on main, builds sdist + wheel, publishes to PyPI, and creates a GitHub Release with auto-generated notes.

One-time PyPI setup (maintainer): on the PyPI project page, add a Trusted Publisher for the catalpainternational/djangostreetmap repo, workflow release.yml, environment pypi.

Writing Views

Subclass TileLayerView with MvtQuery layers:

class RoadLayerView(TileLayerView):
    layers = [
        MvtQuery(
            table=OsmHighway._meta.db_table,
            attributes=["name"],
            filters=[f"\"highway\"='{road_class}'"],
            layer=road_class,
        )
        for road_class in ("primary", "secondary", "tertiary")
    ]

Register the URL:

path("highways/<int:zoom>/<int:x>/<int:y>.pbf", RoadLayerView.as_view()),

Importing OSM Data

Fetch a .osm.pbf extract (e.g. from Geofabrik):

wget https://download.geofabrik.de/asia/east-timor-latest.osm.pbf

You need osm2pgsql >= 1.3. The osmflex app provides two management commands to populate the models:

./manage.py run_osm2pgsql /path/to/east-timor-latest.osm.pbf
./manage.py import_from_pgosmflex

Exploring Data

  • Django admin: http://localhost:8000/admin/osmflex
  • psql: psql --host localhost --username postgres --port 49155
  • QGIS: add a Postgres connection to localhost:49155, database postgres.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

djangostreetmap-0.3.3.tar.gz (117.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

djangostreetmap-0.3.3-py3-none-any.whl (57.6 kB view details)

Uploaded Python 3

File details

Details for the file djangostreetmap-0.3.3.tar.gz.

File metadata

  • Download URL: djangostreetmap-0.3.3.tar.gz
  • Upload date:
  • Size: 117.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for djangostreetmap-0.3.3.tar.gz
Algorithm Hash digest
SHA256 21b548e555fd831ac189f89ca0661ac59a46289c51e8cf9fab9e2c6ef7dc6e65
MD5 78224a3d9cc36a1ff75005e2491327ad
BLAKE2b-256 07c603606547054b82b28d478b637c29718432f7b18e94a29547fefcba758058

See more details on using hashes here.

Provenance

The following attestation bundles were made for djangostreetmap-0.3.3.tar.gz:

Publisher: release.yml on catalpainternational/djangostreetmap

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file djangostreetmap-0.3.3-py3-none-any.whl.

File metadata

File hashes

Hashes for djangostreetmap-0.3.3-py3-none-any.whl
Algorithm Hash digest
SHA256 87311cbc15524f76b7d526a3a7681e00aa0ce1b1fac50b09ca529577388078fd
MD5 4498e58f754c860fd20658b92eacdf32
BLAKE2b-256 27c3ca1b0724cd86ad865d840f2f7338e058a13ef23e7881beccbf85db7d77ce

See more details on using hashes here.

Provenance

The following attestation bundles were made for djangostreetmap-0.3.3-py3-none-any.whl:

Publisher: release.yml on catalpainternational/djangostreetmap

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page