Server to on-the-fly extract and serve vector tiles from an mbtiles file on S3
Project description
mbtiles-s3-server 
Python server to on-the-fly extract and serve vector tiles from mbtiles files on S3. Javascript, maps styles, fonts, and sprites are included so you can get setup quickly, especially with OpenMapTiles mbtiles files, but these are not required to be used.
Versioning must be enabled on the underlying S3 bucket
Installation
pip install mbtiles-s3-server
The libsqlite3 binary library is also required, but this is typically already installed on most systems. The earliest version of libsqlite3 known to work is 2012-12-12 (3.7.15).
Example usage
-
Create or obtain an mbtiles file, for example from https://openmaptiles.org/.
-
Upload this file to S3, for example to
https://my-bucket.s3.eu-west-2.amazonaws.com/tiles.mbtiles -
Ensure to have a IAM user that has
s3:GetObjectands3:GetObjectVersionpermissions on this S3 object, for example{ "Version": "2012-10-17", "Statement": [ { "Sid": "", "Effect": "Allow", "Principal": "*", "Action": [ "s3:GetObject", "s3:GetObjectVersion" ], "Resource": [ "arn:aws:s3:::my-bucket/tiles.mbtiles" ] } ] }
-
Start this server, configured with the location of this object and credentials for this user - it's configured using environment variables. You can assign the tiles file any version you like, in this case,
1.0.0.PORT=8080 \ MBTILES__1__URL=https://my-bucket.s3.eu-west-2.amazonaws.com/tiles.mbtiles \ MBTILES__1__IDENTIFIER=mytiles \ MBTILES__1__VERSION=1.0.0 \ AWS_REGION=eu-west-2 \ AWS_ACCESS_KEY_ID=AKIAIOSFODNN7EXAMPLE \ AWS_SECRET_ACCESS_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY \ HTTP_ACCESS_CONTROL_ALLOW_ORIGIN="*" \ python -m mbtiles_s3_server
The above is only to show what environment variables are needed - usually credentials should be avoided in shell commands. When developing locally, instead of specifying the
AWS_*variables, consider using aws-vault, which populates them for you.For example if you have a local AWS profile called
tiles, you can run the below.PORT=8080 \ MBTILES__1__URL=https://my-bucket.s3.eu-west-2.amazonaws.com/tiles.mbtiles \ MBTILES__1__IDENTIFIER=mytiles \ MBTILES__1__VERSION=1.0.0 \ HTTP_ACCESS_CONTROL_ALLOW_ORIGIN="*" \ aws-vault exec tiles -- python -m mbtiles_s3_server
-
On your user-facing site, include HTML that loads these tiles from this server, for example to load maps from a server started as above running locally
<!DOCTYPE html> <html> <head> <meta charset="utf-8"> <title>Example map</title> <meta name="viewport" content="initial-scale=1,maximum-scale=1,user-scalable=no"> <script src="http://localhost:8080/v1/static/maplibre-gl@2.1.9/maplibre-gl.js"></script> <link href="http://localhost:8080/v1/static/maplibre-gl@2.1.9/maplibre-gl.css" rel="stylesheet"> <style> body, html, #map {margin: 0; padding: 0; height: 100%; width: 100%} </style> </head> <body> <div id="map"></div> <script> var map = new maplibregl.Map({ container: 'map', style: 'http://localhost:8080/v1/styles/osm-bright-gl-style@1.0.0/style.json?fonts=fonts-gl@1.0.0&tiles=mytiles@1.0.0', center: [0, 0], zoom: 1 }); </script> </body> </html>
This HTML is included in this repository in example.html. A simple server can be started to view it by
python -m http.server 8081 --bind 127.0.0.1
and going to http://localhost:8081/example.html
For the curious, advanced, or developers of this server itself
Hosting your own vector map tiles to show them in a browser requires quite a few components:
-
JavaScript and CSS
A Javascript and CSS library, such as MapLibre GL, and your own code to run this library, pointing it to a style file
-
Style file
A JSON file that defines how the library should style the map tiles, and where it should find the map tiles, glyphs (fonts), and the sprite
-
Glyphs (fonts)
Sets of fonts; different fonts can be used for different labels and zoom levels, as defined in the Style file
-
Sprite
A single JSON index file and a single PNG file; the JSON file contains the offsets and sizes of images within the single PNG file
-
Vector map tiles
A set of often hundreds of thousands of tiles each covering a different location and different zoom level. These can be distributed as a single mbtiles file, but this is not the format that the Javascript library accepts. This on-the-fly conversion from the mbtiles file to tiles is the main feature of this server.
Licenses
The code of the server itself is released under the MIT license. However, several components included in mbtiles_s3_server/vendor/ are released under different licenses.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file mbtiles-s3-server-0.0.10.tar.gz.
File metadata
- Download URL: mbtiles-s3-server-0.0.10.tar.gz
- Upload date:
- Size: 67.5 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.0 CPython/3.8.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 937589790cac4ed92be7ce35700c0effed41947c9512825db5112a5180a6caa2 |
|
| MD5 | ad8f3744635eb10492aa43b924078c17 |
|
| BLAKE2b-256 | 0569dc678e8edada34163ae83ebd053eac03ac9cb01545b47d3b31c7f4e00e34 |
File details
Details for the file mbtiles_s3_server-0.0.10-py3-none-any.whl.
File metadata
- Download URL: mbtiles_s3_server-0.0.10-py3-none-any.whl
- Upload date:
- Size: 67.5 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.0 CPython/3.8.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 637195e6c9904bafb9b265e95b053524f191f19c98101869e4f9d7b40d82d699 |
|
| MD5 | 984f7e7fb56f7676d4988351d0741294 |
|
| BLAKE2b-256 | 7d7f91b8688f80c89cbb0caa6e2e88f74d7dfd99d778b2f32c10907b5529a940 |
