Pre-release

This release is a pre-release and may not be stable for production use.

TileCloud Chain

The goal of TileCloud Chain is to provide tools around tile generation on a chain like:

Source: WMS, Mapnik.

Optionally using an SQS queue, AWS host, SNS topic.

Destination in WMTS layout, on S3, on Berkeley DB (bsddb), on MBTiles, or on local filesystem.

Features:

Generate tiles.
Drop empty tiles.
Drop tiles outside a geometry or a bbox.
Use MetaTiles.
Generate the legend images.
Generate GetCapabilities.
Generate OpenLayers example page.
Obtain the hash of an empty tile.
In the future, measure tile generation speed.
Calculate cost and generation time.
In the future, manage the AWS hosts that generate tiles.
Delete empty tiles.
Copy files between caches.
Be able to use an SQS queue to dispatch the generation.
Post processing the generated tiles.
...

Legacy features:

bsddb support
sqlite (mbtiles) support
mapnik support (should be updated for Python3)

Get it

Create the config file tilegeneration/config.yaml see as example.

Support

Only the latest release is supported and version < 1.11 contains security issues.

From sources

Build it:

git submodule update --recursive
python3 -m venv .build/venv
.build/venv/bin/pip install -r requirements.txt
.build/venv/bin/pip install -e .
.build/venv/bin/pip install -r dev-requirements.txt

Run prospector

.build/venv/bin/prospector

Run the tests

Setup your environment:

touch tilecloud_chain/OpenLayers.js
docker build --tag camptocamp/tilecloud-chain .
docker-compose -p tilecloud up

To run the tests:

docker-compose -p tilecloud exec test python setup.py nosetests --logging-filter=tilecloud,tilecloud_chain --attr '!'nopy3

Documentation

As documentation you can read the https://github.com/camptocamp/tilecloud-chain/blob/master/tilecloud_chain/USAGE.rst.

VSCode

You can add that in your workspace configuration to use the JSON schema:

{
  "yaml.schemas": {
    "../tilecloud-chain/tilecloud_chain/schema.json": [
      "tilecloud-chain/tilecloud_chain/tests/tilegeneration/*.yaml"
    ]
  }
}

Changelog

Release 1.17

Change the validator and parser => duplicate key generate an error: on/off are no more considered as boolean.
The argument --layer is no more used when we use the parameter --tiles, we get the information from the tiles file.
Be able to mutualise the service.
Add Azure blob storage
Remove Apache and MapCache
Remove the log_format in the generation configuration, nor we use the logging configuration from the development.ini file.

Release 1.16

Change the config validator who is a little bit more strict.

Release 1.4

Add optional metadata section to the config file. See the scaffolds for example.

Release 0.9

Correct some error with slash.
Better error handling.
Be able to have one error file per layer.

Release 0.8

Correct some error with slash.
Add pre_hash_post_process and post_process.
Add copy command.

Release 0.7

Support of deferent geoms per layers, requires configuration changes, old version:

connection: user=www-data password=www-data dbname=<db> host=localhost
sql: <column> AS geom FROM <table>

to new version:

connection: user=www-data password=www-data dbname=<db> host=localhost
geoms:
  - sql: <column> AS geom FROM <table>

More information in the Configure geom/sql chapter.

Update from optparse to argparse, and some argument refactoring, use --help to see the new version.
Add support of Blackbery DB (bsddb).
The tile server is completely rewrite, now it support all cache, REST and KVP interface, GetFeatureInfo request, and it can be used as a pyramid view or as a WSGI server. More information in the istribute the tiles chapter.
Add three strategy to bypass the proxy/cache: Use the headers Cache-Control: no-cache, no-store, Pragma: no-cache (default). Use localhost in the URL and the header Host: <host_name> (recommended). Add a SALT random argument (if the above don't work). More information in the Proxy/cache issue chapter.
Improve the dimensions usage by adding it ti the WMS requests, And add a --dimensions argument of generate_tiles to change the dimensions values.
Extract generate_cost and generate_amazon from generate_controler.
Now we can creates legends, see the Legends chapter.
Now the tiles generation display generation statistics at the ends.
The EC2 configuration is moved in a separate structure, see README for more information.

Release 0.6

Now the apache configuration can be generated with .build/venv/bin/generate_controller --generate-apache-config, it support filesystem cache and MapCache.
Windows fixes.
Use console rewrite (r) to log generated tiles coordinates.
Now if no layers is specified in generation:default_layers we generate all layers by default.
Now bbox to be floats.
New --get-bbox option to get the bbox of a tile.
Add coveralls support (https://coveralls.io/r/camptocamp/tilecloud-chain).
Add an config option generation:error_file and a command option --tiles to store and regenerate errored tiles.

Release 0.5

SQS config change:

layers:
  layer_name:
    sqs:
      # The region where the SQS queue is
      region: eu-west-1
      # The SQS queue name, it should already exists
      queue: the_name

Add debug option (--debug), please use it to report issue.
Now the sql request can return a set of geometries in a column names geom but the syntax change a little bit => <column> AS geom FROM <table>

Development Status
- 5 - Production/Stable
Environment
- Web Environment
Framework
- Pyramid
Intended Audience
- Other Audience
License
- OSI Approved :: BSD License
Operating System
- OS Independent
Programming Language
Topic
- Scientific/Engineering :: GIS
Typing
- Typed

Metadata

Development Status
- 5 - Production/Stable
Environment
- Web Environment
Framework
- Pyramid
Intended Audience
- Other Audience
License
- OSI Approved :: BSD License
Operating System
- OS Independent
Programming Language
Topic
- Scientific/Engineering :: GIS
Typing
- Typed

Release files for tilecloud-chain 1.17.0.dev20220309142200

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for tilecloud-chain 1.17.0.dev20220309142200
File	Interpreter	ABI	Platform	Reset
tilecloud_chain-1.17.0.dev20220309142200-py3-none-any.whl 74.5 kB Mar 9, 2022	Python 3	none	any	Details

Release files / tilecloud_chain-1.17.0.dev20220309142200-py3-none-any.whl

Download URL	tilecloud_chain-1.17.0.dev20220309142200-py3-none-any.whl
Size	74.5 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`f0d3ca1f4cd5df12cd3ac2a5172c45439dbb1ca37b5ce6c3d98d859879b07eb1`
BLAKE2b-256 checksum How to use checksums	`420252a49a1a40df85849987323d26b564580f30f1e83083d2ca682fc796d1fe`
Upload date	Mar 9, 2022
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/3.8.0 pkginfo/1.8.2 readme-renderer/33.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/18.0.1 rfc3986/2.0.0 colorama/0.4.3 CPython/3.8.10`