Skip to main content

Command line tool for scraping GeoJSON from ThinkGIS sites

Project description

thinkgisdump

Build status pypi

Command line tool for scraping GeoJSON from ThinkGIS sites. Based on pyesridump.

Install

You can install thinkgisdump using pip with the following command:

pip install thinkgisdump

This will add the script thinkgis2geojson to your path.

Usage

usage: thinkgis2geojson [-h] [-l LAYER_ID] [-o OUTPUT] [-q QUIET] url

Scrape GeoJSON from ThinkGIS sites

positional arguments:
  url                   ThinkGIS server URL, layer ID will be parsed from the dsid query param if present

optional arguments:
  -h, --help            show this help message and exit
  -l LAYER_ID, --layer-id LAYER_ID
                        Layer ID (in the dsid query param) to be scraped
  -o OUTPUT, --output OUTPUT
                        Output file name, defaults to stdout
  -q QUIET, --quiet QUIET
                        Suppress logging of feature requests

Because of the defaults and setting the layer ID based on query params, the following two command are equivalent.

thinkgis2geojson https://richlandil.wthgis.com --layer-id 1283 -o richland-precincts.geojson
thinkgis2geojson 'https://richlandil.wthgis.com?dsid=1283' > richland-precincts.geojson

Notes

To get the parameters you'll need to scrape a given ThinkGIS layer, you can open the "Index" section on a map page. On the map index panel that opens up, you can open developer tools to see the full URL of the link for the layer you're interested in. The layer ID will be in the dsid parameter. You can also use this full URL including the query parameter in the url argument and it will be used without supplying --layer-id separately.

ThinkGIS returns point and multipoint geometries as polygon circles. When these are encountered, the mean point of the circle is used to create a point or multipoint GeoJSON geometry. Line shapes are also returned as polygons, and currently these are returned as polygons without further transformation.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

thinkgisdump-0.2.1.tar.gz (5.6 kB view details)

Uploaded Source

Built Distribution

thinkgisdump-0.2.1-py3-none-any.whl (6.0 kB view details)

Uploaded Python 3

File details

Details for the file thinkgisdump-0.2.1.tar.gz.

File metadata

  • Download URL: thinkgisdump-0.2.1.tar.gz
  • Upload date:
  • Size: 5.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.12 CPython/3.9.9 Linux/5.11.0-1025-azure

File hashes

Hashes for thinkgisdump-0.2.1.tar.gz
Algorithm Hash digest
SHA256 f486c7b50d0e0d1b5298a750efc4ce3060ec4015eec06b7f90aa2e08dcfccecb
MD5 2e9f62233d5b69db5d790e56ee5cee74
BLAKE2b-256 eb552db2762b8cf06109ab39225b8eb8517139118d4c3eaafb2eb87778135900

See more details on using hashes here.

File details

Details for the file thinkgisdump-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: thinkgisdump-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 6.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.12 CPython/3.9.9 Linux/5.11.0-1025-azure

File hashes

Hashes for thinkgisdump-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 039050d9c61c9f831ff899616f70151895bffa19f1e67427386eb82e88d4e6ec
MD5 b687c3de33e94c099b33808f92e80102
BLAKE2b-256 a43be3ddefcc6562ef7960f34e8582e0dd979ae923f3086106e16d967db8642c

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page