Skip to main content

Geobuf is a compact binary geospatial format for lossless compression of GeoJSON and TopoJSON data.

Project description

Geobuf is a compact binary geospatial format for lossless compression of GeoJSON and TopoJSON data.

Build Status Coverage Status

Advantages over using GeoJSON and TopoJSON directly (in this revised version):

  • Very compact: typically makes GeoJSON 6-8 times smaller and TopoJSON 2-3 times smaller.

  • Smaller even when comparing gzipped sizes: 2-2.5x compression for GeoJSON and 20-30% for TopoJSON.

  • Easy incremental parsing — you can get features out as you read them, without the need to build in-memory representation of the whole data.

  • Partial reads — you can read only the parts you actually need, skipping the rest.

  • Trivial concatenation: you can concatenate many Geobuf files together and they will form a valid combined Geobuf file.

  • Potentially faster encoding/decoding compared to native JSON implementations (i.e. in Web browsers).

  • Can still accommodate any GeoJSON and TopoJSON data, including extensions with arbitrary properties.

Think of this as an attempt to design a simple, modern Shapefile successor that works seamlessly with GeoJSON and TopoJSON.

Unlike Mapbox Vector Tiles, it aims for lossless compression of datasets — without tiling, projecting coordinates, flattening geometries or stripping properties.

pygeobuf

This repository is the first encoding/decoding implementation of this new major version of Geobuf (in Python). It serves as a prototyping playground, with faster implementations in JS and C++ coming in future.

Sample compression sizes

| normal    | gzipped

us-zips.json

101.85 MB

26.67 MB

us-zips.pbf

12.24 MB

10.48 MB

us-zips.topo.json

15.02 MB

3.19 MB

us-zips.topo.pbf

4.85 MB

2.72 MB

idaho.json

10.92 MB

2.57 MB

idaho.pbf

1.37 MB

1.17 MB

idaho.topo.json

1.9 MB

612 KB

idaho.topo.pbf

567 KB

479 KB

Usage

Command line:

geobuf encode < example.json > example.pbf
geobuf decode < example.pbf > example.pbf.json

As a module:

import geobuf

pbf = geobuf.encode(my_json) # GeoJSON or TopoJSON -> Geobuf string
my_json = geobuf.decode(pbf) # Geobuf string -> GeoJSON or TopoJSON

The encode function accepts a dict-like object, for example the result of json.loads(json_str).

Both encode.py and geobuf.encode accept two optional arguments:

  • precision — max number of digits after the decimal point in coordinates, 6 by default.

  • dimensions — number of dimensions in coordinates, 2 by default.

Tests

py.test -v

The tests run through all .json files in the fixtures directory, comparing each original GeoJSON with an encoded/decoded one.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

geobuf-1.1.0.tar.gz (54.2 kB view details)

Uploaded Source

Built Distributions

geobuf-1.1.0-py3-none-any.whl (14.1 kB view details)

Uploaded Python 3

geobuf-1.1.0-py2-none-any.whl (14.1 kB view details)

Uploaded Python 2

File details

Details for the file geobuf-1.1.0.tar.gz.

File metadata

  • Download URL: geobuf-1.1.0.tar.gz
  • Upload date:
  • Size: 54.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for geobuf-1.1.0.tar.gz
Algorithm Hash digest
SHA256 daa87156272d8045825903119e1a23eeef32d6158db730c7647cf5f4c8700bf6
MD5 bd64b34c8ba86d0c8498e2bd58508e22
BLAKE2b-256 d93476d1199c20e1e1eec7534f98d09b965f79025ee889dc45226890716ea283

See more details on using hashes here.

File details

Details for the file geobuf-1.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for geobuf-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 28351e2029f5100fa146b9a1af0a4a7bf5a426760d2bb078b4362fd94eb03689
MD5 9fc67bfdbc6e21125dcd3c372a5093bc
BLAKE2b-256 0a567820f052a4476f1992c7705cf377f5163e65028d4df85b7e17d5add93eed

See more details on using hashes here.

File details

Details for the file geobuf-1.1.0-py2-none-any.whl.

File metadata

File hashes

Hashes for geobuf-1.1.0-py2-none-any.whl
Algorithm Hash digest
SHA256 3793c9a819ee8cd17edf2172e2045b1ebb5c40cc2d04722234819f1c1d2fd641
MD5 75b30ecff70c1d40e86cb7b4052be31c
BLAKE2b-256 71c983669a2fa813b711306aeaa1a0ccec771e0743f10e4f8dc393a1ba7800e0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page