Skip to main content

Fast linestring simplification using RDP or Visvalingam-Whyatt and a Rust binary

Project description

Build Status Build status Coverage Status

Simplification

Simplify a LineString using the Ramer–Douglas–Peucker or Visvalingam-Whyatt algorithms

Line

Installation

pip install simplification
Please use a recent (>= 8.1.2) version of pip.

Supported Python Versions

  • Python 2.7
  • Python 3.6
  • Python 3.7
  • Python 3.8 (Linux and macOS only)

Supported Platforms

  • Linux (manylinux1-compatible)
  • macOS
  • Windows 32-bit / 64-bit

Usage

import numpy as np
from simplification.cutil import (
    simplify_coords,
    simplify_coords_idx,
    simplify_coords_vw,
    simplify_coords_vw_idx,
    simplify_coords_vwp,
)

# Using Ramer–Douglas–Peucker
coords = [
    [0.0, 0.0],
    [5.0, 4.0],
    [11.0, 5.5],
    [17.3, 3.2],
    [27.8, 0.1]
]

# For RDP, Try an epsilon of 1.0 to start with. Other sensible values include 0.01, 0.001
simplified = simplify_coords(coords, 1.0)

# simplified is [[0.0, 0.0], [5.0, 4.0], [11.0, 5.5], [27.8, 0.1]]

# Using Visvalingam-Whyatt
# You can also pass numpy arrays, in which case you'll get numpy arrays back
coords_vw = np.array([
    [5.0, 2.0],
    [3.0, 8.0],
    [6.0, 20.0],
    [7.0, 25.0],
    [10.0, 10.0]
])
simplified_vw = simplify_coords_vw(coords, 30.0)

# simplified_vw is [[5.0, 2.0], [7.0, 25.0], [10.0, 10.0]]

Passing empty and/or 1-element lists will return them unaltered.

But I only want the simplified Indices

simplification now has:

  • cutil.simplify_coords_idx
  • cutil.simplify_coords_vw_idx

The values returned by these functions are the retained indices. In order to use them as e.g. a masked array in Numpy, something like the following will work:

import numpy as np
from simplification.cutil import simplify_coords_idx

# assume an array of coordinates: orig
simplified = simplify_coords_idx(orig, 1.0)
# build new geometry using only retained coordinates
orig_simplified = orig[simplified]

But I need to ensure that the resulting geometries are valid

You can use the topology-preserving variant of VW for this: simplify_coords_vwp. It's slower, but has a far greater likelihood of producing a valid geometry.

But I Want to Simplify Polylines

No problem; Decode them to LineStrings first.

# pip install pypolyline before you do this
from pypolyline.cutil import decode_polyline
# an iterable of Google-encoded Polylines, so precision is 5. For OSRM &c., it's 6
decoded = (decode_polyline(line, 5) for line in polylines)
simplified = [simplify_coords(line, 1.0) for line in decoded]

How it Works

FFI and a Rust binary

Is It Fast

I should think so.

What does that mean

Using numpy arrays for input and output, the library can be reasonably expected to process around 2500 1000-point LineStrings per second on a Core i7 or equivalent, for a 98%+ reduction in size.
A larger LineString, containing 200k+ points can be reduced to around 3k points (98.5%+) in around 50ms using RDP.

This is based on a test harness available here.

Disclaimer

All benchmarks are subjective, and pathological input will greatly increase processing time. Error-checking is non-existent at this point.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

simplification-0.5.2-cp38-cp38-win_amd64.whl (351.4 kB view hashes)

Uploaded CPython 3.8 Windows x86-64

simplification-0.5.2-cp38-cp38-manylinux2010_x86_64.whl (659.7 kB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.12+ x86-64

simplification-0.5.2-cp38-cp38-manylinux1_x86_64.whl (659.7 kB view hashes)

Uploaded CPython 3.8

simplification-0.5.2-cp38-cp38-macosx_10_9_x86_64.macosx_10_9_intel.macosx_10_10_intel.macosx_10_10_x86_64.macosx_10_11_intel.macosx_10_11_x86_64.whl (306.7 kB view hashes)

Uploaded CPython 3.8 macOS 10.10+ intel macOS 10.10+ x86-64 macOS 10.11+ intel macOS 10.11+ x86-64 macOS 10.9+ intel macOS 10.9+ x86-64

simplification-0.5.2-cp37-cp37m-win_amd64.whl (350.0 kB view hashes)

Uploaded CPython 3.7m Windows x86-64

simplification-0.5.2-cp37-cp37m-win32.whl (337.1 kB view hashes)

Uploaded CPython 3.7m Windows x86

simplification-0.5.2-cp37-cp37m-manylinux2010_x86_64.whl (605.7 kB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

simplification-0.5.2-cp37-cp37m-manylinux1_x86_64.whl (605.7 kB view hashes)

Uploaded CPython 3.7m

simplification-0.5.2-cp37-cp37m-macosx_10_9_x86_64.macosx_10_9_intel.macosx_10_10_intel.macosx_10_10_x86_64.macosx_10_11_intel.macosx_10_11_x86_64.whl (306.4 kB view hashes)

Uploaded CPython 3.7m macOS 10.10+ intel macOS 10.10+ x86-64 macOS 10.11+ intel macOS 10.11+ x86-64 macOS 10.9+ intel macOS 10.9+ x86-64

simplification-0.5.2-cp36-cp36m-win32.whl (337.1 kB view hashes)

Uploaded CPython 3.6m Windows x86

simplification-0.5.2-cp36-cp36m-manylinux2010_x86_64.whl (607.5 kB view hashes)

Uploaded CPython 3.6m manylinux: glibc 2.12+ x86-64

simplification-0.5.2-cp36-cp36m-manylinux1_x86_64.whl (607.5 kB view hashes)

Uploaded CPython 3.6m

simplification-0.5.2-cp36-cp36m-macosx_10_9_x86_64.macosx_10_9_intel.macosx_10_10_intel.macosx_10_10_x86_64.macosx_10_11_intel.macosx_10_11_x86_64.whl (308.5 kB view hashes)

Uploaded CPython 3.6m macOS 10.10+ intel macOS 10.10+ x86-64 macOS 10.11+ intel macOS 10.11+ x86-64 macOS 10.9+ intel macOS 10.9+ x86-64

simplification-0.5.2-cp27-cp27mu-manylinux2010_x86_64.whl (562.9 kB view hashes)

Uploaded CPython 2.7mu manylinux: glibc 2.12+ x86-64

simplification-0.5.2-cp27-cp27mu-manylinux1_x86_64.whl (562.9 kB view hashes)

Uploaded CPython 2.7mu

simplification-0.5.2-cp27-cp27m-macosx_10_9_x86_64.macosx_10_9_intel.macosx_10_10_intel.macosx_10_10_x86_64.macosx_10_11_intel.macosx_10_11_x86_64.whl (306.2 kB view hashes)

Uploaded CPython 2.7m macOS 10.10+ intel macOS 10.10+ x86-64 macOS 10.11+ intel macOS 10.11+ x86-64 macOS 10.9+ intel macOS 10.9+ x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page