Skip to main content

Fast linestring simplification using RDP or Visvalingam-Whyatt and a Rust binary

Project description

Build Status Coverage Status Downloads DOI Anaconda-Server Badge

Simplification

Simplify a LineString using the Ramer–Douglas–Peucker or Visvalingam-Whyatt algorithms

Line

Installation

uv add simplification OR
pip install simplification OR
conda install conda-forge::simplification

Installing for local development

  1. Ensure you have a copy of librdp from https://github.com/urschrei/rdp/releases, and it's in the src/simplification subdir
  2. run pip install -e .[test] --use-pep517
  3. run pytest .

Supported Python Versions

Simplification supports all currently supported Python versions.

Supported Platforms

  • Linux (manylinux-compatible) x86_64 and aarch64
  • macOS Darwin x86_64 and arm64
  • Windows 64-bit

Usage

from simplification.cutil import (
    simplify_coords,
    simplify_coords_idx,
    simplify_coords_vw,
    simplify_coords_vw_idx,
    simplify_coords_vwp,
)

# Using Ramer–Douglas–Peucker
coords = [
    [0.0, 0.0],
    [5.0, 4.0],
    [11.0, 5.5],
    [17.3, 3.2],
    [27.8, 0.1]
]

# For RDP, Try an epsilon of 1.0 to start with. Other sensible values include 0.01, 0.001
simplified = simplify_coords(coords, 1.0)

# simplified is [[0.0, 0.0], [5.0, 4.0], [11.0, 5.5], [27.8, 0.1]]

# Using Visvalingam-Whyatt
# You can also pass numpy arrays, in which case you'll get numpy arrays back
import numpy as np
coords_vw = np.array([
    [5.0, 2.0],
    [3.0, 8.0],
    [6.0, 20.0],
    [7.0, 25.0],
    [10.0, 10.0]
])
simplified_vw = simplify_coords_vw(coords_vw, 30.0)

# simplified_vw is [[5.0, 2.0], [7.0, 25.0], [10.0, 10.0]]

Passing empty and/or 1-element lists will return them unaltered.

But I only want the simplified Indices

simplification now has:

  • cutil.simplify_coords_idx
  • cutil.simplify_coords_vw_idx

The values returned by these functions are the retained indices. In order to use them as e.g. a masked array in Numpy, something like the following will work:

import numpy as np
from simplification.cutil import simplify_coords_idx

# assume an array of coordinates: orig
simplified = simplify_coords_idx(orig, 1.0)
# build new geometry using only retained coordinates
orig_simplified = orig[simplified]

But I need to ensure that the resulting geometries are valid

You can use the topology-preserving variant of VW for this: simplify_coords_vwp. It's slower, but has a far greater likelihood of producing a valid geometry.

But I Want to Simplify Polylines

No problem; Decode them to LineStrings first.

# pip install pypolyline before you do this
from pypolyline.cutil import decode_polyline
# an iterable of Google-encoded Polylines, so precision is 5. For OSRM &c., it's 6
decoded = (decode_polyline(line, 5) for line in polylines)
simplified = [simplify_coords(line, 1.0) for line in decoded]

How it Works

FFI and a Rust binary

Is It Fast

I should think so.

What does that mean

Using numpy arrays for input and output, the library can be reasonably expected to process around 2500 1000-point LineStrings per second on a Core i7 or equivalent, for a 98%+ reduction in size.
A larger LineString, containing 200k+ points can be reduced to around 3k points (98.5%+) in around 50ms using RDP.

This is based on a test harness available here.

Disclaimer

All benchmarks are subjective, and pathological input will greatly increase processing time. Error-checking is non-existent at this point.

License

Blue Oak Model Licence 1.0.0

Citing Simplification

If Simplification has been significant in your research, and you would like to acknowledge the project in your academic publication, we suggest citing it as follows (example in APA style, 7th edition):

Hügel, S. (2021). Simplification (Version X.Y.Z) [Computer software]. https://doi.org/10.5281/zenodo.5774852

In Bibtex format:

@software{Hugel_Simplification_2021,
author = {Hügel, Stephan},
doi = {10.5281/zenodo.5774852},
license = {MIT},
month = {12},
title = {{Simplification}},
url = {https://github.com/urschrei/simplification},
version = {X.Y.Z},
year = {2021}
}

Blue Oak Model License

Version 1.0.0

Purpose

This license gives everyone as much permission to work with this software as possible, while protecting contributors from liability.

Acceptance

In order to receive this license, you must agree to its rules. The rules of this license are both obligations under that agreement and conditions to your license. You must not do anything with this software that triggers a rule that you cannot or will not follow.

Copyright

Each contributor licenses you to do everything with this software that would otherwise infringe that contributor's copyright in it.

Notices

You must ensure that everyone who gets a copy of any part of this software from you, with or without changes, also gets the text of this license or a link to https://blueoakcouncil.org/license/1.0.0.

Excuse

If anyone notifies you in writing that you have not complied with Notices, you can keep your license by taking all practical steps to comply within 30 days after the notice. If you do not do so, your license ends immediately.

Patent

Each contributor licenses you to do everything with this software that would otherwise infringe any patent claims they can license or become able to license.

Reliability

No contributor can revoke this license.

No Liability

As far as the law allows, this software comes as is, without any warranty or condition, and no contributor will be liable to anyone for any damages related to this software or this license, under any kind of legal claim.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

simplification-0.7.13.tar.gz (1.4 MB view hashes)

Uploaded Source

Built Distributions

simplification-0.7.13-cp313-cp313-win_amd64.whl (184.7 kB view hashes)

Uploaded CPython 3.13 Windows x86-64

simplification-0.7.13-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (729.4 kB view hashes)

Uploaded CPython 3.13 manylinux: glibc 2.17+ x86-64

simplification-0.7.13-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (705.9 kB view hashes)

Uploaded CPython 3.13 manylinux: glibc 2.17+ ARM64

simplification-0.7.13-cp313-cp313-macosx_11_0_arm64.whl (254.4 kB view hashes)

Uploaded CPython 3.13 macOS 11.0+ ARM64

simplification-0.7.13-cp313-cp313-macosx_10_13_x86_64.whl (273.3 kB view hashes)

Uploaded CPython 3.13 macOS 10.13+ x86-64

simplification-0.7.13-cp312-cp312-win_amd64.whl (184.6 kB view hashes)

Uploaded CPython 3.12 Windows x86-64

simplification-0.7.13-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (734.6 kB view hashes)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

simplification-0.7.13-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (708.1 kB view hashes)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARM64

simplification-0.7.13-cp312-cp312-macosx_11_0_arm64.whl (255.8 kB view hashes)

Uploaded CPython 3.12 macOS 11.0+ ARM64

simplification-0.7.13-cp312-cp312-macosx_10_13_x86_64.whl (274.5 kB view hashes)

Uploaded CPython 3.12 macOS 10.13+ x86-64

simplification-0.7.13-cp311-cp311-win_amd64.whl (186.0 kB view hashes)

Uploaded CPython 3.11 Windows x86-64

simplification-0.7.13-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (747.0 kB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

simplification-0.7.13-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (726.0 kB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARM64

simplification-0.7.13-cp311-cp311-macosx_11_0_arm64.whl (254.9 kB view hashes)

Uploaded CPython 3.11 macOS 11.0+ ARM64

simplification-0.7.13-cp311-cp311-macosx_10_9_x86_64.whl (275.2 kB view hashes)

Uploaded CPython 3.11 macOS 10.9+ x86-64

simplification-0.7.13-cp310-cp310-win_amd64.whl (185.9 kB view hashes)

Uploaded CPython 3.10 Windows x86-64

simplification-0.7.13-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (700.4 kB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

simplification-0.7.13-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (681.1 kB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARM64

simplification-0.7.13-cp310-cp310-macosx_11_0_arm64.whl (255.0 kB view hashes)

Uploaded CPython 3.10 macOS 11.0+ ARM64

simplification-0.7.13-cp310-cp310-macosx_10_9_x86_64.whl (275.1 kB view hashes)

Uploaded CPython 3.10 macOS 10.9+ x86-64

simplification-0.7.13-cp39-cp39-win_amd64.whl (186.4 kB view hashes)

Uploaded CPython 3.9 Windows x86-64

simplification-0.7.13-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (702.1 kB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

simplification-0.7.13-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (683.5 kB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARM64

simplification-0.7.13-cp39-cp39-macosx_10_9_x86_64.whl (275.8 kB view hashes)

Uploaded CPython 3.9 macOS 10.9+ x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page