Skip to main content

Optimal routing for CRNS mobile sensor data collection

Project description

Sensor Routing

Python Version License

Optimal routing solution for mobile Cosmic Ray Neutron Sensing (CRNS) data collection. This package provides sophisticated algorithms for calculating efficient routes that maximize information value while minimizing travel distance and time.

Features

  • ๐Ÿ—บ๏ธ Geospatial Route Optimization: Calculate optimal routes using real-world road networks from OpenStreetMap
  • ๐Ÿ“Š Information Value Maximization: Balance between spatial coverage and information gain
  • ๐Ÿ”„ Multiple Routing Strategies: Support for both standard and economical routing approaches
  • ๐ŸŽฏ Point Mapping: Map sensor locations to road networks with advanced filtering
  • ๐Ÿ“ˆ Benefit Calculation: Evaluate information value of different route segments
  • ๐Ÿ›ฃ๏ธ Path Finding: Dijkstra-based algorithms with custom cost functions
  • ๐Ÿ” Hull Point Extraction: Optimize sensor placement using convex hull analysis

Installation

From PyPI (recommended)

pip install sensor-routing

From source

git clone https://codebase.helmholtz.cloud/ufz/tb5-smm/met/wg7/sensor-routing.git
cd sensor-routing
pip install -e .

Development installation

pip install -e ".[dev]"

Quick Start

Command Line Interface

The package provides a command-line interface for the full pipeline:

sensor-routing --wd /path/to/work_directory

Python API

from sensor_routing import point_mapping, benefit_calculation, path_finding, route_finding

# Map points to road network
pm_output = point_mapping.point_mapping(
    points_path="input/points.csv",
    osm_path="input/osm_data.geojson",
    output_path="output"
)

# Calculate benefits
bc_output = benefit_calculation.benefit_calculation(
    pm_output=pm_output,
    output_path="output"
)

# Find optimal path
pf_output = path_finding.path_finding(
    bc_output=bc_output,
    output_path="output"
)

# Generate final route
route = route_finding.route_finding(
    pf_output=pf_output,
    output_path="output"
)

Requirements

  • Python 3.12 or higher
  • See requirements.txt for full dependency list

Key Dependencies

  • NumPy & Pandas: Numerical and data processing
  • GeoPandas: Geospatial data handling
  • OSMnx: OpenStreetMap network analysis
  • NetworkX: Graph-based routing algorithms
  • Shapely: Geometric operations
  • SciPy & scikit-learn: Scientific computing and machine learning
  • Pydantic: Data validation

Project Structure

sensor_routing/
โ”œโ”€โ”€ point_mapping.py          # Map sensor points to road network
โ”œโ”€โ”€ benefit_calculation.py    # Calculate information value
โ”œโ”€โ”€ path_finding.py           # Find optimal paths
โ”œโ”€โ”€ route_finding.py          # Generate final routes
โ”œโ”€โ”€ hull_points_extraction.py # Extract convex hull points
โ”œโ”€โ”€ econ_mapping.py           # Economic point mapping variant
โ”œโ”€โ”€ econ_benefit.py           # Economic benefit calculation variant
โ”œโ”€โ”€ econ_paths.py             # Economic path finding variant
โ”œโ”€โ”€ econ_route.py             # Economic route finding variant
โ””โ”€โ”€ full_pipeline_cli.py      # Command-line interface

Usage

Working Directory Structure

The pipeline expects a working directory with the following structure:

work_dir/
โ”œโ”€โ”€ input/
โ”‚   โ”œโ”€โ”€ converted.csv         # Sensor point locations (EPSG:25832)
โ”‚   โ””โ”€โ”€ osm_data.geojson      # OpenStreetMap road network
โ”œโ”€โ”€ transient/                # Intermediate pipeline outputs
โ””โ”€โ”€ debug/                    # Debug outputs (optional, if DEBUG=True)

Input Data Format

converted.csv (sensor locations):

x,y,value
33395000,5695000,150
33396000,5696000,145
...

osm_data.geojson: GeoJSON file containing road network from OpenStreetMap

Pipeline Parameters

The pipeline can be configured via full_pipeline_parameters.json:

{
    "CRS": "EPSG:25832",
    "EPSG": 25832,
    "information_weight": 0.5,
    "start_node": null,
    "end_node": null,
    "max_iterations": 100,
    "enable_module_debug": false
}

Debug Mode

Enable debug output by setting ENABLE_MODULE_DEBUG = True in full_pipeline_cli.py or via parameters file. This will:

  • Print detailed progress information
  • Save intermediate results to debug/ directory
  • Show progress bars for long-running operations

Development

Running Tests

pytest test/

Code Formatting

black sensor_routing/
flake8 sensor_routing/

Type Checking

mypy sensor_routing/

Contributing

Contributions are welcome! Please:

  1. Fork the repository
  2. Create a feature branch (git checkout -b feature/amazing-feature)
  3. Commit your changes (git commit -m 'Add amazing feature')
  4. Push to the branch (git push origin feature/amazing-feature)
  5. Open a Merge Request

Documentation

For detailed documentation on specific modules:

  • Point Mapping: See HOW_TO_USE_FOR_ROUTING.md
  • Benefit Calculation: See IMPROVED_INFORMATION_VALUE_EXPLANATION.md
  • Debug Control: See DEBUG_CONTROL_GUIDE.md
  • Information Weights: See INFORMATION_WEIGHT_RANGES.md

Citation

If you use this software in your research, please cite:

@software{sensor_routing,
  author = {Topaclioglu, Can},
  title = {Sensor Routing: Optimal routing for CRNS mobile sensor data collection},
  year = {2024},
  url = {https://codebase.helmholtz.cloud/ufz/tb5-smm/met/wg7/sensor-routing}
}

License

This project is licensed under the European Union Public License 1.2 (EUPL-1.2). See the LICENSE file for details.

Authors

  • Can Topaclioglu - Initial work - UFZ

Acknowledgments

  • Helmholtz Centre for Environmental Research (UFZ)
  • Department of Monitoring and Exploration Technologies

Support

For questions, issues, or feature requests:

Changelog

Version 0.2.0 (Current)

  • โœจ Added comprehensive debug control system
  • โœจ Migrated to Pydantic V2
  • โœจ Added economic routing variants
  • ๐Ÿ› Fixed multiple debug output issues
  • ๐Ÿ“ฆ Prepared for PyPI distribution
  • ๐Ÿ“ Improved documentation

Version 0.1.15

  • Initial release with basic routing functionality

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sensor_routing-0.2.1.tar.gz (2.5 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sensor_routing-0.2.1-py3-none-any.whl (2.5 MB view details)

Uploaded Python 3

File details

Details for the file sensor_routing-0.2.1.tar.gz.

File metadata

  • Download URL: sensor_routing-0.2.1.tar.gz
  • Upload date:
  • Size: 2.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.9

File hashes

Hashes for sensor_routing-0.2.1.tar.gz
Algorithm Hash digest
SHA256 c177fd2d380663490e80638d91bb1751f92f522eeef17257c3878029ccf35ff1
MD5 f7add6330e14cf328e3d3cec03e92272
BLAKE2b-256 10f38eb3720b31b6da58335f9651bd87b565cea45f1e77aa103dc2be572c2499

See more details on using hashes here.

File details

Details for the file sensor_routing-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: sensor_routing-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 2.5 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.9

File hashes

Hashes for sensor_routing-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 23183f1fadc8b8b242d3c0ad4f8ae0e855f5038f3c1f04162004c67de7fd9041
MD5 e285f6622bab3cca2468d941558e50f0
BLAKE2b-256 d6d84aeaaa35a99ad8bb28d9b8270b4e806219f0b05504c93f500016af906986

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page