Skip to main content

An advanced geospatial data extraction and processing toolkit for Earth observation datasets.

Project description

🌍 MapMiner

Open in Colab Python Xarray Dask Numba Selenium

MapMiner is a geospatial tool designed to efficiently download and process geospatial data and metadata from various sources. It leverages powerful Python libraries like Selenium, Dask, Numba, and Xarray to provide high-performance data retrieval and processing capabilities for geospatial analysis and visualization.


🚀 Key Features

  • 🌐 Selenium: Automated web interactions for metadata extraction.
  • ⚙️ Dask: Distributed computing to manage large datasets.
  • 🚀 Numba: JIT compilation for accelerating numerical computations.
  • 📊 Xarray: Multi-dimensional array data handling for seamless integration.

📚 Supported Datasets

MapMiner supports a variety of geospatial datasets across multiple categories:

Category Datasets
🌍 Satellite Sentinel-2, Sentinel-1, MODIS, Landsat
🚁 Aerial NAIP
🗺️ Basemap Google, ESRI
📍 Vectors Google Building Footprint, OSM
🏔️ DEM (Digital Elevation Model) Copernicus DEM 30m, ALOS DEM
🌍 LULC (Land Use Land Cover) ESRI LULC
🌾 Crop Layer CDL Crop Mask
🕒 Real-Time Google Maps Real-Time Traffic

🛠 Installation

Ensure you have the necessary dependencies installed:

pip3 install mapminer

📝 Usage

MapMiner provides multiple classes to fetch and process different types of geospatial data:

1️⃣ GoogleBaseMapMiner

from mapminer.miner import GoogleBaseMapMiner
miner = GoogleBaseMapMiner()
ds = miner.fetch(lat=40.748817, lon=-73.985428, radius=500)

2️⃣ CDLMiner

from mapminer.miner import CDLMiner
miner = CDLMiner()
ds = miner.fetch(lon=-95.665, lat=39.8283, radius=10000, daterange="2024-01-01/2024-01-10")

3️⃣ GoogleBuildingMiner

from mapminer.miner import GoogleBuildingMiner
miner = GoogleBuildingMiner()
ds = miner.fetch(lat=34.052235, lon=-118.243683, radius=1000)

🖼 Visualizing the Data

You can easily visualize the data fetched using hvplot:

import hvplot.xarray
ds.hvplot.image(title=f"Captured on {ds.attrs['metadata']['date']['value']}")

📦 Dependencies

MapMiner relies on several Python libraries:

  • Selenium: For automated browser control.
  • Dask: For distributed computing and handling large data.
  • Numba: For accelerating numerical operations.
  • Xarray: For handling multi-dimensional array data.
  • EasyOCR: For extracting text from images.
  • HvPlot: For visualizing xarray data.

🛠 Contributing

Contributions are welcome! Fork the repository and submit pull requests. Include tests for any new features or bug fixes.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mapminer-0.1.13.tar.gz (117.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mapminer-0.1.13-py3-none-any.whl (39.1 kB view details)

Uploaded Python 3

File details

Details for the file mapminer-0.1.13.tar.gz.

File metadata

  • Download URL: mapminer-0.1.13.tar.gz
  • Upload date:
  • Size: 117.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.5

File hashes

Hashes for mapminer-0.1.13.tar.gz
Algorithm Hash digest
SHA256 69772491837b1c4002c5681deb57f26a8b4104fe2f2e7f7cd0b702a2cf7c4cab
MD5 a3296f6123707a75cf2d4b4cdc69bc0b
BLAKE2b-256 7d41920a2d58efd8fc2e2a5a3109c2bc64fcd22ec7bd88987be9ed4dc2a49b2e

See more details on using hashes here.

File details

Details for the file mapminer-0.1.13-py3-none-any.whl.

File metadata

  • Download URL: mapminer-0.1.13-py3-none-any.whl
  • Upload date:
  • Size: 39.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.5

File hashes

Hashes for mapminer-0.1.13-py3-none-any.whl
Algorithm Hash digest
SHA256 45dbf1ec39a5a1ac43d8d6fdc93277baf12b4ddfafdb42f3bd42fb7a74e48ffc
MD5 e253911d8a41d81c1890c35c71968ff4
BLAKE2b-256 f7e844f319d8c9bfd32415eab78cdd33900ca42af7c704a064b0656c22307cf6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page