Skip to main content

An advanced geospatial data extraction and processing toolkit for Earth observation datasets.

Project description

🌍 MapMiner

Open in Colab Python Xarray Dask Numba Selenium

MapMiner is a geospatial tool designed to efficiently download and process geospatial data and metadata from various sources. It leverages powerful Python libraries like Selenium, Dask, Numba, and Xarray to provide high-performance data retrieval and processing capabilities for geospatial analysis and visualization.


🚀 Key Features

  • 🌐 Selenium: Automated web interactions for metadata extraction.
  • ⚙️ Dask: Distributed computing to manage large datasets.
  • 🚀 Numba: JIT compilation for accelerating numerical computations.
  • 📊 Xarray: Multi-dimensional array data handling for seamless integration.

📚 Supported Datasets

MapMiner supports a variety of geospatial datasets across multiple categories:

Category Datasets
🌍 Satellite Sentinel-2, Sentinel-1, MODIS, Landsat
🚁 Aerial NAIP
🗺️ Basemap Google, ESRI
📍 Vectors Google Building Footprint, OSM
🏔️ DEM (Digital Elevation Model) Copernicus DEM 30m, ALOS DEM
🌍 LULC (Land Use Land Cover) ESRI LULC
🌾 Crop Layer CDL Crop Mask

🛠 Installation

Ensure you have the necessary dependencies installed:

git clone https://github.com/gajeshladhar/mapminer.git
cd mapminer
pip3 install .

📝 Usage

MapMiner provides multiple classes to fetch and process different types of geospatial data:

1️⃣ GoogleBaseMapMiner

from mapminer.miner import GoogleBaseMapMiner
miner = GoogleBaseMapMiner()
ds = miner.fetch(lat=40.748817, lon=-73.985428, radius=500)

2️⃣ CDLMiner

from mapminer.miner import CDLMiner
miner = CDLMiner()
ds = miner.fetch(lon=-95.665, lat=39.8283, radius=10000, daterange="2024-01-01/2024-01-10")

3️⃣ GoogleBuildingMiner

from mapminer.miner import GoogleBuildingMiner
miner = GoogleBuildingMiner()
ds = miner.fetch(lat=34.052235, lon=-118.243683, radius=1000)

🖼 Visualizing the Data

You can easily visualize the data fetched using hvplot:

import hvplot.xarray
ds.hvplot.image(title=f"Captured on {ds.attrs['metadata']['date']['value']}")

📦 Dependencies

MapMiner relies on several Python libraries:

  • Selenium: For automated browser control.
  • Dask: For distributed computing and handling large data.
  • Numba: For accelerating numerical operations.
  • Xarray: For handling multi-dimensional array data.
  • EasyOCR: For extracting text from images.
  • HvPlot: For visualizing xarray data.

🛠 Contributing

Contributions are welcome! Fork the repository and submit pull requests. Include tests for any new features or bug fixes.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mapminer-0.1.1.tar.gz (4.2 MB view details)

Uploaded Source

Built Distribution

mapminer-0.1.1-py3-none-any.whl (36.1 kB view details)

Uploaded Python 3

File details

Details for the file mapminer-0.1.1.tar.gz.

File metadata

  • Download URL: mapminer-0.1.1.tar.gz
  • Upload date:
  • Size: 4.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.5

File hashes

Hashes for mapminer-0.1.1.tar.gz
Algorithm Hash digest
SHA256 021942f748b84ec2ba1bc5c50fd51e08c95ec8d98caa4820a838fcb9c2f42f32
MD5 ac060a54e3149d9061b85118c0bd3c6c
BLAKE2b-256 b0f6663d2bc3cfe41bb540a0cdcc00dd67b8895dcec8d305bff0a04b86d6048a

See more details on using hashes here.

File details

Details for the file mapminer-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: mapminer-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 36.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.5

File hashes

Hashes for mapminer-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 013333234804b6466fb05de58c919e3e65805ee0749a4e681d7809566761fb1f
MD5 f2afed17f7fa1b6cd9a08b60cbd89a0b
BLAKE2b-256 05f668b627e848d0331fe805145a8bb2497da3e708ffa4c35e054545e8168f05

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page