mapminer 0.1.57

An advanced geospatial data extraction and processing toolkit for Earth observation datasets.

🌍 MapMiner

MapMiner is a geospatial tool designed to efficiently download and process geospatial data and metadata from various sources. It leverages powerful Python libraries like Selenium, Dask, Numba, and Xarray to provide high-performance data retrieval and processing capabilities for geospatial analysis and visualization.

🚀 Key Features

• 🌐 Selenium: Automated web interactions for metadata extraction.
• ⚙️ Dask: Distributed computing to manage large datasets.
• 🚀 Numba: JIT compilation for accelerating numerical computations.
• 📊 Xarray: Multi-dimensional array data handling for seamless integration.

📚 Supported Datasets

MapMiner supports a variety of geospatial datasets across multiple categories:

Category	Datasets
🌍 Satellite	Sentinel-2, Sentinel-1, MODIS, Landsat
🚁 Aerial	NAIP
🗺️ Basemap	Google, ESRI
📍 Vectors	Google Building Footprint, OSM
🏔️ DEM (Digital Elevation Model)	Copernicus DEM 30m, ALOS DEM
🌍 LULC (Land Use Land Cover)	ESRI LULC
🌾 Crop Layer	CDL Crop Mask
🕒 Real-Time	Google Maps Real-Time Traffic

🛠 Installation

Ensure you have the necessary dependencies installed:

pip3 install mapminer

📝 Usage

MapMiner provides multiple classes to fetch and process different types of geospatial data:

1️⃣ GoogleBaseMapMiner

from mapminer.miners import GoogleBaseMapMiner
miner = GoogleBaseMapMiner()
ds = miner.fetch(lat=40.748817, lon=-73.985428, radius=500)

2️⃣ CDLMiner

from mapminer.miners import CDLMiner
miner = CDLMiner()
ds = miner.fetch(lon=-95.665, lat=39.8283, radius=10000, daterange="2024-01-01/2024-01-10")

3️⃣ GoogleBuildingMiner

from mapminer.miners import GoogleBuildingMiner
miner = GoogleBuildingMiner()
ds = miner.fetch(lat=34.052235, lon=-118.243683, radius=1000)

4️⃣ NAFNet Model

You can import and use NAFNet directly for downstream tasks like denoising, enhancement, etc.:

from mapminer.models import NAFNet
model = NAFNet(in_channels=12, dim=32,)
output = model(input_tensor)

🖼 Visualizing the Data

You can easily visualize the data fetched using hvplot:

import hvplot.xarray
ds.hvplot.image(title=f"Captured on {ds.attrs['metadata']['date']['value']}")

📦 Dependencies

MapMiner relies on several Python libraries:

• Selenium: For automated browser control.
• Dask: For distributed computing and handling large data.
• Numba: For accelerating numerical operations.
• Xarray: For handling multi-dimensional array data.
• EasyOCR: For extracting text from images.
• HvPlot: For visualizing xarray data.

🛠 Contributing

Contributions are welcome! Fork the repository and submit pull requests. Include tests for any new features or bug fixes.