Skip to main content

GEOROC database downloader and SQLite converter

Project description

GeoRocData

GEOROC database downloader and SQLite converter.

Automatically downloads, processes, and builds a SQLite database from GEOROC precompiled datasets.

Features

  • Download all GEOROC precompiled CSV data from the new georoc.eu DOI system
  • Legacy fallback to georoc.mpch-mainz.gwdg.de for older data
  • Fix CSV quote errors that GEOROC data commonly has
  • Split each CSV into data, abbreviations, and references sections
  • Build SQLite database with deduplication

Installation

pip install georocdata

Usage

Command Line

# Full update: download + process + build DB
georocdata

# Only download
georocdata --download-only

# Only process existing CSVs + build DB
georocdata --process-only

# Use legacy georoc.mpch-mainz.gwdg.de source
georocdata --source legacy

# Both sources
georocdata --source both

# Skip steps
georocdata --skip-fix --skip-split

# Custom output directory and DB name
georocdata --output-dir ./my_data --db-name my_georoc.db

Python API

from georocdata import GEOROCDownloader, GEOROCProcessor

# Download
dl = GEOROCDownloader(output_dir="./data")
dl.download_new_source()

# Process
proc = GEOROCProcessor(data_dir="./data")
proc.fix_all_csvs()
proc.split_all_csvs()
proc.build_database(db_path="./GeoRoc.db")

Data Sources

GEOROC provides 14 precompiled dataset categories:

Category DOI
Archaean Cratons 10.25625/1KRR1P
Complex Volcanic Settings 10.25625/1VOFM5
Continental Flood Basalts 10.25625/WSTPOX
Convergent Margins 10.25625/PVFZCE
Intraplate Volcanic Rocks 10.25625/RZZ9VM
Oceanic Plateaus 10.25625/JRZIJF
Ocean Basin Flood Basalts 10.25625/AVLFC2
Ocean Island Groups 10.25625/WFJZKY
Seamounts 10.25625/JUQK7N
Rift Volcanics 10.25625/KAIVCT
Rocks 10.25625/2JETOA
Minerals 10.25625/SGFTFN
Melt Inclusions 10.25625/7JW6XU
Sample Metadata 10.25625/4EZ7ID

License

GPLv3+

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

georocdata-0.1.0.tar.gz (22.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

georocdata-0.1.0-py3-none-any.whl (22.1 kB view details)

Uploaded Python 3

File details

Details for the file georocdata-0.1.0.tar.gz.

File metadata

  • Download URL: georocdata-0.1.0.tar.gz
  • Upload date:
  • Size: 22.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.12

File hashes

Hashes for georocdata-0.1.0.tar.gz
Algorithm Hash digest
SHA256 94ea4889f757ccecf470d4010f0374a24a5a05d573173ae5c4cc2057816defe5
MD5 5c82dd71d8032803645326b6f73f92f0
BLAKE2b-256 e7d4b670bac9ff0210d7dbc0f1a2b5fab8d9d5062fe1abb45756bc6a37cc127e

See more details on using hashes here.

File details

Details for the file georocdata-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: georocdata-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 22.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.12

File hashes

Hashes for georocdata-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ec89961b2800c366822ecce768d475d83bc2a529d8725371ec121217663cbfcb
MD5 0ed621d02282a9a59a01409f27d66593
BLAKE2b-256 32ee2ba6a25c4cb3a2c585ef1d85597ff5e2e819548012c48b9299f7099256b5

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page