pygeochemtools

A CLI based eclectic set of geochemical data manipulation, QC and plotting tools.

Pygeochemtools is a python library and command line interface tool to enable rapid manipulation, filtering, QC and plotting of geochemical data. It is primarily designed to allow people with limited or no coding experience to deal with very large datasets when programs like Excel will struggle. It is designed to natively load and manipulate the geochemical datasets output by the Geological Survey of South Australia, but will easily handle other datasets with a little bit of configuration in later updates.

Why pygeochemtools

The SA Geodata database (available via the SARIG portal) contains over 10 Gb of geochemical data. That’s a lot of chemistry. Explorers often request extracts of this data set, but then find it a challenge to handle all that data. Because of the size and amount of data, programs like Excel wont even open the file, and if the extract is small enough to open, explorers often find the format of the data a challenge. Generally, people like to use wide data for analysis, where each row in a table represents all the data about a single sample. But database exports are in a long format where each row represents a single data point.

Pygeochemtools provides an abstraction and cli to make loading, filtering and restructuring this data easy. It uses python libraries like dask and pandas under the hood to be able to deal with 'larger than memory' datasets, so you can load and filter those large datasets and then output something more easy to handle with Excel or other tools.

Functionality

Currently pygeochemtools provides the following functionality:

• Filter large datasets based on a list of elements, sample type or drillhole numbers (or a combination of all three) and convert from long to wide format.
• Add detailed geochemical methods columns onto the SARIG geochemical dataset.
• Extract single element datasets from large geochemical datasets.
• Plot maximum down hole geochemical data maps.
• Plot maximum down hole chemistry per interval geochemical data maps.