Python API to extract JSON data from S&P Global Petra projects
Project description
purr_petra
PETRA |
---|
Use purr_petra to locate and query any Petra project* with minimal setup via a simple Python API. It's the missing middleware API for taming an unruly geoscience data environment.
-
Dynamic discovery and query of projects (even lost, unshared)
-
Simple Python API
-
No license checkouts
-
Well-centric exports to JSON:
- core
- dst
- formation
- ip
- perforation
- production
- raster_log
- survey
- vector_log
- well
- zone
- Each Petra "project" is a semi-structured collection of E&P assets that interoperate with its own DBISAM database. From an IT perspective, Petra is a distributed collection of user-managed databases "on the network" containing millions of assets.
QUICKSTART
pip install purr_petra
- launch console "as Administrator" and run
prep-purr-petra
start-purr-petra
- visit
http://localhost:8070/docs
for auto-generated docs
DETAILED INSTALL/CONFIG
install
Using Python >3.10... (and it should go without saying, this is a Windows-only package)
(optional) Define a virtual environment (venv), then:
pip install purr_petra
or
poetry add purr_petra
prepare
You'll need a DBISAM v4 ODBC driver. A bare-bones, 64-bit only install of v4.48 is provided here for evaluation, but you should probably get the real thing from Elevate Softare.
Repo metadata collection uses the DU Disk Usage utility for performance. The following script will register the DU utility and tacitly accept its terms of use.
Register the driver and du using these steps:
- launch an admin console (right-click Command Prompt | Run as administrator)
- cd to the install location, activate your virtual environment
prep-purr-petra
- close the admin console
configure
You can optionally define environment variables to modify some API behaviors. If the PC isn't running other services you probably don't have to define/change any of these:
variable | default | description |
---|---|---|
PURR_PETRA_PORT | 8070 | TCP port number used by the API |
PURR_PETRA_HOST | 0.0.0.0 | the default "localhost" |
PURR_PETRA_WORKERS | 4 | can increase if CPU supports it |
PURR_LOG_LEVEL | INFO | options: CRITICAL, ERROR, WARNING, INFO, DEBUG |
Some other files get written to your install location:
- SQLite database:
purr_petra.sqlite
- log file:
purr_petra.log
launch
Launch the API via its preinstalled script
- cd to the install location (a non-admin console is fine)
start-purr-petra
The first time you launch the API, Windows Firewall may whine about Python. Enable "Private networks" and Allow Access:
purr_petra uses FastAPI. You can test-drive your local API at either:
http://localhost:8070/docs
or
http://localhost:8070/doc
USAGE
1. Do a POST /purr/petra/repos/recon
with a network path and hostname
The path can be a top-level container of projects or just a project itself. NOTE: We use the term repo and project interchangeably
or
curl -X 'POST' \
'http://localhost:8000/purr/petra/repos/recon?recon_root=d%3A%5Cpetra' \
-H 'accept: application/json' \
-d ''
(Replace single quotes with double-quote for Windows)
This might take a few minutes, so you get a 202 Reponse
containing a task id
and task_status:
{
"id": "4792ff33-fe6d-4938-bb95-4257b99f6ec0",
"recon_root": "D:\\petra",
"task_status": "pending"
}
Metadata for each repo is stored in a local (sqlite) database.
2. Use the task id to check status with a GET to /purr/petra/repos/recon/{task_id}
{
"id": "4792ff33-fe6d-4938-bb95-4257b99f6ec0",
"recon_root": "D:\\petra",
"task_status": "completed"
}
Possible status values are: pending
, in_progress
, completed
, or failed
.
3. Use the repo_id
to query asset data in a repo. Add a UWI filter to search for specific well identifiers.
This can also be time-consuming, so it returns a 202 Response
with a task id and the
pending export file.
{
"id": "0c2fdd2e-70b4-4eb3-8e59-dcfa8983b70d",
"task_status": "pending",
"task_message": "export file (pending): fre_e5215f_1727127449_survey.json"
}
4. Check asset export with a GET to /purr/petra/asset/{repo_id}/{asset}
Like repo/recon
, this returns a tast_status and task_message containing
exported file info.
{
"id": "0c2fdd2e-70b4-4eb3-8e59-dcfa8983b70d",
"task_status": "completed",
"task_message": {
"message": "json docs written: 1",
"out_file": "c:\\temp\\fre_e5215f_1727127449_survey.json"
}
}
All asset data is exported as a "flattened" JSON representation of the original relational model. Here's a survey example.
FUTURE
Let me know whatever you might want to see in a future release. Some ideas are:
- Better query logic: match terms with
AND
instead ofSIMILAR TO
(OR
) - Structured ASCII (Petra PPF or GeoGraphix ASCII3) exports instead of JSON
- Full Text Search
- Datum-shift and standardize on EPSG:4326 for polygon hull points
- Auto-sync with your PPDM or OSDU store?
- Standardize a multi-project interface with Spotfire
LICENSE
MIT License
Copyright (c) 2024 Bryan Hughes
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
DBISAM License
Clients of S&P Global's PETRA Software are assumed to have accepted Elevate
Software's License Agreement(s) for DBISAM under whatever terms set forth by
GeoPLUS, IHS and/or S&P Global. Use of **purr_petra** does not supersede those
agreements.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for purr_petra-0.1.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5862131b13a0cc451aad4b59bc11484f67ffcbfc7eb287f746fe89164cf9500a |
|
MD5 | 38c885b6037a5f539e215e6bd45c9e84 |
|
BLAKE2b-256 | b74e0d7618832d69959668dba3caa12d65d2e73d8ad48b7efff6c9acf17b8b86 |