hydws-client 1.2.0

Python client library for the HYDWS web service

HYDWS Client

Hydraulic Web Service Client This client can be used to access the data from a Hydraulic Webservice more comfortably.

Installation

Currently the package needs to be installed via the github repository:

pip install git+https://gitlab.seismo.ethz.ch/indu/hydws-client.git

Usage

Imports

from datetime import datetime

from hydws.client import HYDWSDataSource
from hydws.parser import BoreholeHydraulics, SectionHydraulics

TLDR; How to get the data?

hydws_url = 'http://scforge.ethz.ch:8081/hydws/v1'
hydws = HYDWSDataSource(hydws_url)

Assuming you know exactly what you want, you can use the following methods to get the data you need.

Throughout, you can usually use the name and the id interchangeably.

Let's assume we have the borehole id, and the section name.

borehole_id = 'caf65646-8093-4aaf-989c-1c837f497667'
section_name = '16A-32/section_03'
hydraulics_start = datetime(2024, 4, 6, 1, 0, 0)
hydraulics_end = datetime(2024, 4, 6, 1, 1, 0)

The fastest way to get to the data, without caring about any metadata:

hydraulics = hydws.get_section_hydraulics(borehole_id, section_name, hydraulics_start, hydraulics_end, format='pandas')
hydraulics

	topflow	toppressure
datetime
2024-04-06 01:00:00	0.212990	4.710498e+07
2024-04-06 01:00:01	0.212990	4.719461e+07
2024-04-06 01:00:02	0.212990	4.721530e+07
2024-04-06 01:00:03	0.212831	4.716703e+07
2024-04-06 01:00:04	0.212646	4.714635e+07
...	...	...
2024-04-06 01:00:56	0.213653	4.716703e+07
2024-04-06 01:00:57	0.213308	4.717393e+07
2024-04-06 01:00:58	0.213308	4.710498e+07
2024-04-06 01:00:59	0.213308	4.714635e+07
2024-04-06 01:01:00	0.213494	4.716014e+07

61 rows × 2 columns

Boreholes and Sections

Otherwise, if you want the metadata, or need to parse a file containing hydws, or prefer an object with the borehole and/or section structure, you can use the hydws client together with BoreholeHydraulics and SectionHydraulics classes:

If you just want to consider one Section, it's easiest to directly use the SectionHydraulics class:

section_json = hydws.get_section(borehole_id, section_name, hydraulics_start, hydraulics_end)
section = SectionHydraulics(section_json)

section.metadata # to access the metadata of the section
section.hydraulics # to access the hydraulic data as a dataframe

	topflow	toppressure
datetime
2024-04-06 01:00:00	0.212990	4.710498e+07
2024-04-06 01:00:01	0.212990	4.719461e+07
2024-04-06 01:00:02	0.212990	4.721530e+07
2024-04-06 01:00:03	0.212831	4.716703e+07
2024-04-06 01:00:04	0.212646	4.714635e+07
...	...	...
2024-04-06 01:00:56	0.213653	4.716703e+07
2024-04-06 01:00:57	0.213308	4.717393e+07
2024-04-06 01:00:58	0.213308	4.710498e+07
2024-04-06 01:00:59	0.213308	4.714635e+07
2024-04-06 01:01:00	0.213494	4.716014e+07

61 rows × 2 columns

If you prefer to directly get all the metadata and hydraulic data of a Borehole for a given time, use the following methods:

# Get Borehole, containing all of its sections and their hydraulic data for the given time range
borehole_json = hydws.get_borehole(borehole_id, hydraulics_start, hydraulics_end)
borehole = BoreholeHydraulics(borehole_json)

borehole.metadata # to access the metadata of the borehole

{'publicid': 'caf65646-8093-4aaf-989c-1c837f497667',
 'description': 'Well 16A-32',
 'name': '16A-32',
 'location': 'FORGE',
 'institution': 'FORGE Utah',
 'measureddepth': {'value': 3339.1},
 'bedrockaltitude': {'value': 0.0},
 'altitude': {'value': 1650.02},
 'latitude': {'value': -112.906857},
 'longitude': {'value': 38.506874},
 'creationinfo': {'creationtime': '2024-04-01T22:40:47.911589'}}

Accessing the sections inside a borehole, can be done using the publicid as a dict key, or by using the section name and the nloc attribute:

section_id = '37801a57-90b9-4fb5-83d7-506ee9166acf'

section = borehole[section_id] # use the section id as a key to access the section
section = borehole.nloc[section_name] # use the section name as a key to access the section
section.hydraulics

<style scoped> .dataframe tbody tr th:only-of-type { vertical-align: middle; }

.dataframe tbody tr th {
    vertical-align: top;
}

.dataframe thead th {
    text-align: right;
}

</style>

	topflow	toppressure
datetime
2024-04-06 01:00:00	0.212990	4.710498e+07
2024-04-06 01:00:01	0.212990	4.719461e+07
2024-04-06 01:00:02	0.212990	4.721530e+07
2024-04-06 01:00:03	0.212831	4.716703e+07
2024-04-06 01:00:04	0.212646	4.714635e+07
...	...	...
2024-04-06 01:00:56	0.213653	4.716703e+07
2024-04-06 01:00:57	0.213308	4.717393e+07
2024-04-06 01:00:58	0.213308	4.710498e+07
2024-04-06 01:00:59	0.213308	4.714635e+07
2024-04-06 01:01:00	0.213494	4.716014e+07

61 rows × 2 columns

Navigating Boreholes, Sections and Metadata

If you don't exactly know which names or publicids there are, you can use the following methods to display the available boreholes and sections.

borehole_metadata_all = hydws.list_boreholes() # returns all metadata
borehole_names = hydws.list_borehole_names() # only returns name, publicid or both (default is name)
borehole_names

['16A-32', '16B-32']

The first column is the name of the borehole, the second one its public ID. It's generally possible to use either of the two for all of the following functions. The same applies to the section names and their IDs.

section_metadata_all = hydws.list_sections(borehole_names[0]) # returns all metadata
section_names = hydws.list_section_names(borehole_names[0]) # only returns name, publicid or both (default is name)
section_names

['16A-32/section_01', '16A-32/section_02', '16A-32/section_03']

It is also possible to use theget_borehole_metadata or the get_section_metadata functions to get the metadata of a specific borehole or section.

borehole_metadata = hydws.get_borehole_metadata(borehole_names[0])
section_metadata = hydws.get_section_metadata(borehole_names[0], section_names[0])
section_metadata

{'publicid': '8eb6ce9a-247d-4675-8647-880841bb9531',
 'starttime': '2022-04-17T02:35:57',
 'endtime': '2022-04-17T05:50:13',
 'topclosed': True,
 'bottomclosed': True,
 'description': '200 ft long open hole section at the toe of the well',
 'name': '16A-32/section_01',
 'hydraulics': [],
 'casingdiameter': {},
 'holediameter': {},
 'bottommeasureddepth': {'value': 3339.09},
 'topmeasureddepth': {'value': 3278.13},
 'bottomaltitude': {'value': -958.71},
 'bottomlatitude': {'value': 38.504462},
 'bottomlongitude': {'value': -112.893086},
 'topaltitude': {'value': -936.3276802186539},
 'toplatitude': {'value': 38.50454148787154},
 'toplongitude': {'value': -112.89372764195421}}