Skip to main content

Read data from ucn history table

Project description

ucnhistory

Fetch UCN history measurements from SQL database on daq01.ucn.triumf.ca as a pandas DataFrame. Allows for user-friendly timestamp input and write table to csv.

Quick Links:

Installation and Setup

Clone and install by the following

git clone https://github.com/ucn-triumf/ucnhistory.git
cd ucnhistory
pip install .

which will install the files on the user's python path. One can then import the package from anywhere on the device.

Database access

Note that access to the database requires the use of a password. This password should be stored in the python keyring in the following way:

import keyring
keyring.set_password("ucn_history", "ucn_reader", password)

The password should be obtained from someone within the group. Some issues with the keyring may exist for WSL usage. You may need to run the following before trying to set the password:

pip install keyrings.alt

SSH access

Access to the DAQ computer is provided by mean of an SSH tunnel. First ensure that you have an ssh key present. If you run the command:

ls ~/.ssh

it should return a list of files, which should include something like id_rsa or id_dsa or similar. If file like this does not exist run the command

ssh-keygen

and follow the prompts (leave the password blank). Once you are certain you have an ssh public key you should copy it to daq01 for password-less access to the machine.

ssh-copy-id ucn@daq01.ucn.triumf.ca

Documentation and Examples

See here for reference

Command line usage:

Help message:

usage: ucnhistory [-h] [-t TABLE] [-s START] [-e END] [-o OUTPUT] [-lt] [-lc] [-c COLUMN]

Fetch tables from ucn history SQL database to csv file

options:
  -h, --help            show this help message and exit
  -t TABLE, --table TABLE
                        Name of table from which to fetch
  -s START, --start START
                        Specify range start date and time
  -e END, --end END     Specify range end date and time
  -o OUTPUT, --output OUTPUT
                        Specify name of output csv file
  -lt, --list_tables    Display tables in database
  -lc, --list_columns   Display columns in database table (must specify table)
  -c COLUMN, --column COLUMN
                        Fetch column from table, use multiple times to get multiple columns. If
                        absent, fetch all columns

Some example usage:

# fetch an table from the past 24h nd save with default filename
ucnhistory -t ucn2epics_measured

# list all available tables
ucnhistory -lt

# list all columns in a table
ucnhistory -lc -t ucn2epics_measured

# get one table for a specified time period
ucnhistory -t ucn2epics_measured -s 'June 6 2024 12pm' -e 'June 6 2024 1pm'

Python Example

The easiest thing is to use the search_data function:

from ucnhistory import ucnhistory

# initialize the object
h = ucnhistory()

# lets load some level probe data and a temperature
# command is case-insensitive

# default is to fetch past 24H
df = h.search_data(['TS112', 'lvl204', 'LvL203'])

# now lets fetch from a specific date range
# insensitive to specifics of the date and time formats
df = h.search_data(['TS112', 'lvl204', 'LvL203'],
                   start = 'Mar 5, 1pm 2025',
                   stop = '2025/03/05 14:00'
)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ucnhistory-0.4.1.tar.gz (32.6 kB view details)

Uploaded Source

File details

Details for the file ucnhistory-0.4.1.tar.gz.

File metadata

  • Download URL: ucnhistory-0.4.1.tar.gz
  • Upload date:
  • Size: 32.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for ucnhistory-0.4.1.tar.gz
Algorithm Hash digest
SHA256 de76d3929251ade1773af3cdc755b89c59117bd250ebdef49f23e7d7b2fd9d39
MD5 0c14f36e881277dff0307371ac192ba8
BLAKE2b-256 019518084f9f7cc6e59cca899235a89fe5295917d48c87932a5cf109b66177c6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page