Skip to main content

Read data from ucn history table

Project description

ucnhistory

Fetch UCN history measurements from SQL database on daq01.ucn.triumf.ca as a pandas DataFrame. Allows for user-friendly timestamp input and write table to csv.

Quick Links:

Installation and Setup

Clone and install by the following

git clone https://github.com/ucn-triumf/ucnhistory.git
cd ucnhistory
pip install .

which will install the files on the user's python path. One can then import the package from anywhere on the device.

Database access

Note that access to the database requires the use of a password. This password should be stored in the python keyring in the following way:

import keyring
keyring.set_password("ucn_history", "ucn_reader", password)

The password should be obtained from someone within the group. Some issues with the keyring may exist for WSL usage. You may need to run the following before trying to set the password:

pip install keyrings.alt

SSH access

Access to the DAQ computer is provided by mean of an SSH tunnel. First ensure that you have an ssh key present. If you run the command:

ls ~/.ssh

it should return a list of files, which should include something like id_rsa or id_dsa or similar. If file like this does not exist run the command

ssh-keygen

and follow the prompts (leave the password blank). Once you are certain you have an ssh public key you should copy it to daq01 for password-less access to the machine.

ssh-copy-id ucn@daq01.ucn.triumf.ca

Documentation and Examples

See here for reference

Command line usage:

Help message:

usage: ucnhistory [-h] [-t TABLE] [-s START] [-e END] [-o OUTPUT] [-lt] [-lc] [-c COLUMN]

Fetch tables from ucn history SQL database to csv file

options:
  -h, --help            show this help message and exit
  -t TABLE, --table TABLE
                        Name of table from which to fetch
  -s START, --start START
                        Specify range start date and time
  -e END, --end END     Specify range end date and time
  -o OUTPUT, --output OUTPUT
                        Specify name of output csv file
  -lt, --list_tables    Display tables in database
  -lc, --list_columns   Display columns in database table (must specify table)
  -c COLUMN, --column COLUMN
                        Fetch column from table, use multiple times to get multiple columns. If
                        absent, fetch all columns

Some example usage:

# fetch an table from the past 24h nd save with default filename
ucnhistory -t ucn2epics_measured

# list all available tables
ucnhistory -lt

# list all columns in a table
ucnhistory -lc -t ucn2epics_measured

# get one table for a specified time period
ucnhistory -t ucn2epics_measured -s 'June 6 2024 12pm' -e 'June 6 2024 1pm'

Python Example

The easiest thing is to use the search_data function:

from ucnhistory import ucnhistory

# initialize the object
h = ucnhistory()

# lets load some level probe data and a temperature
# command is case-insensitive

# default is to fetch past 24H
df = h.search_data(['TS112', 'lvl204', 'LvL203'])

# now lets fetch from a specific date range
# insensitive to specifics of the date and time formats
df = h.search_data(['TS112', 'lvl204', 'LvL203'],
                   start = 'Mar 5, 1pm 2025',
                   stop = '2025/03/05 14:00'
)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ucnhistory-0.4.2.tar.gz (32.7 kB view details)

Uploaded Source

File details

Details for the file ucnhistory-0.4.2.tar.gz.

File metadata

  • Download URL: ucnhistory-0.4.2.tar.gz
  • Upload date:
  • Size: 32.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for ucnhistory-0.4.2.tar.gz
Algorithm Hash digest
SHA256 6bf3772cde6369154d047ea55f72d761af5d7c58c9585379c67f69e9d497889f
MD5 f095fdf606b453b325bdb5d74e20d006
BLAKE2b-256 ec7c06b4f9aeed4612071bca323012fbc9bb568cdcd56a7f5870e7d67e8ad10c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page