Skip to main content

Package for GERG to ingest raw glider data into NetCDF files

Project description


Logo

GERG Glider Ingest

Convert raw data from GERG gliders into netcdf using python
Explore the docs »

Report Bug · Request Feature

Table of Contents
  1. About The Project
  2. Getting Started
  3. Usage
  4. Contributing
  5. License
  6. Contact
  7. Acknowledgments

About The Project

This project was created to streamline the process of converting the raw data from the gliders after missions into NetCDF files, as well as ensuring the code can be easily maintained, understood, and used by others.

Built With

Python

Getting Started

There are three ways to get started

  1. Create a fresh virtual environment using your favorite method and install the dependencies
  2. Use an already established virtual environment and install the dependencies

Dependencies

I have provided some commands to install the dependencies using conda but you can use any package manager

  1. Creating your own virtual environment then installing dependencies

    You can change "glider_ingest" to your desired environment name

    conda create -n glider_ingest python=3.12
    
    conda activate glider_ingest
    
    pip install numpy pandas xarray gsw attrs
    
  2. Using an already established virtual environment

    conda activate your_env
    
    pip install numpy pandas xarray gsw attrs
    

Installation

  1. Activate your virtual environment
  2. Verify/Install Dependencies
  3. Clone the repo
    git clone https://github.com/alecmkrueger/glider-ingest.git
    

Usage

Process raw data from gliders using python.

Function inputs:

  • raw_data_source (Path|str): Raw data source, from the glider SD card
  • working_directory (Path|str): Where you want the raw copy and processed data to be
  • glider_number (str): The number of the glider, for NetCDF metadata
  • mission_title (str): The mission title, for NetCDF metadata
  • extensions (list): The extensions you wish to process
  • output_nc_filename (str): The name of the output NetCDF file
  • return_ds (bool): If you would like the output dataset to be returned. Default = False

Example:

from pathlib import Path

from glider_ingest import MissionData, MissionProcessor

memory_card_copy_loc = Path('path/to/memory/card/copy')
# Where you want the netcdf to be saved to
working_dir = Path('path/to/working/dir').resolve()
mission_num = '46'

# Initalize the mission_data container
mission_data = MissionData(memory_card_copy_loc=memory_card_copy_loc,
                         working_dir=working_dir,
                         mission_num=mission_num)
# Pass the mission_data container to the MissionProcessor class
# call save_mission_dataset to generate and save the mission dataset
MissionProcessor(mission_data=mission_data).save_mission_dataset()

Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement".

  1. Fork the Project
  2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
  3. Commit your Changes (git commit -m 'Add some AmazingFeature')
  4. Push to the Branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

License

Distributed under the MIT License. See LICENSE for more information.

Contact

Alec Krueger - alecmkrueger@tamu.edu

Project Link: https://github.com/alecmkrueger/glider-ingest

Acknowledgments

  • Sakib Mahmud, Texas A&M University, Geochemical and Environmental Research Group, sakib@tamu.edu
  • Xiao Ge, Texas A&M University, Geochemical and Environmental Research Group, gexiao@tamu.edu
  • Alec Krueger, Texas A&M University, Geochemical and Environmental Research Group, alecmkrueger@tamu.edu

(back to top)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

glider_ingest-1.1.18.tar.gz (22.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

glider_ingest-1.1.18-py3-none-any.whl (24.2 kB view details)

Uploaded Python 3

File details

Details for the file glider_ingest-1.1.18.tar.gz.

File metadata

  • Download URL: glider_ingest-1.1.18.tar.gz
  • Upload date:
  • Size: 22.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.0.1 CPython/3.12.8 Windows/11

File hashes

Hashes for glider_ingest-1.1.18.tar.gz
Algorithm Hash digest
SHA256 3d3ff5592c6a44e4e72ff7d24afa6c56363a3a285510f763e110ea5bbc180003
MD5 b37a2663f45bc8517467a48f8aa3cf52
BLAKE2b-256 19d081fd226dc4b3cef724e429deb887718f2fca5792beccf1105663db32b9c0

See more details on using hashes here.

File details

Details for the file glider_ingest-1.1.18-py3-none-any.whl.

File metadata

  • Download URL: glider_ingest-1.1.18-py3-none-any.whl
  • Upload date:
  • Size: 24.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.0.1 CPython/3.12.8 Windows/11

File hashes

Hashes for glider_ingest-1.1.18-py3-none-any.whl
Algorithm Hash digest
SHA256 38cee61f088bd89f811ba031799a9734a5ce1c15fbab191443a7862f45a182fa
MD5 47d2ce20de82135c9f673604b8a09695
BLAKE2b-256 81b322c9a956b48ab6cdfb82ec65fdfb6f57cfdf8c26a36dc02cd4a05998677b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page