Skip to main content

A CSV data storage and management engine.

Project description

Syphon

A CSV data storage and management engine.

build codecov CodeFactor PyPI PyPI - License

Checked with mypy Code style: black

Keithley

Syphon is a Python package that provides a simple interface to perform common tasks on labelled data. Its aim is to fit seamlessly into any automation pipeline that requires organization and collation of large datasets.

Features

  • Archive file(s) into a data storage directory.
    • Automatic archive organization based on the value of a data column (if a .schema.json file is present).
    • Quickly append new archive files onto a previously built data file.
  • Build a single data file from the contents of the archive directory.
  • Initialize new archive directories by creating a storage schema (.schema.json) file.

Basic Usage

Initialize an archive directory:

python -m syphon init ./storage/folder some_column_header "another column header"

Archive one or more files with direct paths, wildcard patterns, or a combination of both:

python -m syphon archive /path/to/data.csv ./storage/folder

python -m syphon archive /path/to/data.csv /path/to/more/*.csv ./storage/folder

Build a single data file from an archive directory:

python -m syphon build ./storage/folder all_data.csv

Archive additional data and append it to a previously built data file:

python -m syphon archive /path/to/still/more/*.csv ./storage/folder -i all_data.csv

General command line documentation and subcommand documentation can be accessed via

 python -m syphon --help

 python -m syphon SUBCOMMAND --help

Contribute

See a typo? Know how to fix an issue? Implement a requested feature?

We'd love to accept your patches and contributions! The Contributing document guides you through checkout, unit testing, and building.

Maintainer

Disclaimer

This is not an officially supported Tektronix product. It is maintained by a small group of employees in their spare time. We lack the resources typical of most Tektronix products, so please bear with us! We will do our best to address your issues and answer any questions directly related to this extension in a timely manner.

License

Copyright Keithley Instruments, LLC. All rights reserved.

Licensed under the MIT License.


Made with ❤ at Keithley Instruments

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

syphon-2.0.1.tar.gz (55.6 kB view details)

Uploaded Source

Built Distribution

syphon-2.0.1-py3-none-any.whl (57.2 kB view details)

Uploaded Python 3

File details

Details for the file syphon-2.0.1.tar.gz.

File metadata

  • Download URL: syphon-2.0.1.tar.gz
  • Upload date:
  • Size: 55.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.50.0 CPython/3.7.1

File hashes

Hashes for syphon-2.0.1.tar.gz
Algorithm Hash digest
SHA256 e412fa23e003bd78f56f1e9a60e89b1f40451016d7d43d0f2632a9fe2c3101f5
MD5 194ecebd872000697151842ddbec8640
BLAKE2b-256 fff1dc4296fb3711f519106633e4f00639502804e3dabc4b9a629e69ab8f845e

See more details on using hashes here.

File details

Details for the file syphon-2.0.1-py3-none-any.whl.

File metadata

  • Download URL: syphon-2.0.1-py3-none-any.whl
  • Upload date:
  • Size: 57.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.50.0 CPython/3.7.1

File hashes

Hashes for syphon-2.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 7e582b6e7eddf9c1bba04562e9d103eb5de7dad0768c4aa84f8ac3e2b2113677
MD5 58ca26591a2587d7b041cdc48aee2c2e
BLAKE2b-256 3402061a0190dd5cf46531a28a0db4c5c0a67aa6b4938f9efea6ef70e9915deb

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page