A CSV data storage and management engine.
Project description
Syphon
A CSV data storage and management engine.
Syphon is a Python package that provides a simple interface to perform common tasks on labelled data. Its aim is to fit seamlessly into any automation pipeline that requires organization and collation of large datasets.
Features
- Archive file(s) into a data storage directory.
- Automatic archive organization based on the value of a data column (if a
.schema.json
file is present). - Quickly append new archive files onto a previously built data file.
- Automatic archive organization based on the value of a data column (if a
- Build a single data file from the contents of the archive directory.
- Initialize new archive directories by creating a storage schema (
.schema.json
) file.
Basic Usage
Initialize an archive directory:
python -m syphon init ./storage/folder some_column_header "another column header"
Archive one or more files with direct paths, wildcard patterns, or a combination of both:
python -m syphon archive /path/to/data.csv ./storage/folder
python -m syphon archive /path/to/data.csv /path/to/more/*.csv ./storage/folder
Build a single data file from an archive directory:
python -m syphon build ./storage/folder all_data.csv
Archive additional data and append it to a previously built data file:
python -m syphon archive /path/to/still/more/*.csv ./storage/folder -i all_data.csv
General command line documentation and subcommand documentation can be accessed via
python -m syphon --help
python -m syphon SUBCOMMAND --help
Contribute
See a typo? Know how to fix an issue? Implement a requested feature?
We'd love to accept your patches and contributions! The Contributing document guides you through checkout, unit testing, and building.
Maintainer
Disclaimer
This is not an officially supported Tektronix product. It is maintained by a small group of employees in their spare time. We lack the resources typical of most Tektronix products, so please bear with us! We will do our best to address your issues and answer any questions directly related to this extension in a timely manner.
License
Copyright Keithley Instruments, LLC. All rights reserved.
Licensed under the MIT License.
Made with ❤ at Keithley Instruments
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file syphon-2.0.1.tar.gz
.
File metadata
- Download URL: syphon-2.0.1.tar.gz
- Upload date:
- Size: 55.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.50.0 CPython/3.7.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | e412fa23e003bd78f56f1e9a60e89b1f40451016d7d43d0f2632a9fe2c3101f5 |
|
MD5 | 194ecebd872000697151842ddbec8640 |
|
BLAKE2b-256 | fff1dc4296fb3711f519106633e4f00639502804e3dabc4b9a629e69ab8f845e |
File details
Details for the file syphon-2.0.1-py3-none-any.whl
.
File metadata
- Download URL: syphon-2.0.1-py3-none-any.whl
- Upload date:
- Size: 57.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.50.0 CPython/3.7.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7e582b6e7eddf9c1bba04562e9d103eb5de7dad0768c4aa84f8ac3e2b2113677 |
|
MD5 | 58ca26591a2587d7b041cdc48aee2c2e |
|
BLAKE2b-256 | 3402061a0190dd5cf46531a28a0db4c5c0a67aa6b4938f9efea6ef70e9915deb |