Skip to main content

Utilities for finding and reformatting FlySight 2 CSV files (SENSOR.CSV and TRACK.CSV).

Project description

flysight2csv

CI Status Documentation Status Test coverage percentage

Poetry black pre-commit

PyPI Version Supported Python versions License


Documentation: https://flysight2csv.readthedocs.io

Source Code: https://github.com/yoleg/flysight2csv


Utilities for finding and reformatting FlySight 2 CSV files (SENSOR.CSV and TRACK.CSV).

💡 This is an early release. Please let me know how you use this tool and what features you would like to see.

Features

Functionality:

  • Find all the FlySight 2 CSV files in one or more directories or possible file paths.
  • View metadata (vars, sensors, columns, units, and first row) for each CSV file.
  • Copy matching files to a single directory, prepending the parent directory names to the filename.
  • Reformat the CSV files for easier use with other tools, such as Pandas dataframes.
    • Calculates ISO timestamps for non-GPS sensors from $TIME field values, if available.
    • Available formats:
      • Flat CSV (single header row)
      • JSON lines (one JSON object per line)
    • Available filters:
      • Select only the columns you need.
      • Select only the sensors you need.
  • Merge the reformatted files from each directory into an additional MERGED.csv (or .jsonl) file, sorted by timestamp.

Compatibility:

  • Works with Python 3.10+
  • Tested on Windows, Mac, and Linux
  • May be used as a Python library or command-line tool

Possible future features

Let me know if you would like to see any of these added.

  • Filter the CSV files by date/time, altitude, or other criteria.
  • Show a summary of date ranges and altitudes for the discovered CSV files.
  • Add units to the flattened CSV files.
  • FlySight 1 output format.
  • Trim the CSV files to just the descent or ascent portion of a flight.
  • Installers for Windows, Mac, and Linux.
  • Simple graphical user interface (GUI) for selecting options and running the command.

Installation

The package is published on PyPI and can be installed with pip (or any equivalent):

pip install flysight2csv

For complete installation instructions, see the documentation.

Usage

Please note that this is an early release, and the API may change in future versions.

Preview the files to be processed:

flysight2csv source/files/or/directories/
flysight2csv source/files/or/directories/ --info=metadata

Copy just the TRACK.CSV files (unchanged) to a single directory, prepending the date and time to the filename:

flysight2csv source/files/or/directories/ -o output/path/ '--glob=**/TRACK.CSV'

Reformat all the FlySight 2 CSVs into a "flat" CSV (single header) for use with other tools:

flysight2csv source/files/or/directories/ -o output/path/ -f csv-flat

For more options, see the help:

flysight2csv --help

Troubleshooting

See the troubleshooting section of the documentation.

Contributors ✨

Contributions of any kind welcome! Please see the contributing guide.

Credits

This package was created with Copier and the browniebroke/pypackage-template project template.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flysight2csv-0.2.3.tar.gz (24.2 kB view details)

Uploaded Source

Built Distribution

flysight2csv-0.2.3-py3-none-any.whl (24.5 kB view details)

Uploaded Python 3

File details

Details for the file flysight2csv-0.2.3.tar.gz.

File metadata

  • Download URL: flysight2csv-0.2.3.tar.gz
  • Upload date:
  • Size: 24.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/4.0.2 CPython/3.11.7

File hashes

Hashes for flysight2csv-0.2.3.tar.gz
Algorithm Hash digest
SHA256 abdf447e490124ce202c0f6eaa390217076c65a1d7008eeb557fa0b797c2fa5d
MD5 2bdaee2eee59e28c7f1521f87055b479
BLAKE2b-256 b8261dcc8c5878a6328564d8fb4aae450080c64a344b8b225db24169db49dec5

See more details on using hashes here.

File details

Details for the file flysight2csv-0.2.3-py3-none-any.whl.

File metadata

  • Download URL: flysight2csv-0.2.3-py3-none-any.whl
  • Upload date:
  • Size: 24.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/4.0.2 CPython/3.11.7

File hashes

Hashes for flysight2csv-0.2.3-py3-none-any.whl
Algorithm Hash digest
SHA256 3b694dc40a6e623a4542ab107885ec235bee4cc5ca72db807ebeec6ce51701e2
MD5 e50c63405a1e975aa47ae87e975ccb55
BLAKE2b-256 f926dab3ee0d2a2cc1334810f41384f752cdf1df5df2bb310062eaf532b51910

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page