Skip to main content

Neuroscience data analysis framework for reproducible research

Project description

spyglass

Tests PyPI version

Spyglass Figure

Demo | Installation | Docs | Tutorials | Citation

spyglass is a data analysis framework that facilitates the storage, analysis, visualization, and sharing of neuroscience data to support reproducible research. It is designed to be interoperable with the NWB format and integrates open-source tools into a coherent framework.

Try out a demo here!

Features of Spyglass include:

  • Standardized data storage - Spyglass uses the open-source Neurodata Without Borders: Neurophysiology (NWB:N) format to ingest and store processed data. NWB:N is a standard set by the BRAIN Initiative for neurophysiological data (Rübel et al., 2022).
  • Reproducible analysis - Spyglass uses DataJoint to ensure that all analysis is reproducible. DataJoint is a data management system that automatically tracks dependencies between data and analysis code. This ensures that all analysis is reproducible and that the results are automatically updated when the data or analysis code changes.
  • Common analysis tools - Spyglass provides easy usage of the open-source packages SpikeInterface, Ghostipy, and DeepLabCut for common analysis tasks. These packages are well-documented and have active developer communities.
  • Interactive data visualization - Spyglass uses figurl to create interactive data visualizations that can be shared with collaborators and the broader community. These visualizations are hosted on the web and can be viewed in any modern web browser. The interactivity allows users to explore the data and analysis results in detail.
  • Sharing results - Spyglass enables sharing of data and analysis results via Kachery, a decentralized content addressable data sharing platform. Kachery Cloud allows users to access the database and pull data and analysis results directly to their local machine.
  • Pipeline versioning - Processing and analysis of data in neuroscience is often dynamic, requiring new features. Spyglass uses Merge tables to ensure that analysis pipelines can be versioned. This allows users to easily use and compare results from different versions of the analysis pipeline while retaining the ability to access previously generated results.
  • Cautious Delete - Spyglass uses a cautious delete feature to ensure that data is not accidentally deleted by other users. When a user deletes data, Spyglass will first check to see if the data belongs to another team of users. This enables teams of users to work collaboratively on the same database without worrying about accidentally deleting each other's data.

Documentation can be found at - https://lorenfranklab.github.io/spyglass/

Installation

For installation instructions see - https://lorenfranklab.github.io/spyglass/latest/notebooks/00_Setup/

Typical installation time is: 5-10 minutes

Tutorials

The tutorials for spyglass are currently in the form of Jupyter Notebooks and can be found in the notebooks directory. We strongly recommend running the notebooks yourself.

Contributing

See the Developer's Note for contributing instructions found at - https://lorenfranklab.github.io/spyglass/latest/contribute/

License/Copyright

License and Copyright notice can be found at https://lorenfranklab.github.io/spyglass/latest/LICENSE/

System requirements

Spyglass has been tested on Linux Ubuntu 20.04 and MacOS 10.15. It has not been tested on Windows and likely will not work.

No specific hardware requirements are needed to run spyglass. However, the amount of data that can be stored and analyzed is limited by the available disk space and memory. GPUs are required for some of the analysis tools, such as DeepLabCut.

See pyproject.toml, environment.yml, or environment_dlc.yml for software dependencies.

See spec-file.txt for the conda environment used in the demo.

Citation

Lee, K.H.*, Denovellis, E.L.*, Ly, R., Magland, J., Soules, J., Comrie, A.E., Gramling, D.P., Guidera, J.A., Nevers, R., Adenekan, P., Brozdowski, C., Bray, S., Monroe, E., Bak, J.H., Coulter, M.E., Sun, X., Broyles, E., Shin, D., Chiang, S., Holobetz, C., Tritt, A., Rübel, O., Nguyen, T., Yatsenko, D., Chu, J., Kemere, C., Garcia, S., Buccino, A., Frank, L.M., 2024. Spyglass: a data analysis framework for reproducible and shareable neuroscience research. bioRxiv. 10.1101/2024.01.25.577295.

* Equal contribution

See paper related code here.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

spyglass_neuro-0.5.4.tar.gz (3.5 MB view details)

Uploaded Source

Built Distribution

spyglass_neuro-0.5.4-py3-none-any.whl (353.1 kB view details)

Uploaded Python 3

File details

Details for the file spyglass_neuro-0.5.4.tar.gz.

File metadata

  • Download URL: spyglass_neuro-0.5.4.tar.gz
  • Upload date:
  • Size: 3.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for spyglass_neuro-0.5.4.tar.gz
Algorithm Hash digest
SHA256 1382d4ba39554f7d853238d2a0f90f1a97242655a96398c3aaec6c962c0e3478
MD5 f9fd9014025a7530fad7b67b64d2be03
BLAKE2b-256 418cb93c19f7c73401f4b82a20823ee16a6dc6d67131815b171979330050155d

See more details on using hashes here.

Provenance

The following attestation bundles were made for spyglass_neuro-0.5.4.tar.gz:

Publisher: test-package-build.yml on LorenFrankLab/spyglass

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file spyglass_neuro-0.5.4-py3-none-any.whl.

File metadata

  • Download URL: spyglass_neuro-0.5.4-py3-none-any.whl
  • Upload date:
  • Size: 353.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for spyglass_neuro-0.5.4-py3-none-any.whl
Algorithm Hash digest
SHA256 4c11e97766878940adbc03b2ce12393b4165ef9b2cda03fa083464cf178a7c7c
MD5 6f50c31d3351f17603a68fc297d3a771
BLAKE2b-256 8f3388e9d6169d6f72c5ef94378cc90e379d2188845aabf18e5e0f02b6696427

See more details on using hashes here.

Provenance

The following attestation bundles were made for spyglass_neuro-0.5.4-py3-none-any.whl:

Publisher: test-package-build.yml on LorenFrankLab/spyglass

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page