Skip to main content

Package for exrtacting, processing and analyzing Intan and OpenEphys data

Project description

See the full documentation here.

Table of contents generated with markdown-toc

blechpy

This is a package to extract, process and analyze electrophysiology data recorded with Intan or OpenEphys recording systems. This package is customized to store experiment and analysis metadata for the BLECh Lab (Katz lab) @ Brandeis University, but can readily be used and customized for other labs.

Installation

If is set this up correctly you can install with pip: pip install blechpy

If you are setting up from source you can create a compatible conda environment with: conda env create --name blech -f=conda_environment.yml

Can then handle all data from within an ipython terminal conda activate blech ipython

import blechpy

Usage

blechpy handles experimental metadata using data_objects which are tied to a directory encompassing some level of data. Existing types of data_objects include:

  • dataset
    • object for a single recording session
  • experiment
    • object encompasing an ordered set of recordings from a single animal
    • individual recordings must first be processes as datasets
  • project
    • object that can encompass multiple experiments & data groups and allow analysis or group differences

Datasets

Right now this pipeline is only compatible with recordings done with Intan's 'one file per channel' or 'one file per signal type' recordings settings.

Starting wit a raw dataset

Create dataset

With a brand new shiny recording you can initilize a dataset with:

dat = blechpy.dataset('path/to/recording/directory')
# or
dat = blechpy.dataset()  # for user interface to select directory

This will create a new dataset object and setup basic file paths. If you're working via SSH or just want a command-line interface instead of a GUI you can use the keyword argument shell=True

Initialize Parameters

dat.initParams() 
# or
dat.initParams(shell=True)

Initalizes all analysis parameters with a series of prompts. See prompts for optional keyword params. Primarily setups parameters for:

  • Flattening Port & Channel in Electrode designations
  • Common average referencing
  • Labelling areas of electrodes
  • Labelling digital inputs & outputs
  • Labelling dead electrodes
  • Clustering parameters
  • Spike array creation
  • PSTH creation
  • Palatability/Identity Responsiveness calculations

Initial parameters are pulled from default json files in the dio subpackage. Parameters for a dataset are written to json files in a parameters folder in the recording directory

Basic Processing

dat.processing_status

Can provide an overview of basic data extraction and processing steps that need to be taken.

An example data extraction workflow would be:

dat = blechpy.dataset('/path/to/data/dir/')
dat.initParams()
dat.extract_data()          # Extracts raw data into HDF5 store
dat.create_trial_list()     # Creates table of digital input triggers
dat.mark_dead_channels()    # View traces and label electrodes as dead
dat.common_average_reference() # Use common average referencing on data. 
                               # Repalces raw with referenced data in HDF5 store
dat.blech_clust_run()       # Cluster data using GMM
dat.blech_clust_run(data_quality='noisy') # re-run clustering with less strict parameters

dat.sort_units()        # Split, merge and label clusters as units

Viewing a Dataset

Experiments can be easily viewed wih: print(dat) A summary can also be exported to a text with: dat.export_to_text()

Loading an existing dataset

dat = blechpy.load_dataset() # load an existing dataset from .p file
# or
dat = blechpy.load_dataset('path/to/recording/directory') 
# or
dat = blechpy.load_dataset('path/to/dataset/save/file.p')

Import processed dataset into dataset framework

dat = blechpy.port_in_dataset()
# or
dat = blechpy.port_in_dataset('/path/to/recording/directory')

Experiments

Creating an experiment

exp = blechpy.experiment('/path/to/dir/encasing/recordings')
# or
exp = blechpy.experiment()

This will initalize an experiment with all recording folders within the chosen directory.

Editing recordings

exp.add_recording('/path/to/new/recording/dir/')    # Add recording
exp.remove_recording('rec_label')                   # remove a recording dir 

Recordings are assigned labels when added to the experiment that can be used to easily reference exerpiments.

Held unit detection

exp.detect_held_units()

Uses raw waveforms from sorted units to determine if units can be confidently classified as "held". Results are stored in exp.held_units as a pandas DataFrame. This also creates plots and exports data to a created directory: /path/to/experiment/experiment-name_analysis

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

blechpy-2.0.47.tar.gz (132.1 kB view details)

Uploaded Source

Built Distribution

blechpy-2.0.47-py3-none-any.whl (177.4 kB view details)

Uploaded Python 3

File details

Details for the file blechpy-2.0.47.tar.gz.

File metadata

  • Download URL: blechpy-2.0.47.tar.gz
  • Upload date:
  • Size: 132.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/45.2.0.post20200210 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.7.6

File hashes

Hashes for blechpy-2.0.47.tar.gz
Algorithm Hash digest
SHA256 e9052a8736275b5d7184c7e2f2a6482b3ea473a286f21dae32a0dfca97d49404
MD5 53084c9e2b2c724021729b2d2b9643c5
BLAKE2b-256 10798fb899ef80cdc4a699967cd874dc934370e76327e20fe5aeafbc8107d3e1

See more details on using hashes here.

File details

Details for the file blechpy-2.0.47-py3-none-any.whl.

File metadata

  • Download URL: blechpy-2.0.47-py3-none-any.whl
  • Upload date:
  • Size: 177.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/45.2.0.post20200210 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.7.6

File hashes

Hashes for blechpy-2.0.47-py3-none-any.whl
Algorithm Hash digest
SHA256 04f0dae0aaeda1bea64085f3131e25602925ac2b3d502e217f0c2867cc46469b
MD5 f1cce24d782902a86d95e68e5824dbf7
BLAKE2b-256 f25fef34920811bf4aa7298a34e946fed39138fd625daf291501ce8ce8faacea

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page