Skip to main content

Package for exrtacting, processing and analyzing Intan and OpenEphys data

Project description

See the full documentation here.

Table of contents generated with markdown-toc

blechpy

This is a package to extract, process and analyze electrophysiology data recorded with Intan or OpenEphys recording systems. This package is customized to store experiment and analysis metadata for the BLECh Lab (Katz lab) @ Brandeis University, but can readily be used and customized for other labs.

Installation

If is set this up correctly you can install with pip: pip install blechpy

If you are setting up from source you can create a compatible conda environment with: conda env create --name blech -f=conda_environment.yml

Can then handle all data from within an ipython terminal conda activate blech ipython

import blechpy

Usage

blechpy handles experimental metadata using data_objects which are tied to a directory encompassing some level of data. Existing types of data_objects include:

  • dataset
    • object for a single recording session
  • experiment
    • object encompasing an ordered set of recordings from a single animal
    • individual recordings must first be processes as datasets
  • project
    • object that can encompass multiple experiments & data groups and allow analysis or group differences

Datasets

Right now this pipeline is only compatible with recordings done with Intan's 'one file per channel' or 'one file per signal type' recordings settings.

Starting wit a raw dataset

Create dataset

With a brand new shiny recording you can initilize a dataset with:

dat = blechpy.dataset('path/to/recording/directory')
# or
dat = blechpy.dataset()  # for user interface to select directory

This will create a new dataset object and setup basic file paths. If you're working via SSH or just want a command-line interface instead of a GUI you can use the keyword argument shell=True

Initialize Parameters

dat.initParams() 
# or
dat.initParams(shell=True)

Initalizes all analysis parameters with a series of prompts. See prompts for optional keyword params. Primarily setups parameters for:

  • Flattening Port & Channel in Electrode designations
  • Common average referencing
  • Labelling areas of electrodes
  • Labelling digital inputs & outputs
  • Labelling dead electrodes
  • Clustering parameters
  • Spike array creation
  • PSTH creation
  • Palatability/Identity Responsiveness calculations

Initial parameters are pulled from default json files in the dio subpackage. Parameters for a dataset are written to json files in a parameters folder in the recording directory

Basic Processing

dat.processing_status

Can provide an overview of basic data extraction and processing steps that need to be taken.

An example data extraction workflow would be:

dat = blechpy.dataset('/path/to/data/dir/')
dat.initParams()
dat.extract_data()          # Extracts raw data into HDF5 store
dat.create_trial_list()     # Creates table of digital input triggers
dat.mark_dead_channels()    # View traces and label electrodes as dead
dat.common_average_reference() # Use common average referencing on data. 
                               # Repalces raw with referenced data in HDF5 store
dat.blech_clust_run()       # Cluster data using GMM
dat.blech_clust_run(data_quality='noisy') # re-run clustering with less strict parameters

dat.sort_units()        # Split, merge and label clusters as units

Viewing a Dataset

Experiments can be easily viewed wih: print(dat) A summary can also be exported to a text with: dat.export_to_text()

Loading an existing dataset

dat = blechpy.load_dataset() # load an existing dataset from .p file
# or
dat = blechpy.load_dataset('path/to/recording/directory') 
# or
dat = blechpy.load_dataset('path/to/dataset/save/file.p')

Import processed dataset into dataset framework

dat = blechpy.port_in_dataset()
# or
dat = blechpy.port_in_dataset('/path/to/recording/directory')

Experiments

Creating an experiment

exp = blechpy.experiment('/path/to/dir/encasing/recordings')
# or
exp = blechpy.experiment()

This will initalize an experiment with all recording folders within the chosen directory.

Editing recordings

exp.add_recording('/path/to/new/recording/dir/')    # Add recording
exp.remove_recording('rec_label')                   # remove a recording dir 

Recordings are assigned labels when added to the experiment that can be used to easily reference exerpiments.

Held unit detection

exp.detect_held_units()

Uses raw waveforms from sorted units to determine if units can be confidently classified as "held". Results are stored in exp.held_units as a pandas DataFrame. This also creates plots and exports data to a created directory: /path/to/experiment/experiment-name_analysis

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

blechpy-1.1.12.tar.gz (83.3 kB view details)

Uploaded Source

Built Distribution

blechpy-1.1.12-py3-none-any.whl (117.2 kB view details)

Uploaded Python 3

File details

Details for the file blechpy-1.1.12.tar.gz.

File metadata

  • Download URL: blechpy-1.1.12.tar.gz
  • Upload date:
  • Size: 83.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.2

File hashes

Hashes for blechpy-1.1.12.tar.gz
Algorithm Hash digest
SHA256 82dcadada5cb9b811740a4091cac07b322e1f2c6e84ddda36039ba0acf5d26f3
MD5 b6466d51e9fcd97c4b3c7b972faf978f
BLAKE2b-256 135e00f3f7ec95f911ff0facf86df531d20c481949bf95a56b3bc3ff89dfab8d

See more details on using hashes here.

File details

Details for the file blechpy-1.1.12-py3-none-any.whl.

File metadata

  • Download URL: blechpy-1.1.12-py3-none-any.whl
  • Upload date:
  • Size: 117.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.2

File hashes

Hashes for blechpy-1.1.12-py3-none-any.whl
Algorithm Hash digest
SHA256 2ef0ff1f62e1b3133afe7948c5d6c10ad376ffd976f9c2ddcbeed3b9a0a0782f
MD5 051115f662056c7c4dc0371ae613ccdc
BLAKE2b-256 f62ea4baf0f579b5e152e69bb3442dc76c6ebfa99e6d38af18cdc32d0ff13dd4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page