jdb-to-nwb 2.3.0

Converts electrophysiology, photometry, and behavioral data for the hex maze task used by the Berke Lab at UCSF to NWB format for sharing and analysis.

jdb_to_nwb

Converts electrophysiology, photometry, and behavioral data for the hex maze task used by the Berke Lab at UCSF to NWB format for sharing and analysis.

Installation

git clone https://github.com/calderast/jdb_to_nwb.git
cd jdb_to_nwb
pip install -e .

Usage

1. Open one of the example metadata files in a text editor (metadata_example_Jose.yaml for Jose's experiments, or metadata_example_Tim.yaml for Tim / Yang-Sun / Stephanie's experiments). Update the paths to point to your data and update the metadata for your experiment. See metadata_fully_explained.yaml for an explanation of all metadata fields.

2. Run the conversion to generate an NWB file (replace output_dir with your desired output directory). The nwb file will be automatically named based on the animal name and date (i.e. rat_date.nwb):

jdb_to_nwb metadata_example.yaml output_dir

3. Sub-directories for associated figures and conversion log files will be created alongside the nwb file in output_dir. Check that there are no errors in the error log file and that all figures look as expected.

Downloading test data (Developers only)

The large test data files are stored in a shared UCSF Box account. To get access to the test data, please contact the repo maintainers.

Create a new file called .env in the root directory of the repository and add your Box credentials:

BOX_USERNAME=<your_box_username>
BOX_PASSWORD=<your_box_password>

Or set the environment variables in your shell:

export BOX_USERNAME=<your_box_username>
export BOX_PASSWORD=<your_box_password>

Then run the download script:

python tests/download_test_data.py

You can pass the --overwrite flag to overwrite existing files:

python tests/download_test_data.py --overwrite

Notes:

• Run python tests/test_data/create_raw_ephys_test_data.py to re-create the test data for raw_ephys.
• Run python tests/test_data/create_processed_ephys_test_data.py to re-create the test data for processed_ephys.
• tests/test_data/processed_ephys/impedance.csv was manually created for testing purposes.
• tests/test_data/processed_ephys/geom.csv was manually created for testing purposes.
• Some files (settings.xml, structure.oebin) nested within tests/test_data/raw_ephys/2022-07-25_15-30-00 were manually created for testing purposes.

The GitHub Actions workflow (.github/workflows/test_package_build.yml) will automatically download the test data and run the tests.

Versioning

Versioning is handled automatically using hatch-vcs using the latest tag in the git history as the version number. To make a new release, simply tag the current commit and push to the repository. Use semantic versioning to set the version number. Create a GitHub release using the tag.