Tools for uploading and interacting with Mindscope Neuropixels experiments on Code Ocean
Project description
np_codeocean
Tools for uploading and interacting with Mindscope Neuropixels experiments on Code Ocean
Requires running as admin on Windows in order to create remote-to-remote symlinks on the Isilon.
-
upload
CLI tool is provided, which uses thenp_session
interface to find and upload raw data for one ecephys session:pip install np_codeocean upload <session-id>
where session-id is a valid input to
np_session.Session()
:- a lims ID (
1333741475
) - a workgroups foldername (
DRPilot_366122_20230101
) - a path to a session folder (
\\allen\programs\mindscope\workgroups\np-exp\1333741475_719667_20240227
)
- a lims ID (
-
a folder of symlinks pointing to the raw data is created, with a new structure suitable for the KS2.5 sorting pipeline on Code Ocean
-
the symlink folder, plus metadata, are entered into a csv file, which is submitted to
http://aind-data-transfer-service
, which in turn runs theaind-data-transfer
tool on the HPC, which follows the symlinks to the original data, median-subtracts/scales/compresses ephys data, then uploads with the AWS CLI tool -
all compression/zipping acts on copies in temporary folders: the original raw data is not altered in anyway
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for np_codeocean-0.2.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fd708302b7f43e8c114fdf6df30c9a8f5816af38dd526fa7452973137fd2147f |
|
MD5 | e0809c68b0f7975818b831703c151845 |
|
BLAKE2b-256 | 6cc15ce69b8702fe6c7980f400c5d95cd7a9301ef03d57519f1a3a56173fd9ff |