labdata
Tools to copy data and manage data analysis in an experimental neuroscience lab.
This is built after labdata-tools and integrates with S3 and a database through datajoint.
Concepts
Experiments often involve many computers in the lab and data has to be copied to a server(and sometimes backed up). In this process files can be corrupted, data loss and so on, specially if manually copying files. Further, in some cases, tasks have to be performed on the files (those might involve compressing, formatting, etc).
What labdata does to copy files:
1. After data are acquired, labdata performs a md5 checksum of the file to be copied and copies the file to a server.
2. After the copy, the checksum and datapath are placed on the Upload database table.
3. The computer/server that manages the copy to the permanent storage server will read the database table. The server will perform a checksum on the file to ensure the copy from the acquisition computer was ok.
4. If needed it will compress data or do whatever is specified in the preference file rules (see upload_rules)
5. Data will be put in S3 and added to the Files
Instalation
Clone the repository to a folder in your computer and do:
pip install . or pip install -e . to if you want that the source code follows git.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file labdata-0.1.16.tar.gz.
File metadata
- Download URL: labdata-0.1.16.tar.gz
- Upload date:
- Size: 251.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.11.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
88de29f988000fe2619d6ca5527ed3f9985b234434f4952c4fe3ead5f31bdd5b
|
|
| MD5 |
eff146742f3ffd1172cc9c3a8d097ca9
|
|
| BLAKE2b-256 |
6fac2a253e693fb1e6a080cb0127a817bf85b1a31b46e2e3a27934a277fac552
|
File details
Details for the file labdata-0.1.16-py3-none-any.whl.
File metadata
- Download URL: labdata-0.1.16-py3-none-any.whl
- Upload date:
- Size: 272.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.11.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
53be920a854209cfbeaae9287b8aefe56803d7a4ffe9e9dfd5146af3c403c1f0
|
|
| MD5 |
e4af89f3e74c3d75e80eb14bb05129ee
|
|
| BLAKE2b-256 |
7a9137fc2b4e13c45be50cac388a1a979fe229f62ac0fb13c4a66e08e20b9505
|
