Skip to main content

labdata

Tools to copy data and manage data analysis in an experimental neuroscience lab.

This is built after labdata-tools and integrates with S3 and a database through datajoint.

Concepts

Experiments often involve many computers in the lab and data has to be copied to a server(and sometimes backed up). In this process files can be corrupted, data loss and so on, specially if manually copying files. Further, in some cases, tasks have to be performed on the files (those might involve compressing, formatting, etc).

What labdata does to copy files: 1. After data are acquired, labdata performs a md5 checksum of the file to be copied and copies the file to a server. 2. After the copy, the checksum and datapath are placed on the Upload database table. 3. The computer/server that manages the copy to the permanent storage server will read the database table. The server will perform a checksum on the file to ensure the copy from the acquisition computer was ok. 4. If needed it will compress data or do whatever is specified in the preference file rules (see upload_rules) 5. Data will be put in S3 and added to the Files

Instalation

Clone the repository to a folder in your computer and do:

pip install . or pip install -e . to if you want that the source code follows git.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

labdata-0.1.15.tar.gz (243.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

labdata-0.1.15-py3-none-any.whl (266.4 kB view details)

Uploaded Python 3

File details

Details for the file labdata-0.1.15.tar.gz.

File metadata

  • Download URL: labdata-0.1.15.tar.gz
  • Upload date:
  • Size: 243.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.6

File hashes

Hashes for labdata-0.1.15.tar.gz
Algorithm Hash digest
SHA256 a4552420acec457ecd2bbf29e77ed38189bfe25e4ec55cdafd9b039a3dd532e4
MD5 37b17eb0bcf65aa68c4cce0883a01d7f
BLAKE2b-256 f99072d9d4f175bf1c663fb45920a5a094277615d244ad33e4337ca166fe485b

See more details on using hashes here.

File details

Details for the file labdata-0.1.15-py3-none-any.whl.

File metadata

  • Download URL: labdata-0.1.15-py3-none-any.whl
  • Upload date:
  • Size: 266.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.6

File hashes

Hashes for labdata-0.1.15-py3-none-any.whl
Algorithm Hash digest
SHA256 26d565350a00628f5a9825b686c0411e6e334d1d0ff027c4e3f8e0cd15bc04be
MD5 9f982a2700019508176facfd96705dd5
BLAKE2b-256 3ffa0bc5b203d20c50dc4e37ac6614a7bafb248a75a750cdcd728e9d69eb37cb

See more details on using hashes here.

Release history Release notifications | RSS feed

0.1.16

2 files

This release

0.1.15 This release

2 files

0.1.14

2 files

0.1.13

2 files

0.1.12

2 files

0.1.11

2 files

0.1.9

2 files

0.1.8

2 files

0.1.7

2 files

0.1.6

2 files

0.1.4

2 files

0.1.3

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

0.0.25

2 files

0.0.24

2 files

0.0.23

2 files

0.0.22

2 files

0.0.21

2 files

0.0.20

2 files

0.0.19

2 files

0.0.18

2 files

0.0.17

2 files

0.0.16

2 files

0.0.15

2 files

0.0.14

2 files

0.0.12

2 files

0.0.11

2 files

0.0.10

2 files

0.0.9

2 files

0.0.8

2 files

0.0.7

2 files

0.0.6

2 files

0.0.5

2 files

0.0.3

3 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page