Skip to main content

Dataloader that serves MRI images from a mongodb

Project description

mongoslabs

Dataloader that serves MRI images from a mongodb.

The main idea is to keep MRI images and corresponding training labels for segmentation tasks in a mongo database. However, each 2563 3D MRI tensor even in 8 bit precision is 16Mb. mongo's records cannot be larger than this limit and we need to also store the labels of the same dimensions. mongoslabs fetches and aggregates each 2563 tensor stored across 8 records, together with corresponding labels either for gray and white matter, 104 regions atlas, or a 50 region atlas. (The scripts to populate such collection are upcoming.)

An example of maintaining a high utilization on 4 GPUs

installation

pip install mongoslabs

usage

A detailed example of how to create a dataloader using provided dataset class and the corresponding tools is in scripts/usage_example.py

Do not forget to move the batches to the GPU once obtained.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mongoslabs-0.0.2.tar.gz (4.8 kB view details)

Uploaded Source

Built Distribution

mongoslabs-0.0.2-py3-none-any.whl (5.8 kB view details)

Uploaded Python 3

File details

Details for the file mongoslabs-0.0.2.tar.gz.

File metadata

  • Download URL: mongoslabs-0.0.2.tar.gz
  • Upload date:
  • Size: 4.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.7.12

File hashes

Hashes for mongoslabs-0.0.2.tar.gz
Algorithm Hash digest
SHA256 f279b1cd49b698951a92d5263eafe2850a2510cb8593e4a3d57a81560d96cb1f
MD5 ce746ef91a355756fdf0136218b5037c
BLAKE2b-256 c22d4ec5e6b74a4884ccbd8fd3ddb58bf4354f32fce8a8ce38b092db5442a30b

See more details on using hashes here.

File details

Details for the file mongoslabs-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: mongoslabs-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 5.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.7.12

File hashes

Hashes for mongoslabs-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 7b804351841c5c0f0e18f29cfd5e7b293e721da05f3b7c255c2668ede663e04e
MD5 2311678e637be8ca194e428b93258757
BLAKE2b-256 f7ce96106131d2b8bac0c93c29b4eb240523d77484ce671c6cb1d2456e39fda0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page