Skip to main content

UKB Access Repo

Project description

UKB_Wrapper_Repo

This library has been designed to provide convenient access to UKB dataset to users of PSC and Openmind7 clusters by leveraging Datalad package. Datalad allows its users to store large datasets in a distributed manner and faciliate easier collaboration. Currently the repo has modules dedicated to three types of data stored within the UKB dataset namely Scalar, Genetic and Bulk data types. The library also serves as a directory for all the unique categories and field ids which are part of UKB dataset.

Datalad is designed as a tool to version control large datasets in a manner quite similar to Git but limited to either a single network, HPC cluster. This library has been designed to help the end user make use the principles of datalad to access data stored on a different cluster and even with limited knowledge of how datalad works.

Additionally this repository also houses the notebook files related to this project showcasing exploratory data analysis done on multiple categories.The modules are currently designed to give access to the necessary data through the use of maximum of three-four lines of code.

  1. Import relevant modules and initilize objects
from UKBRepo.UKBRepo import module_scalar_data_handler as scalar_module

scalar_handler_object=scalar_module.scalar_data_handler()
  1. Pick the main category to which your datatype belongs (T1_Images/Freesurfer/Diet/Smoking)
scalar_handler_object.display_all_ukb_categories()
  1. Fetch relevant field for that Category
bulk_handler_object.get_field_ids_for_category(Category_Name)
  1. Retrive the list of subjects who have those particular field ids
bulk_handler_object.get_subject_list_field_ids(Field_Id_List)
  1. Retrive relevant data for the subjects
bulk_handler_object.get_data_bulk(Field_Id,subject_id)

After executing the funtion of data retrival,the output user receives depends upon the type of data bieng requested. In case of scalar data the user will recive the actual data in the output whereas in case of bulk data it will be the path where the fetched bulk data files have been stored.

Requirements

  1. Datalad
  2. Git-annex
  3. Pandas
  4. Numpy

Refrences

http://handbook.datalad.org/en/latest/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ukbaccessrepo-0.24.tar.gz (9.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ukbaccessrepo-0.24-py3-none-any.whl (10.3 kB view details)

Uploaded Python 3

File details

Details for the file ukbaccessrepo-0.24.tar.gz.

File metadata

  • Download URL: ukbaccessrepo-0.24.tar.gz
  • Upload date:
  • Size: 9.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7

File hashes

Hashes for ukbaccessrepo-0.24.tar.gz
Algorithm Hash digest
SHA256 624a2abed08ee5ab1b48b8cd49124cd4b42baf62e0e15e8d1a709af57602cda6
MD5 129fcdaa515cffc0a3ffaa06389068c8
BLAKE2b-256 92828f22e169c0f26dad8fea989196a379e0a2730619ee30ef1240a0fb941d4e

See more details on using hashes here.

File details

Details for the file ukbaccessrepo-0.24-py3-none-any.whl.

File metadata

  • Download URL: ukbaccessrepo-0.24-py3-none-any.whl
  • Upload date:
  • Size: 10.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7

File hashes

Hashes for ukbaccessrepo-0.24-py3-none-any.whl
Algorithm Hash digest
SHA256 97720a01dfe98f582dbcde75309c005378657557f4959596f2af7e30816173dd
MD5 2e60b3fb68874afd572f19c33af8641d
BLAKE2b-256 f2ce59923a405b82ed09db531432b2ac9b485de7f2f29b2cbd27523fb2c7da3a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page