Skip to main content

Data slicing tool for reading data from one tranSMART and uploading it to another

Project description

Build status codecov PyPI PyPI - Downloads

transmart-hyper-dicer is a data slicing tool that reads data from one TranSMART instance and uploads it to another.

⚠️ Note: this is a very preliminary version, still under development. Issues can be reported at


Connection to Keycloak identity provider and tranSMART is configured by setting the environment variables below:

Variable Description
TRANSMART_URL URL of the TranSMART back-end application e.g.
KEYCLOAK_SERVER_URL URL of the Keycloak identity provider e.g.
KEYCLOAK_REALM Keycloak realm, e.g. dev
KEYCLOAK_CLIENT_ID Keycloak client ID, e.g. transmart-client
OFFLINE_TOKEN An offline token used used as a refresh token in order to communicate with TranSMART
VERIFY_CERT Either a boolean, in which case it controls whether the server’s TLS certificate is verified, or a string, in which case it must be a path to a CA bundle to use. Defaults to True.

In order to generate an offline token for USERNAME user, the following curl command can be used. To get the token the user needs to have the role mapping for the realm-level: offline_access. Before using the command you have to substitute words in uppercase with proper ones.

curl \
  -d 'client_id=KEYCLOAK_CLIENT_ID' \
  -d 'username=USERNAME' \
  -d 'password=PASSWORD' \
  -d 'grant_type=password' \
  -d 'scope=offline_access' \

The value of the refresh_token field in the response is the offline token.

All the variables can be specified in the .env file as key-value pairs. They will be automatically set as environment variables, when starting the application. Example of the .env file:

OFFLINE_TOKEN=<refresh_token value from the curl response>


The package requires Python 3.6+.

To install transmart-hyper-dicer, do:

pip install transmart-hyper-dicer

Or from source:

git clone
cd transmart-hyper-dicer
pip install .

Run tests (including coverage) with:

python test


Read subset of data from the configured tranSMART instance, based on the constraint specified in an input JSON file and write the output in transmart-copy format to /path/to/output. The output directory should be empty of not existing (then it will be created).

Input constraint has to be a valid tranSMART constraint. Example of <input.json> file content:

  "type": "study_name",
  "studyId": "EHR"


transmart-hyper-dicer <input.json> /path/to/output

This generates the directories i2b2metadata and i2b2demodata in the output directory. The generated data can be loaded using transmart-copy:

# Download transmart-copy:
curl -f -L -o transmart-copy.jar
# Load data
PGUSER=tm_cz PGPASSWORD=tm_cz java -jar transmart-copy.jar -d output

Package management and dependencies

This project uses pip for installing dependencies and package management.

  • Dependencies should be added to in the install_requires list.


Copyright (c) 2019 The Hyve B.V.

The Transmart Hyper Dicer is licensed under the MIT License. See the file LICENSE.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for transmart-hyper-dicer, version 0.1.3
Filename, size File type Python version Upload date Hashes
Filename, size transmart_hyper_dicer-0.1.3-py3-none-any.whl (18.2 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size transmart-hyper-dicer-0.1.3.tar.gz (13.8 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page