UDC

The Universal Data Client

What is UDC?

Universal Data is an open source initiative to build a decentralized, cryptographically-secure ecosystem containerizing both structured and unstructured data. UDC is the initial (alpha) client for that system.

Installation

Production Package

From PyPi:

python3 -m pip install udc # OR
python3 -m pip install --upgrade udc
which udc

Development Branch

python3 -m pip install https://github.com/data-yaml/udc@main

Cloned

When cloned from GitHub:

poetry install

<--

alias udc="poetry run udc"

-->

Usage

udc # prints help

List contents of a specific package instance

udc list "quilt+s3://quilt-example#package=examples/wellplates@6782cf98a2"

e.g.,

quilt+s3://quilt-example#package=examples/wellplates@6782cf98a2&path=README.md
quilt+s3://quilt-example#package=examples/wellplates@6782cf98a2&path=autoplate_H1N1.csv
quilt+s3://quilt-example#package=examples/wellplates@6782cf98a2&path=data_products.ipynb
quilt+s3://quilt-example#package=examples/wellplates@6782cf98a2&path=neutralisation-altair.json
quilt+s3://quilt-example#package=examples/wellplates@6782cf98a2&path=neutralisation.json
quilt+s3://quilt-example#package=examples/wellplates@6782cf98a2&path=quilt_summarize.json
quilt+s3://quilt-example#package=examples/wellplates@6782cf98a2&path=render.html

List all versions of a package

udc list "quilt+s3://quilt-example#package=examples/wellplates" | head -n 1

e.g.,

quilt+s3://quilt-example#package=examples/wellplates@6782cf98a2c600f4c519efd5de868d5ef1e05ac92fcb0fa56044bb8c925c5f02

List all packages in a registry

udc list quilt+s3://quilt-example | head -n 1

e.g.,

quilt+s3://quilt-example#package=akarve/amazon-reviews:latest

Development

Testing

make test

Continuous Monitoring

make watch

Create Package

WARNING: Do this only if you are the maintainer of the package.

Be sure you to first set your ~/.pypirc using poetry config pypi-token.pypi <pypi-api-token>

# merge PR
make tag
make pypi
poetry publish