Skip to main content

DCIC-wrangling

This is a collection of scripts and Jupyter notebooks that can be helpful when performing many data wrangling tasks. Most of the tools are specific to 4DN Nucleome wrangling needs, however may be modified to be more generally useful for certain tasks.

Install

Packaged with poetry can be installed using make, poetry or pip.

From the dcicwrangling directory - make build

If you already have poetry installed - poetry install

Or to pip install from PyPi - pip install dcicwrangling

All dependencies are installed by default - if for some reason you don't want to install pytest packages or invoke (used to launch notebooks) you can do poetry install --no-dev - not recommended.

Usage

Jupyter notebooks

There are a collection of commonly used jupyter notebooks in the notebooks/useful_notebooks directory. You can start a jupyter notebook server locally using invoke notebook from the top level directory. This should launch the server and open a browser page where the notebooks can be accessed.

IMPORTANT! - You should create your own folder in the notebooks directory named Yourname_scripts. This folder is where you should create, access and run your notebooks. If you want to start with one of the notebooks in the useful_notebooks directory please create a copy and move it to your own folder. This keeps the repository clean and organized. Please DO NOT run notebooks in the useful_notebooks directory and commit the results to the repository.

Scripts

The scripts directory contains some useful command line scripts. They can be run from the top level directory using python scripts/script_name --options. Using --help shows available options. In general, modified versions and bespoke scripts should not be committed to the repository - or alternatively committed to a separate non-master branch.

As scripts are developed and refined tool.poetry.scripts directives can be added to facilitate script usage - see pyproject.toml file example.

Metadata

Release files for dcicwrangling 3.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dcicwrangling 3.2.0
File Size Uploaded
dcicwrangling-3.2.0.tar.gz 57.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dcicwrangling 3.2.0
File Interpreter ABI Platform
dcicwrangling-3.2.0-py3-none-any.whl Python 3 none any Details

Total release size: 126.7 kB

Release files / dcicwrangling-3.2.0.tar.gz

Download URL dcicwrangling-3.2.0.tar.gz
Size 57.7 kB
Tags Source
SHA-256 checksum
How to use checksums
0365b00e13fd7d4be524c2e2d74e105d64250bbcfba7328f97d3b3dc985a3e7b
BLAKE2b-256 checksum
How to use checksums
82144e84ffc1c8df231ad73009950a70b00acea7549c8d80fd8ff1c59f94a134
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.4.2 CPython/3.11.9 Linux/6.5.0-1025-azure

Release files / dcicwrangling-3.2.0-py3-none-any.whl

Download URL dcicwrangling-3.2.0-py3-none-any.whl
Size 69.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
99f177e1d719a530f663d76efac7659eb22e05d225b6817bedf6b6c6e2e755fe
BLAKE2b-256 checksum
How to use checksums
683efe286734dc36a8cbdd560910741cbd13ee24100f263a7db56f6f8ddeeeb7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.4.2 CPython/3.11.9 Linux/6.5.0-1025-azure
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page