Skip to main content

ML & data helper code!

Project description

ML & data helper code!

Jakub Langr (c) 2021

This is a CLI utility for speeding up basic Data Engineering/Data Science tasks

Installation

$ pip install data-toolkit

Development

This project includes a number of helpers in the Makefile to streamline common development tasks.

Environment Setup

The following demonstrates setting up and working with a development environment:

### create a virtualenv for development

$ make virtualenv

$ source env/bin/activate


### run dt cli application

$ dt --help


### run pytest / coverage

$ make test

TODO: Central Data Repository

As a PM, I want to be able to quickly look at all the data we have on S3 with sample images.

* Needs a DB
* Needs a way of sampling

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data-toolkit-0.9.0.tar.gz (30.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

data_toolkit-0.9.0-py3-none-any.whl (38.4 kB view details)

Uploaded Python 3

File details

Details for the file data-toolkit-0.9.0.tar.gz.

File metadata

  • Download URL: data-toolkit-0.9.0.tar.gz
  • Upload date:
  • Size: 30.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5

File hashes

Hashes for data-toolkit-0.9.0.tar.gz
Algorithm Hash digest
SHA256 26696e2a0b207b975a2970ba6f855565cfa73be4d13e046c888cd27cbb4f1b3e
MD5 f32a85886fd754a56a4861c86709850e
BLAKE2b-256 6365c73c40df858dd317848610ecdfbcd2b6fba972fc58f628214754dca1f243

See more details on using hashes here.

File details

Details for the file data_toolkit-0.9.0-py3-none-any.whl.

File metadata

  • Download URL: data_toolkit-0.9.0-py3-none-any.whl
  • Upload date:
  • Size: 38.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5

File hashes

Hashes for data_toolkit-0.9.0-py3-none-any.whl
Algorithm Hash digest
SHA256 50f107f7380dc1dd6cc3479f71547e9421ed7638a9e978ff1be753130d7c3274
MD5 ed7ab2e77b1e7675bc0ff4a0a165c0c0
BLAKE2b-256 da5b9f5f165c9fa9f0b8ab60d0269433c8ad0d38963c384277899a1adf157b08

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page