Skip to main content

ML & data helper code!

Project description

ML & data helper code!

Jakub Langr (c) 2021

This is a CLI utility for speeding up basic Data Engineering/Data Science tasks

Installation

$ pip install data-toolkit

Development

This project includes a number of helpers in the Makefile to streamline common development tasks.

Environment Setup

The following demonstrates setting up and working with a development environment:

### create a virtualenv for development

$ make virtualenv

$ source env/bin/activate


### run dt cli application

$ dt --help


### run pytest / coverage

$ make test

TODO: Central Data Repository

As a PM, I want to be able to quickly look at all the data we have on S3 with sample images.

* Needs a DB
* Needs a way of sampling

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data-toolkit-0.10.0.tar.gz (31.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

data_toolkit-0.10.0-py3-none-any.whl (40.3 kB view details)

Uploaded Python 3

File details

Details for the file data-toolkit-0.10.0.tar.gz.

File metadata

  • Download URL: data-toolkit-0.10.0.tar.gz
  • Upload date:
  • Size: 31.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5

File hashes

Hashes for data-toolkit-0.10.0.tar.gz
Algorithm Hash digest
SHA256 8596c47f694419cc9b00fb41289980e9f2481f8422ca6bedbf0c0110195d4212
MD5 eea6360d804e39cf33f6676caca17555
BLAKE2b-256 a28f57f17e06ac007c6c4687008705b73911131a297e9090c83949b2fbe93957

See more details on using hashes here.

File details

Details for the file data_toolkit-0.10.0-py3-none-any.whl.

File metadata

  • Download URL: data_toolkit-0.10.0-py3-none-any.whl
  • Upload date:
  • Size: 40.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5

File hashes

Hashes for data_toolkit-0.10.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8e100787dd3212697344b215ddade7e0363d9607c726a4a6bc173a0cb56bb704
MD5 69c5d33988a01ccc21d1d25a73749b43
BLAKE2b-256 21fbe82ca39d499d82dfbf791700e64a650e5cc30a62d072a1d51c47958b7cf4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page