Skip to main content

ML & data helper code!

Project description

ML & data helper code!

Jakub Langr (c) 2021

This is a CLI utility for speeding up basic Data Engineering/Data Science tasks

Installation

$ pip install data-toolkit

Development

This project includes a number of helpers in the Makefile to streamline common development tasks.

Environment Setup

The following demonstrates setting up and working with a development environment:

### create a virtualenv for development

$ make virtualenv

$ source env/bin/activate


### run dt cli application

$ dt --help


### run pytest / coverage

$ make test

TODO: Central Data Repository

As a PM, I want to be able to quickly look at all the data we have on S3 with sample images.

* Needs a DB
* Needs a way of sampling

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data-toolkit-0.9.1.tar.gz (30.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

data_toolkit-0.9.1-py3-none-any.whl (38.4 kB view details)

Uploaded Python 3

File details

Details for the file data-toolkit-0.9.1.tar.gz.

File metadata

  • Download URL: data-toolkit-0.9.1.tar.gz
  • Upload date:
  • Size: 30.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5

File hashes

Hashes for data-toolkit-0.9.1.tar.gz
Algorithm Hash digest
SHA256 57783fdf9b29fb4e22198b864a75276d8108dd1d5754d00c24aa41cf7cb23fc9
MD5 66d0a30d42883852e503d96b558c2b1a
BLAKE2b-256 29b1907e4581d083f7340deaa824b1921a89b6d8a142b295569fd5c73783adcb

See more details on using hashes here.

File details

Details for the file data_toolkit-0.9.1-py3-none-any.whl.

File metadata

  • Download URL: data_toolkit-0.9.1-py3-none-any.whl
  • Upload date:
  • Size: 38.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5

File hashes

Hashes for data_toolkit-0.9.1-py3-none-any.whl
Algorithm Hash digest
SHA256 aedaeec346c5b84a7c193ea072f8ab4ac1388e06194adaa6e963f8d7a573fc9f
MD5 fed6d0b7bf8b16c2a87a331ab3faac79
BLAKE2b-256 43704b3af414b94379d9dbd2541569ae5b9d4c1bc54e5e1a698546e82de18977

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page