Skip to main content

ML & data helper code!

Project description

ML & data helper code!

Jakub Langr (c) 2021

This is a CLI utility for speeding up basic Data Engineering/Data Science tasks

Installation

$ pip install data-toolkit

Development

This project includes a number of helpers in the Makefile to streamline common development tasks.

Environment Setup

The following demonstrates setting up and working with a development environment:

### create a virtualenv for development

$ make virtualenv

$ source env/bin/activate


### run dt cli application

$ dt --help


### run pytest / coverage

$ make test

TODO: Central Data Repository

As a PM, I want to be able to quickly look at all the data we have on S3 with sample images.

* Needs a DB
* Needs a way of sampling

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data-toolkit-0.9.11.tar.gz (31.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

data_toolkit-0.9.11-py3-none-any.whl (40.2 kB view details)

Uploaded Python 3

File details

Details for the file data-toolkit-0.9.11.tar.gz.

File metadata

  • Download URL: data-toolkit-0.9.11.tar.gz
  • Upload date:
  • Size: 31.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5

File hashes

Hashes for data-toolkit-0.9.11.tar.gz
Algorithm Hash digest
SHA256 a2a0f1e3419485b0f535df9f663464994bf319b4356aa2fe8f2ded60afdef100
MD5 8239afe862d0846e7b6843cdfb52cc46
BLAKE2b-256 884011b65d5f2d18967c4146ef9fc804c6803b34c11772501f46b01f8935fab7

See more details on using hashes here.

File details

Details for the file data_toolkit-0.9.11-py3-none-any.whl.

File metadata

  • Download URL: data_toolkit-0.9.11-py3-none-any.whl
  • Upload date:
  • Size: 40.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5

File hashes

Hashes for data_toolkit-0.9.11-py3-none-any.whl
Algorithm Hash digest
SHA256 3ceec07c94b929e7bdcf53892ae9db4cff97fa2cfc5544199a1ecb564b14abfb
MD5 3ddc948c86939778c14fd061dfe28c12
BLAKE2b-256 0ec1c2922443d156853ddbe4e53fdaef71a0ca28e0ba54a1bf884ba098df6c92

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page