sscu-budapest utilities for scientific data engineering
Project description
datazimmer
Some utility function to help with
- setting up data environments
- simplified dvc pipeline registry
these are used in the project-template
Make sure that python
points to python>=3.8
and you have pip
and git
Functions
Tinker
check out a table or few, with a notebook and some basic analysis to help
Engineer Research
Lookahead
- overlapping names convention
- resolve naming confusion with colassigner, colaccessor and table feature / composite type / index base classes
- abstract composite type + subclass of entity class
- import ACT, inherit from it and specify
- importing composite type is impossible now if it contains foreign key :(
- automatic filter for env creation based on foreign key metadata
- add option to infer data type of assigned feature
- can be problematic b/c pandas int/float/nan issue
- sharing functions among projects
- functions specific to processing certain composite / named types
- e.g. function dealing with fitting into a limit in dogshow project 1
- create similar sets of features in a dry way
- detecting reliance of composite type given by assigner
- can wait, as initial import is just the assigner transformed to accessor
- overlapping in entities
- detect / signal the same type of entity
- properly assert importing
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
datazimmer-0.2.6.tar.gz
(67.0 kB
view hashes)
Built Distribution
datazimmer-0.2.6-py3-none-any.whl
(53.5 kB
view hashes)
Close
Hashes for datazimmer-0.2.6-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 62452e7642680dd7502b6ffb97765008d3f200cfadd7ed1a7cee31d2510aa7e0 |
|
MD5 | 4a81371d4b26caefc10dc755bb7f1ba3 |
|
BLAKE2b-256 | 2a8a91ed413fb1c2d875640a5d1baf42681ccd054735ba8960b77c84b791d8c5 |