sscu-budapest utilities for scientific data engineering
Project description
datazimmer
Some utility function to help with
- setting up data environments
- simplified dvc pipeline registry
these are used in the project-template
Make sure that python
points to python>=3.8
and you have pip
and git
Functions
Tinker
check out a table or few, with a notebook and some basic analysis to help
Engineer Research
Lookahead
- overlapping names convention
- resolve naming confusion with colassigner, colaccessor and table feature / composite type / index base classes
- abstract composite type + subclass of entity class
- import ACT, inherit from it and specify
- importing composite type is impossible now if it contains foreign key :(
- automatic filter for env creation based on foreign key metadata
- add option to infer data type of assigned feature
- can be problematic b/c pandas int/float/nan issue
- sharing functions among projects
- functions specific to processing certain composite / named types
- e.g. function dealing with fitting into a limit in dogshow project 1
- create similar sets of features in a dry way
- detecting reliance of composite type given by assigner
- can wait, as initial import is just the assigner transformed to accessor
- overlapping in entities
- detect / signal the same type of entity
- properly assert importing
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
datazimmer-0.3.1.tar.gz
(61.5 kB
view hashes)
Built Distribution
datazimmer-0.3.1-py3-none-any.whl
(44.0 kB
view hashes)
Close
Hashes for datazimmer-0.3.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ecc333d0e973c9b8de5667e46e99815917a2e17109929ba57cc6d0d44b5bd811 |
|
MD5 | e6ca5173a0387a97ddc82b51c0dcf002 |
|
BLAKE2b-256 | 77897f49182aec424ffa8d0a81f7edd2eaa626f59f746fb5626b855fca781c1a |