An industrial-strength data science toolkits
Project description
## Home Built on popular scientific computing toolkits, aresy aims to make it easy to process large-scale data on a single server. aresy treats the whole data flow as a computation graph, where the input data will be put into placeholders, and you can perform nearly any python-based transformation by extending the graph. aresy was designed with the following principles:
Compatible with python data science ecosystem, such as numpy, pytorch, tensorflow modules.
Able to process cross-type, cross-domain, cross-granularity data simultaneously.
Easy to build a large feature generator, a transformer or even a data loader to feed preprocessed data into deep learning models.
## Installation `shell python setup.py install `
## Package Reference
- aresy.formatting
aresy.formatting.TSVDataLoader
aresy.formatting.TSVPlaceholder
- aresy.preprocessing
aresy.preprocessing.WrangleFloat
aresy.preprocessing.WrangleStr
aresy.preprocessing.WrangleNormalDatetime
- aresy.aggregating
aresy.aggregating.Sum
aresy.aggregating.Mean
aresy.aggregating.Std
aresy.aggregating.Max
aresy.aggregating.Min
aresy.aggregating.Quantile
- aresy.utils
aresy.wrap_outputs_to_json
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file aresy-0.0.8.tar.gz
.
File metadata
- Download URL: aresy-0.0.8.tar.gz
- Upload date:
- Size: 4.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: Python-urllib/3.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 02db450348d8b8e90317fa8ef95f103b334285c912b93580dd7d7b2de1c4f66e |
|
MD5 | ceefeebcb4e852ee3a88980b8ab1085b |
|
BLAKE2b-256 | ce076461153184b413e8b82e89e438381302144c91506a6199afde449e0ccab9 |