should make things more reproducible
Project description
DBIS Pipeline
This pipline can be used to run analyses in a structured way.
Usage
the user writes a minimal configuration file which contains only the following information:
- "how do I get the data?", by providing a dataloader
- "what to do with the data?", by providing a scikit pipeline
- "what to do with the result?", by providing output handlers.
Please have a look at the examples for more information.
Requirements
pipenv
everything else should be installed by pipenv.
Installation
- Create a fresh directory.
- In that directory, call
pipenv install dbispipeline
This call will install a virtual environment as well as all dependencies. - Write your configuration(s)
- call
pipenv run python -m dbispipeline <yourconfigurationfile.py>
Enjoy!
Configuration
The framework look in multiple directories for its configuration files.
/usr/local/etc/dbispipeline.ini
used for system wide default.$HOME/.config/dbispipeline.ini
used for user specific configurations../dbispipeline.ini
for project sepcifig configurations.
And example configuration file looks like this:
[database]
# url to your postgres database
host = your.personal.database
# your database user name
user = user
# port of your postgres database, default = 5432
# port = 5432
# password of your database user
password = <secure-password>
# database to use
database = pipelineresults
# table to be used
result_table = my_super_awesome_results
[project]
# this will be stored in the database
name = dbispipeline-test
[mail]
# email address to use as sender
sender = botname@yourserver.com
# recipient. This should probably be set on a home-directory-basis.
recipient = you@yourserver.com
# smtp server address to use
smtp_server = smtp.yourserver.com
# use smtp authentication, default = no
# authenticate = no
# username for smtp authentication, required if authenticate = yes
# username = foo
# password for smtp authentication, required if authenticate = yes
# password = bar
# port to use for smtp server connection, default = 465
# port = 465
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dbispipeline-0.1.6.tar.gz
(26.4 kB
view details)
Built Distribution
File details
Details for the file dbispipeline-0.1.6.tar.gz
.
File metadata
- Download URL: dbispipeline-0.1.6.tar.gz
- Upload date:
- Size: 26.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | a4d041c54d13b5224a41eb6d485a0a0ed37bf2e13e71d56ef7d0dd2267a2edbe |
|
MD5 | 47be4c4c24abb6a88fd83abe0cbefb58 |
|
BLAKE2b-256 | b1e88269a51769d58eb09e5b88b480195a3fdb5f7ebef5960f7a946507b3beb5 |
File details
Details for the file dbispipeline-0.1.6-py3-none-any.whl
.
File metadata
- Download URL: dbispipeline-0.1.6-py3-none-any.whl
- Upload date:
- Size: 40.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 03061235714b5f23354b2f5f3049bd7b7c6e3bf01cb159942551652244c9c456 |
|
MD5 | ff2dfe5447b8d55d3353de109a66df1d |
|
BLAKE2b-256 | ad8d1d38f2bdf925dec4cf72f53afd9285c1246608190ce4e355de91a9812c2b |