Lightweight DataPipeline Documentation
Project description
dbpipe
A lightweight and easy way to manage data pipelines.
Getting Started
pip install dbpipe
Creating a Pipe
from dbpipe import Pipe
pipe = Pipe(
name='DW',
sources=["AdSpend","SocialStats"],
destination="DW",
processfile="Test.py"
)
pipe
Saving a Pipe
pipe.save()
Creating a Schedule
from dbpipe import Schedule
schedule = Schedule(frequency="Daily", start_time="8:00AM")
schedule
Creating a Job
from dbpipe import Job
job = Job('My Job',schedule=schedule,jobs=[pipe])
job
Saving a Job
job.save()
Reading a Pipe
from dbpipe import read_pipe
pipe = read_pipe('pipes/DW.json')
pipe
Reading a Job
from dbpipe import read_job
job = read_job('jobs/My Job.json')
job
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dbpipe-0.1.0.tar.gz
(2.3 kB
view hashes)
Built Distribution
dbpipe-0.1.0-py3-none-any.whl
(2.6 kB
view hashes)