Skip to main content

Python ETL framework

Project description

https://travis-ci.com/AsyncMicroStack/kigo-etl.svg?branch=master

Declarative ETL engine.

Example of usege

Let’s assume that we have a file named input_1

aaaaaaaaaaaaaaaaaaaaaabbbbbbbbbsome data 11      some data 2Y
aaaaaaaaaaaaaaaaaaaaaabbbbbbbbbsome data 12      some data 2Y
aaaaaaaaaaaaaaaaaaaaaabbbbbbbbbsome data 13      some data 2N
# helloworld.py

from kigo.etl.mapper.mapping import mapping
from kigo.etl.extractors.fabric import Extract


@mapping
class SomeClass:
    data_1 = Extract.TextSlice[31:43]
    data_2 = Extract.TextSlice[49:61]

What we expect is to have 3 instances of classes SomeClass where data_1 and data_2 will have proper ranges of data. For example first instance will look like:

data_1 -> 'some data 11'
data_2 -> 'some data 2Y'

Documentation

Documentation and links to additional resources are available at https://www.asyncstack.org/kigo-etl

License

Apache 2.0. See LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kigo-etl-0.0.8.tar.gz (13.4 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page