declarative data migration and transformation package
Data-migrator (version 0.6.2) is a simple data-migration package for python lovers.
Data-migrator is a declarative DSL for table driven data transformations, set up as an open and extensive system. Use this to create data transformations for changing databases as a result of changing code, initial loads to datalakes (it contains a Kinesis provider)and more.
Data-migrator assumes data is extracted and loaded with client access.
$ mysql source_db -E 'select id,a,b from table' -B | python my_filter.py | mysql target_db
It than offers a wide range of primitives with default settings to build complex transformations fast, readable and extendable
from data_migrator import models, transform class Result(models.Model): id = models.IntField(pos=0) # keep id uuid = models.UUIDField() # generate new uuid4 field a = models.StringField(pos=1, default='NO_NULL', max_length=5, nullable='NULL', replacement=lambda x:x.upper()) b = models.StringField(pos=2, name='my_b') if __name__ == "__main__": transform.Transformer(models=[Result]).process()
Execute the following command to install data-migrator with pip:
pip install data-migrator
See the Installation Instructions in Documentation for more instructions on installing, upgrading, and uninstalling data-migrator.
The project is maintained at GitHub.
Release history Release notifications | RSS feed
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Hashes for data_migrator-0.6.2-py2.py3-none-any.whl