Data-migrator (version 0.6.2) is a simple data-migration package for python lovers.
Data-migrator is a declarative DSL for table driven data transformations, set up as an open and extensive system. Use this to create data transformations for changing databases as a result of changing code, initial loads to datalakes (it contains a Kinesis provider)and more.
Example
Data-migrator assumes data is extracted and loaded with client access.
$ mysql source_db -E 'select id,a,b from table' -B | python my_filter.py | mysql target_dbIt than offers a wide range of primitives with default settings to build complex transformations fast, readable and extendable
from data_migrator import models, transform
class Result(models.Model):
id = models.IntField(pos=0) # keep id
uuid = models.UUIDField() # generate new uuid4 field
a = models.StringField(pos=1, default='NO_NULL', max_length=5, nullable='NULL', replacement=lambda x:x.upper())
b = models.StringField(pos=2, name='my_b')
if __name__ == "__main__":
transform.Transformer(models=[Result]).process()Installation
Execute the following command to install data-migrator with pip:
pip install data-migrator
See the Installation Instructions in Documentation for more instructions on installing, upgrading, and uninstalling data-migrator.
The project is maintained at GitHub.
Support and contribute
Questions, comments, bug reports and especially tested patches may be submitted directly to the issue tracker.
Everyone interacting with this codebase, issue trackers, chat rooms, and mailing lists is expected to follow the Code of Conduct.
1 maintainer
Metadata
1 maintainer
Release files for data-migrator 0.6.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| data-migrator-0.6.2.tar.gz | 50.3 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| data_migrator-0.6.2-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Total release size: 87.5 kB
Release files / data-migrator-0.6.2.tar.gz
| Download URL | data-migrator-0.6.2.tar.gz |
|---|---|
| Size | 50.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
f1e7f908aaf70c509b0b567281f861047c92c41606e560c09280c1fc817fee11
|
|
BLAKE2b-256 checksum How to use checksums |
0d4fec203c44e6f4b0ffcf829961893156c5ae086e6ed1444fd4780384a5a53a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / data_migrator-0.6.2-py2.py3-none-any.whl
| Download URL | data_migrator-0.6.2-py2.py3-none-any.whl |
|---|---|
| Size | 37.2 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
51063b3ae01e837cf3ee5adbfbf73fb1409cf74f0a97c75ed50de1af8b9cf639
|
|
BLAKE2b-256 checksum How to use checksums |
66f4b8a3a568e2b522324537ea8658890120756b380bad35b6d2c1e3b77ea1a1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Security for data-migrator 0.6.2
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
