Skip to main content

Data modeling managing and transforming data

Project description

|PyPI version| |Docs badge| |License|

******
popEtl
******

popEtl created for modeling and implementing any data integration project- if it is small or large amount of data,
relational database or cloud APIs, Sql or no sql, data cleansing or modeling algorthims - popEtl aims to give a
single platfrom that can model any data strucure, load data from one source to another and be able to maintain all
required changes that any integration project deal in fast and clean manner
The project started to be build becouse we are lazy and we like automation any we hate mainatance !!

Read more about popEtl at http://www.biSkilled.com (marketing) or at `popEtl documnatation <https://readthedocs.org/projects/popeye-etl/>`_

Installation
===========
`download from GitHub <https://github.com/biskilled/popEtl>`_ or intall by using ``pip``


Roadmap
=======

We would like to create a platfrom that will enable to design, implement and maintance and data integration project such as:
* Any REST API connectivity from any API to any API using simple json maping
* Any Relational data base connectivity using json mapping
* Any Non relational storage
* Main platfrom for any middleware business logic - from sample if-than-else up to statistics algorithms using ML and DL algorithms
* Enable Real time and schedlued integration

We will extend our connectors and Meta-data manager accordingly.

Cuurent supporting features
===========================

* APIs : salesforce
* RMDBs : sql-server, access, oracle, vertice, mySql
* middleware : column reansformation and simple data cleansing
* DBs : mongoDb
* Batch : Using external scheduler currentltly .....
* onLine : Needs to be implemented .....

Authors
=======

popEtl was created by `Tal Shany <http://www.biskilled.com>`_
(tal@biSkilled.com)
We are looking for contributions !!!

License
=======

GNU General Public License v3.0

See `COPYING <COPYING>`_ to see the full text.

.. |PyPI version| image:: https://img.shields.io/pypi/v/popEtl.svg
:target: https://github.com/biskilled/popEtl
.. |Docs badge| image:: https://img.shields.io/badge/docs-latest-brightgreen.svg
:target: https://readthedocs.org/projects/popeye-etl/
.. |License| image:: https://img.shields.io/badge/license-GPL%20v3.0-brightgreen.svg
:target: COPYING
:alt: Repository License

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

popEtl-1.1.4.tar.gz (1.5 MB view details)

Uploaded Source

File details

Details for the file popEtl-1.1.4.tar.gz.

File metadata

  • Download URL: popEtl-1.1.4.tar.gz
  • Upload date:
  • Size: 1.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.18.4 setuptools/28.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.4

File hashes

Hashes for popEtl-1.1.4.tar.gz
Algorithm Hash digest
SHA256 5af33e961f52022cb034faf5eb7d23861edb1a601d98f55d503a9dd9bcb1159c
MD5 a483b9d579581da17d7929f201945a5f
BLAKE2b-256 5d789dda9450ceb93ca99949d5d118139eecd916ca526d70ec6eb86b50ca4c1e

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page