Skip to main content

Syncmaster REST API + scheduler + Worker

Project description

Data.SyncMaster logo

Repo Status Docker image PyPI PyPI License PyPI Python Version Documentation Build Status Coverage pre-commit.ci

What is Data.SyncMaster?

Data.SyncMaster is as no-code ETL tool for transferring data between databases and file systems. List of currently supported connections:

  • Apache Hive

  • Clickhouse

  • Iceberg (REST Catalog + S3)

  • MSSQL

  • MySQL

  • Oracle

  • Postgres

  • FTP

  • FTPS

  • HDFS

  • S3

  • Samba

  • SFTP

  • WebDAV

Based on onETL and Apache Spark.

Goals

  • Make transferring data between databases and file systems as simple as possible

  • Provide a lot of builtin connectors to transfer data in heterogeneous environment

  • RBAC and multitenancy support

Non-goals

  • No streaming support for now, only batch operations

  • This is not a change data capture (CDC) solution

Documentation

See https://syncmaster.readthedocs.io

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data_syncmaster-0.3.2.tar.gz (93.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

data_syncmaster-0.3.2-py3-none-any.whl (192.4 kB view details)

Uploaded Python 3

File details

Details for the file data_syncmaster-0.3.2.tar.gz.

File metadata

  • Download URL: data_syncmaster-0.3.2.tar.gz
  • Upload date:
  • Size: 93.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for data_syncmaster-0.3.2.tar.gz
Algorithm Hash digest
SHA256 668eb4fca65f83b3c5d544ca8efe4b7a752145ec781bb5ac00aca8d776e1ceae
MD5 f4b6ce460f24651b51cd4c636f38c607
BLAKE2b-256 35ecb08ceb877e83af5c2e667bff36bd11d2983b9af9847e002fe496fdd9de25

See more details on using hashes here.

Provenance

The following attestation bundles were made for data_syncmaster-0.3.2.tar.gz:

Publisher: release.yml on MTSWebServices/syncmaster

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file data_syncmaster-0.3.2-py3-none-any.whl.

File metadata

File hashes

Hashes for data_syncmaster-0.3.2-py3-none-any.whl
Algorithm Hash digest
SHA256 90ea5bddc5942146cd9cd2be003b57aeebab6ad0fae4463fd56f0ac29428c5b9
MD5 cc7fe391f9840e94d356339b1ff216f4
BLAKE2b-256 33d9400ca22b2dd4443e349cbdb9f2397549e14236d10df30614490eb1af8fa6

See more details on using hashes here.

Provenance

The following attestation bundles were made for data_syncmaster-0.3.2-py3-none-any.whl:

Publisher: release.yml on MTSWebServices/syncmaster

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page