Skip to main content

Syncmaster REST API + scheduler + Worker

Project description

Data.SyncMaster logo

Repo Status Docker image PyPI PyPI License PyPI Python Version Documentation Build Status Coverage pre-commit.ci

What is Data.SyncMaster?

Data.SyncMaster is as no-code ETL tool for transferring data between databases and file systems. List of currently supported connections:

  • Apache Hive

  • Clickhouse

  • Iceberg (REST Catalog + S3)

  • MSSQL

  • MySQL

  • Oracle

  • Postgres

  • FTP

  • FTPS

  • HDFS

  • S3

  • Samba

  • SFTP

  • WebDAV

Based on onETL and Apache Spark.

Goals

  • Make transferring data between databases and file systems as simple as possible

  • Provide a lot of builtin connectors to transfer data in heterogeneous environment

  • RBAC and multitenancy support

Non-goals

  • No streaming support for now, only batch operations

  • This is not a change data capture (CDC) solution

Documentation

See https://syncmaster.readthedocs.io

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data_syncmaster-0.3.4.tar.gz (94.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

data_syncmaster-0.3.4-py3-none-any.whl (193.5 kB view details)

Uploaded Python 3

File details

Details for the file data_syncmaster-0.3.4.tar.gz.

File metadata

  • Download URL: data_syncmaster-0.3.4.tar.gz
  • Upload date:
  • Size: 94.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for data_syncmaster-0.3.4.tar.gz
Algorithm Hash digest
SHA256 879ba906f3bc4ff1651c6eb10df6479b001292dbe2b2086b51051db3f2e3140f
MD5 ee2cf61a3741bdb1530b2ee1e2e68597
BLAKE2b-256 2d676cafe66894c1ac46eed6566b610d193f70a84995b25ced274eaa77147e6e

See more details on using hashes here.

Provenance

The following attestation bundles were made for data_syncmaster-0.3.4.tar.gz:

Publisher: release.yml on MTSWebServices/syncmaster

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file data_syncmaster-0.3.4-py3-none-any.whl.

File metadata

  • Download URL: data_syncmaster-0.3.4-py3-none-any.whl
  • Upload date:
  • Size: 193.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for data_syncmaster-0.3.4-py3-none-any.whl
Algorithm Hash digest
SHA256 3f82f398207475d26a7fd76fb40d8927f5592c93def29a44ece71aeb347f8866
MD5 9231ca9252c55766a3a04b0054754b24
BLAKE2b-256 b3d89d8b1de7422ca7602b6493f18311dde4aceaa780ea59a571ab0d1b5ed16d

See more details on using hashes here.

Provenance

The following attestation bundles were made for data_syncmaster-0.3.4-py3-none-any.whl:

Publisher: release.yml on MTSWebServices/syncmaster

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page