Skip to main content

Syncmaster REST API + scheduler + Worker

Project description

Data.SyncMaster logo

Repo Status Docker image PyPI PyPI License PyPI Python Version Documentation Build Status Coverage pre-commit.ci

What is Data.SyncMaster?

Data.SyncMaster is as no-code ETL tool for transferring data between databases and file systems. List of currently supported connections:

  • Apache Hive

  • Clickhouse

  • Iceberg (REST Catalog + S3)

  • MSSQL

  • MySQL

  • Oracle

  • Postgres

  • FTP

  • FTPS

  • HDFS

  • S3

  • Samba

  • SFTP

  • WebDAV

Based on onETL and Apache Spark.

Goals

  • Make transferring data between databases and file systems as simple as possible

  • Provide a lot of builtin connectors to transfer data in heterogeneous environment

  • RBAC and multitenancy support

Non-goals

  • No streaming support for now, only batch operations

  • This is not a change data capture (CDC) solution

Documentation

See https://syncmaster.readthedocs.io

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data_syncmaster-0.3.3.tar.gz (94.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

data_syncmaster-0.3.3-py3-none-any.whl (193.8 kB view details)

Uploaded Python 3

File details

Details for the file data_syncmaster-0.3.3.tar.gz.

File metadata

  • Download URL: data_syncmaster-0.3.3.tar.gz
  • Upload date:
  • Size: 94.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for data_syncmaster-0.3.3.tar.gz
Algorithm Hash digest
SHA256 46cc62b6c5fd03a72777a32f4ec8a73e75a23300329f5853306615f6a67c3f10
MD5 6b885c827aa2633e0f6a5c69127cb0d9
BLAKE2b-256 94b413a852c7986d537bd8f1cd72342056a8da8d5e0d1c30815aff624ce95b76

See more details on using hashes here.

Provenance

The following attestation bundles were made for data_syncmaster-0.3.3.tar.gz:

Publisher: release.yml on MTSWebServices/syncmaster

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file data_syncmaster-0.3.3-py3-none-any.whl.

File metadata

  • Download URL: data_syncmaster-0.3.3-py3-none-any.whl
  • Upload date:
  • Size: 193.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for data_syncmaster-0.3.3-py3-none-any.whl
Algorithm Hash digest
SHA256 19d76e32d9f47df36bb0f1b632ec2ee50e8af1cf90d98c0d68156d3e1d234863
MD5 c89fbcaf3cc803b9604e53d5f9ca2db6
BLAKE2b-256 e0fc15727ea54d1c0b40e13bc308a0c989fe96e145eb12bf78cabd1239cf7dda

See more details on using hashes here.

Provenance

The following attestation bundles were made for data_syncmaster-0.3.3-py3-none-any.whl:

Publisher: release.yml on MTSWebServices/syncmaster

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page