Skip to main content

Popsink transformer

Project description

Transformer Library

This library provides a set of tools to transform Avro schemas into various formats such as JSON schema, SQL for Apache Flink, and PostgreSQL SQL. Additionally, it can transform data from these formats back into Avro schemas. Whether you're working with Avro schemas in your data pipeline or database schema, this library aims to simplify the conversion process for you.

Features

  • Convert Avro schema to JSON schema.
  • Generate SQL statements for Apache Flink based on Avro schema.
  • Generate PostgreSQL SQL statements based on Avro schema.

Usage

Here's a quick guide on how to use the library:

1. Convert Avro Schema to JSON Schema

transformer = Transformer(from_source=avro_schema)
json_schema = transformer.avro_to_json.convert()
print(json_schema)

2. Generate SQL for Apache Flink

transformer = Transformer(
    from_source=avro_schema,
    sql_type=SqlType.FLINK,
)
flink_sql = transformer.avro_to_sql.convert()
print(flink_sql)

3. Generate PostgreSQL SQL

transformer = Transformer(
    from_source=avro_schema,
    sql_type=SqlType.POSTGRES,
)
postgres_sql = transformer.avro_to_sql.convert()
print(postgres_sql)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

popsink_transformer-1.1.0.tar.gz (4.3 kB view details)

Uploaded Source

Built Distribution

popsink_transformer-1.1.0-py3-none-any.whl (6.0 kB view details)

Uploaded Python 3

File details

Details for the file popsink_transformer-1.1.0.tar.gz.

File metadata

  • Download URL: popsink_transformer-1.1.0.tar.gz
  • Upload date:
  • Size: 4.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.1 CPython/3.10.5 Darwin/23.3.0

File hashes

Hashes for popsink_transformer-1.1.0.tar.gz
Algorithm Hash digest
SHA256 5190fb32a03a77ab885db02edc80b8ff756fa47e2386e0093c34e805e454f7f7
MD5 78e8e0873ab26304885de66bf30ac01e
BLAKE2b-256 dd6fd75202321cd3e0f09eee7ed7c03caf4764a48db81a37b94c3a8336ff3e20

See more details on using hashes here.

File details

Details for the file popsink_transformer-1.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for popsink_transformer-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 cb0e4e43ba738875ce1f0a7da22fb752d1815658253653bf31027cf027185dd2
MD5 532a1d07090845e06cedb81549c20826
BLAKE2b-256 3ab62c60696f4e4115645aa27418b50633ae7d9e38c46bb537da6a1267947bf3

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page