datashack-sdk 0.0.5

No project description provided

Datashack

What is this?

Create AWS big data streaming pipeline with Datashack sdk. For example:

Users = StreamingTable("users")
Users['id'] = Column('string')
Users['age'] = Column('int')
Users['name'] = Column('string')

run datashack plan/apply to see the actual changes or actually applying them to your AWS account.

creates this pipeline:

• Provision Kinesis+Spark+Glue+Iam
• Automate schema evolution
• Tests

Pre-requisites

To work with this project, you will need to have the following software installed on your machine:

• Node.js: You can download and install Node.js from the official website: https://nodejs.org/en/download/

• Python: You can download and install Python from the official website: https://www.python.org/downloads/

• Terraform and CDKTF: These tools are used for defining infrastructure as code. To install them, follow the instructions on the HashiCorp website: https://developer.hashicorp.com/terraform/tutorials/aws-get-started/install-cli. Additionally, you can install the CDKTF CLI by running the following command:

  npm install --global cdktf-cli@latest
  

Make sure to run this command in your terminal or command prompt.

Getting Started

run in your terminal

pip install datashack-sdk
git clone https://github.com/datashack-dev/datashack-sdk-examples
datashack plan ./datashack-sdk-examples/my_app/models

Stay tuned

We are working on a fully funcional beta with many more features. Join here so we can ping you

https://www.datashack.dev/stay-in-touch