Skip to main content

S3 loader for mkpipe.

Project description

MkPipe

MkPipe is a modular, open-source ETL (Extract, Transform, Load) tool that allows you to integrate various data sources and sinks easily. It is designed to be extensible with a plugin-based architecture that supports extractors, transformers, and loaders.

Documentation

For more detailed documentation, please visit the GitHub repository.

License

This project is licensed under the Apache 2.0 License - see the LICENSE file for details.

mkpipe_project.yaml Variables

...
  connections:
    destination:
      bucket_name: xxx 
      s3_prefix: xxx # optional
      aws_access_key: "xxx"
      aws_secret_key: "xxx"
...

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mkpipe_loader_s3-0.2.0.tar.gz (7.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mkpipe_loader_s3-0.2.0-py3-none-any.whl (8.7 kB view details)

Uploaded Python 3

File details

Details for the file mkpipe_loader_s3-0.2.0.tar.gz.

File metadata

  • Download URL: mkpipe_loader_s3-0.2.0.tar.gz
  • Upload date:
  • Size: 7.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.13

File hashes

Hashes for mkpipe_loader_s3-0.2.0.tar.gz
Algorithm Hash digest
SHA256 da5afaf3125bdf83844aa57a18dbb312c06386da1afee8d769f770e98d1f8787
MD5 136ee7eee365217d4124aac185b35c05
BLAKE2b-256 8485aa52fe5b84e8b6c60c209026a091401fabd1f1d46ddf6aa0ac9e8fed2226

See more details on using hashes here.

File details

Details for the file mkpipe_loader_s3-0.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for mkpipe_loader_s3-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 e56c4efeed9e2abf685acb390f7ee682e8d7bcbc28ff4e628da159610a93e7ed
MD5 94a547bf30b0463a4368cd92ad9dae1e
BLAKE2b-256 e5e02a2d0bf7156c0815eb4d65aba72588a2ced4bbeb77c0450c2166b5cd1806

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page