Skip to main content

S3 extractor for mkpipe.

Project description

MkPipe

MkPipe is a modular, open-source ETL (Extract, Transform, Load) tool that allows you to integrate various data sources and sinks easily. It is designed to be extensible with a plugin-based architecture that supports extractors, transformers, and loaders.

Documentation

For more detailed documentation, please visit the GitHub repository.

License

This project is licensed under the Apache 2.0 License - see the LICENSE file for details.

mkpipe_project.yaml Variables

...
  connections:
    source:
      bucket_name: xxx 
      s3_prefix: xxx # optional
      aws_access_key: "xxx"
      aws_secret_key: "xxx"
...

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mkpipe_extractor_s3-0.2.1.tar.gz (8.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mkpipe_extractor_s3-0.2.1-py3-none-any.whl (9.2 kB view details)

Uploaded Python 3

File details

Details for the file mkpipe_extractor_s3-0.2.1.tar.gz.

File metadata

  • Download URL: mkpipe_extractor_s3-0.2.1.tar.gz
  • Upload date:
  • Size: 8.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.13

File hashes

Hashes for mkpipe_extractor_s3-0.2.1.tar.gz
Algorithm Hash digest
SHA256 c933c165ed661a0d4815855e39062d26aa4c9e182459c004baf6924a57ef234b
MD5 7ba78aa683a97f69b0b3ae69bc9d0374
BLAKE2b-256 fb5f874e247db678415709aa75ac2ee0ecab080d0684fb7c4aa8b63ba9cbb952

See more details on using hashes here.

File details

Details for the file mkpipe_extractor_s3-0.2.1-py3-none-any.whl.

File metadata

File hashes

Hashes for mkpipe_extractor_s3-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 3b65c3309f4fdf09eec7b33a5cc11c5091f15ca1d53fc25d5f641fcee3eb513b
MD5 fdce79e202001c9cb9e81e029bbf907a
BLAKE2b-256 6d3ffa7ed22e2da3406db8a76ce8f1f4daaa80f22421fc5830d75e0b102f8b94

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page