Skip to main content

S3 extractor for mkpipe.

Project description

MkPipe

MkPipe is a modular, open-source ETL (Extract, Transform, Load) tool that allows you to integrate various data sources and sinks easily. It is designed to be extensible with a plugin-based architecture that supports extractors, transformers, and loaders.

Documentation

For more detailed documentation, please visit the GitHub repository.

License

This project is licensed under the Apache 2.0 License - see the LICENSE file for details.

mkpipe_project.yaml Variables

...
  connections:
    source:
      bucket_name: xxx 
      s3_prefix: xxx # optional
      aws_access_key: "xxx"
      aws_secret_key: "xxx"
...

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mkpipe_extractor_s3-0.3.0.tar.gz (8.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mkpipe_extractor_s3-0.3.0-py3-none-any.whl (9.1 kB view details)

Uploaded Python 3

File details

Details for the file mkpipe_extractor_s3-0.3.0.tar.gz.

File metadata

  • Download URL: mkpipe_extractor_s3-0.3.0.tar.gz
  • Upload date:
  • Size: 8.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.13

File hashes

Hashes for mkpipe_extractor_s3-0.3.0.tar.gz
Algorithm Hash digest
SHA256 5e8328acd695e7fd5edafd956678f7d8f0d484edacb9794f7c9f5ff3806893d0
MD5 bfc0b33f74782bfcd3916a447ea2ae4a
BLAKE2b-256 e7a4ea1da754d8734c733c954d2c34120fe2cb6c5df41679df4c914d99f48339

See more details on using hashes here.

File details

Details for the file mkpipe_extractor_s3-0.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for mkpipe_extractor_s3-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 22da7ef2eb3183bf78b914f5df78b19e6c9597f5e82277f9ea0189f3c5c96f00
MD5 431cf929bb158071f97e1fec461636ee
BLAKE2b-256 658caf896de1eddba7fd2b40f2985f943c75d650bb4f1de992b073ba7611c94b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page