luigi-monkey-patch

Luigi is a Python (2.7, 3.3, 3.4, 3.5) package that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, handling failures, command line integration, and much more.

Current Luigi has some issues in s3 file iteration in production. When the file is too large, Amazon s3 would tend to disconnect first. Any application should support retry based on current status to aquire the whole part. This project add this part for luigi s3 file iteration feature.

Getting Started

Run pip install luigi_monkey_patch to install the latest stable version from Pypi. Documentation and any issues are hosted here.

Modified Functions

luigi.s3.ReadableS3File.close
luigi.s3.ReadableS3File.__iter__

Authors

Luigi was built at Spotify. This patch is done by Zenix Huang.

Metadata

Release files for luigi-monkey-patch 0.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for luigi-monkey-patch 0.0.1
File	Size	Uploaded
luigi_monkey_patch-0.0.1.tar.gz	6.6 kB	Jan 12, 2017	Details

Built distribution (wheel)

Table of built distributions (wheels) for luigi-monkey-patch 0.0.1
File	Interpreter	ABI	Platform	Reset
luigi_monkey_patch-0.0.1-py2-none-any.whl 4.6 kB Jan 12, 2017	Python 2	none	any	Details

Total release size: 11.2 kB

Release files / luigi_monkey_patch-0.0.1.tar.gz

Download URL	luigi_monkey_patch-0.0.1.tar.gz
Size	6.6 kB
Tags	Source
SHA-256 checksum How to use checksums	`705c77cc8b7b4281916a3c73bda67c414dc32c4fad0a2f7cb94aa30ea356e255`
BLAKE2b-256 checksum How to use checksums	`a606cd4ac1c16974268035b151dc1dec7f31c801cca0f5bd158f228d3bc527b7`
Upload date	Jan 12, 2017
Uploaded using Trusted Publishing? What is trusted publishing?	No

Release files / luigi_monkey_patch-0.0.1-py2-none-any.whl

Download URL	luigi_monkey_patch-0.0.1-py2-none-any.whl
Size	4.6 kB
Tags	Python 2
SHA-256 checksum How to use checksums	`11a02cbfe5da836e1616c1c1aa54f6b18f7d87dc00f2a43f0dcc14ae7a7a6e68`
BLAKE2b-256 checksum How to use checksums	`ea392da8ef86c93666d3d21cf8862ba10d3739bfd9d904e16b505b3e45b3cf8f`
Upload date	Jan 12, 2017
Uploaded using Trusted Publishing? What is trusted publishing?	No

Release history Release notifications | RSS feed

This release

0.0.1 This release

Jan 12, 2017 2 release files

luigi-monkey-patch 0.0.1