Light-Pipe makes data processing pipeline development quick and painless. It is an extensible, light-weight Python framework with zero non-standard dependencies for data pipelines that scale effortlessly. It abstracts away the implementation details of the pipeline itself, meaning that the developer only has to define the transformations performed within the pipeline on individual units of data.
Pipelines defined using Light-Pipe scale effortlessly, with native support for all forms of concurrency, allowing for the mixing and matching of asynchronous, multi-threaded, and multi-process operations all within a single pipeline. It’s also super fast and efficient, having been used to perform critical geospatial data processing tasks at least an order of magnitude faster than existing systems.
Light-Pipe is released under a BSD-3-Clause License.
1 maintainer
Metadata
1 maintainer
Release files for light-pipe 0.3.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| light-pipe-0.3.1.tar.gz | 8.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| light_pipe-0.3.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 18.1 kB
Release files / light-pipe-0.3.1.tar.gz
| Download URL | light-pipe-0.3.1.tar.gz |
|---|---|
| Size | 8.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
387e8fe563357b03c41c1bc07d2b54c425ef9ce89f9764b5770bb3b650fabb01
|
|
BLAKE2b-256 checksum How to use checksums |
073c4a331449e919f98330ba39ef11e98bb44da0ae54f1630eb6e71c8b678afc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.10.11
|
Release files / light_pipe-0.3.1-py3-none-any.whl
| Download URL | light_pipe-0.3.1-py3-none-any.whl |
|---|---|
| Size | 9.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
2d665f5558a0990a69ab1db8ee9c7723ffa3da21145dcb4295c781459e289a0d
|
|
BLAKE2b-256 checksum How to use checksums |
bb4cb3501ff877aad7c91c0b5fb4daf4bb3f1af04e27928e907122ec0ef86341
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.10.11
|
