Json processing pipeline tools
Project description
Tool for defining dict lists or jsonlines batch processing pipelines.
See tests for usage on the first case. You can also process a jsonlines batch file using the command line tool.
For running tests:
> nosetest3 tests/test_transform.py
Typically you build command line tool in this way:
```
from json_pipeline.transform import TransformScript as JPTransformScript
class TransformScript(JPTransformScript):
PIPELINE = ...
if __name__ == '__main__':
transform = TransformScript()
transform.main()
```
You can skip definition of your subclass. In that case pipeline can be passed via command line.
See tests for usage on the first case. You can also process a jsonlines batch file using the command line tool.
For running tests:
> nosetest3 tests/test_transform.py
Typically you build command line tool in this way:
```
from json_pipeline.transform import TransformScript as JPTransformScript
class TransformScript(JPTransformScript):
PIPELINE = ...
if __name__ == '__main__':
transform = TransformScript()
transform.main()
```
You can skip definition of your subclass. In that case pipeline can be passed via command line.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
json-pipeline-0.1.1.tar.gz
(3.8 kB
view hashes)
Built Distribution
Close
Hashes for json_pipeline-0.1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d4da90f1ade85773835a9ec3981a39cc1282babcc0f9d2d483f16a2da154acbc |
|
MD5 | 6b1437e3d085b24953e1fb25c52169b6 |
|
BLAKE2b-256 | 628179bbeda92c68ed08d8a1442af8334de4f25bfa7482d562aeb3920a96e8da |