Skip to main content

Command-line argument parser for pipen.

Project description

pipen-args

Command line argument parser for pipen

Usage

from pipen import Proc, Pipen
from pipen_args import args

class Process(Proc):
    input = 'a'
    input_data = range(10)
    script = 'echo {{in.a}}'

Pipen().run(Process)
> python example.py --help

DESCRIPTION:
  Pipeline description.

USAGE:
  example.py [OPTIONS]

OPTIONAL OPTIONS:
  --profile <STR>                 - The default profile from the configuration
                                    to run the pipeline. This profile will be
                                    used unless a profile is specified in the
                                    process or in the .run method of pipen.
                                    Default: default
  --loglevel <AUTO>               - The logging level for the main logger, only
                                    takes effect after pipeline is initialized.
                                    Default: <from config>
  --cache [BOOL]                  - Whether enable caching for processes.
                                    Default: <from config>
  --dirsig <INT>                  - The depth to check the Last Modification
                                    Time of a directory.
                                    Since modifying the content won't change its
                                    LMT.
                                    Default: <from config>
  --error_strategy <CHOICE>       - How we should deal with job errors.
                                     - ignore: Let other jobs keep running.
                                    But the process is still failing when done.
                                     - halt: Halt the pipeline, other running
                                    jobs will be killed.
                                     - retry: Retry this job on the scheduler
                                    system.
                                    Default: <from config>
  --num_retries <INT>             - How many times to retry the job when failed.
                                    Default: <from config>
  --forks <INT>                   - How many jobs to run simultaneously by the
                                    scheduler.
                                    Default: <from config>
  --submission_batch <INT>        - How many jobs to submit simultaneously to
                                    the scheduler system.
                                    Default: <from config>
  --workdir <PATH>                - The workdir for the pipeline.
                                    Default: <from config>
  --scheduler <STR>               - The default scheduler.
                                    Default: <from config>
  --scheduler_opts <JSON>         - The default scheduler options. Will update
                                    to the default one.
                                    Default: <from config>
  --plugins <LIST>                - A list of plugins to only enabled or
                                    disabled for this pipeline.
                                    To disable plugins, use no:<plugin_name>
                                    Default: <from config>
  --plugin_opts <JSON>            - Plugin options. Will update to the default.
                                    Default: <from config>
  --template_opts <JSON>          - Template options. Will update to the
                                    default.
                                    Default: <from config>
  --outdir <PATH>                 - The output directory for the pipeline.
                                    Default: <from config>
  -h, --help                      - Print help information for this command

See more examples in examples/ folder.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pipen-args-0.0.5.tar.gz (4.4 kB view details)

Uploaded Source

Built Distribution

pipen_args-0.0.5-py3-none-any.whl (4.5 kB view details)

Uploaded Python 3

File details

Details for the file pipen-args-0.0.5.tar.gz.

File metadata

  • Download URL: pipen-args-0.0.5.tar.gz
  • Upload date:
  • Size: 4.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.11 CPython/3.10.0 Linux/5.8.0-1042-azure

File hashes

Hashes for pipen-args-0.0.5.tar.gz
Algorithm Hash digest
SHA256 652f554012e9b49362f1dd8aa15b394fbdbdc6d8b14bd39181a8b83d9a9588c1
MD5 bc4cbb99f9f55e506a9d1fc30f331f9c
BLAKE2b-256 a97b2462c85023aba4e2de10dc9d94060f61a47cda67856b73a0190be0d78c79

See more details on using hashes here.

File details

Details for the file pipen_args-0.0.5-py3-none-any.whl.

File metadata

  • Download URL: pipen_args-0.0.5-py3-none-any.whl
  • Upload date:
  • Size: 4.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.11 CPython/3.10.0 Linux/5.8.0-1042-azure

File hashes

Hashes for pipen_args-0.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 b179bb4aae8823391be83d84ef6225fb2d3dc7e26cefc3d8cd25a6526b877a88
MD5 398902cc35b6c5de309f635e20d74d06
BLAKE2b-256 1c695dcae1197b6a5891fcfb0e4a433a4de160584a8223967f1af7cbd8418e8f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page