Skip to main content

Command-line argument parser for pipen.

Project description

pipen-args

Command line argument parser for pipen

Usage

from pipen import Proc, Pipen
from pipen_args import args

class Process(Proc):
    input = 'a'
    input_data = range(10)
    script = 'echo {{in.a}}'

Pipen().run(Process)
> python example.py --help

DESCRIPTION:
  Pipeline description.

USAGE:
  example.py [OPTIONS]

OPTIONAL OPTIONS:
  --profile <STR>                 - The default profile from the configuration
                                    to run the pipeline. This profile will be
                                    used unless a profile is specified in the
                                    process or in the .run method of pipen.
                                    Default: default
  --loglevel <AUTO>               - The logging level for the main logger, only
                                    takes effect after pipeline is initialized.
                                    Default: <from config>
  --cache [BOOL]                  - Whether enable caching for processes.
                                    Default: <from config>
  --dirsig <INT>                  - The depth to check the Last Modification
                                    Time of a directory.
                                    Since modifying the content won't change its
                                    LMT.
                                    Default: <from config>
  --error_strategy <CHOICE>       - How we should deal with job errors.
                                     - ignore: Let other jobs keep running.
                                    But the process is still failing when done.
                                     - halt: Halt the pipeline, other running
                                    jobs will be killed.
                                     - retry: Retry this job on the scheduler
                                    system.
                                    Default: <from config>
  --num_retries <INT>             - How many times to retry the job when failed.
                                    Default: <from config>
  --forks <INT>                   - How many jobs to run simultaneously by the
                                    scheduler.
                                    Default: <from config>
  --submission_batch <INT>        - How many jobs to submit simultaneously to
                                    the scheduler system.
                                    Default: <from config>
  --workdir <PATH>                - The workdir for the pipeline.
                                    Default: <from config>
  --scheduler <STR>               - The default scheduler.
                                    Default: <from config>
  --scheduler_opts <JSON>         - The default scheduler options. Will update
                                    to the default one.
                                    Default: <from config>
  --plugins <LIST>                - A list of plugins to only enabled or
                                    disabled for this pipeline.
                                    To disable plugins, use no:<plugin_name>
                                    Default: <from config>
  --plugin_opts <JSON>            - Plugin options. Will update to the default.
                                    Default: <from config>
  --template_opts <JSON>          - Template options. Will update to the
                                    default.
                                    Default: <from config>
  --outdir <PATH>                 - The output directory for the pipeline.
                                    Default: <from config>
  -h, --help                      - Print help information for this command

See more examples in examples/ folder.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pipen-args-0.0.3.tar.gz (4.4 kB view details)

Uploaded Source

Built Distribution

pipen_args-0.0.3-py3-none-any.whl (4.4 kB view details)

Uploaded Python 3

File details

Details for the file pipen-args-0.0.3.tar.gz.

File metadata

  • Download URL: pipen-args-0.0.3.tar.gz
  • Upload date:
  • Size: 4.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.9 CPython/3.9.7 Linux/5.8.0-1041-azure

File hashes

Hashes for pipen-args-0.0.3.tar.gz
Algorithm Hash digest
SHA256 2e9a857bcb7cbb718ae726cfb6db5f37b30a975a41203bd3fd273ddc3061c5e9
MD5 e467aad404d13b1d805e26a1474c6a66
BLAKE2b-256 abcb772877730f27aa5403bd74832f9df56842a05755142260c7ff5f652a815c

See more details on using hashes here.

File details

Details for the file pipen_args-0.0.3-py3-none-any.whl.

File metadata

  • Download URL: pipen_args-0.0.3-py3-none-any.whl
  • Upload date:
  • Size: 4.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.9 CPython/3.9.7 Linux/5.8.0-1041-azure

File hashes

Hashes for pipen_args-0.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 2591261e21a18b5ff7ffae6631635e2719499ea78ea2afcac436877cb328d34d
MD5 61124963aeb0d24f9b577fa9e68ca2dd
BLAKE2b-256 433bed00054f049a08b3415d5ff31f38d987ce12a0ecc87aca6208af3c38a8f6

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page