AzkabanCLI 
A lightweight Azkaban client providing:
A command line interface to run workflows, upload projects, etc.
A convenient and extensible way for building projects.
Sample
Below is a simple configuration file for a project containing a workflow with four pig scripts.
from azkaban import PigJob, Project
from getpass import getuser
PROJECT = Project('sample', root=__file__)
# default options for all jobs
DEFAULTS = {
'user.to.proxy': getuser(),
'param': {
'input_root': 'sample_dir/',
'n_reducers': 20,
},
'jvm.args.mapred': {
'max.split.size': 2684354560,
'min.split.size': 2684354560,
},
}
# list of pig job options
OPTIONS = [
{'pig.script': 'first.pig'},
{'pig.script': 'second.pig', 'dependencies': 'first.pig'},
{'pig.script': 'third.pig', 'param': {'foo': 48}},
{'pig.script': 'fourth.pig', 'dependencies': 'second.pig,third.pig'},
]
for option in OPTIONS:
PROJECT.add_job(option['pig.script'], PigJob(DEFAULTS, option))The examples directory contains another sample project that uses Azkaban properties to build a project with two configurations: production and test, without any job duplication.
Documentation
The full documentation can be found here.
Installation
Using pip:
$ pip install azkaban2 maintainers
Metadata
2 maintainers
Release files for azkaban 0.6.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| azkaban-0.6.3.tar.gz | 21.9 kB | Details |
Release files / azkaban-0.6.3.tar.gz
| Download URL | azkaban-0.6.3.tar.gz |
|---|---|
| Size | 21.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
820ac98c2362a9dcacb448794bf3e3b9f4c04c5108c8b28bdf7f6dff1ac824ad
|
|
BLAKE2b-256 checksum How to use checksums |
10e5583b7b23daefc2353ad4ddc08355fff84c180dc0b7d0d40c54fac211b9f6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
