Lightweight command line interface (CLI) for Azkaban:
Define jobs from a single python file
Build projects and upload to Azkaban from the command line
Integration is meant to be as transparent as possible:
No additional folders and files
No imposed project structure
Installation
Using pip:
$ pip install azkabanQuickstart
We first create a file to define our project. Let’s call it jobs.py,
although any name would work.
In this example, we add a single job and file:
from azkaban import Job, Project
project = Project('foo')
project.add_job('bar', Job({'type': 'command', 'command': 'echo "Hello!"'}))
project.add_file('bax.jar')
if __name__ == '__main__':
project.main()From the command line we can now run python jobs.py --help to view the
list of all available options (build, upload, etc.). E.g. the
following command will create the archive foo.zip containing all the
project’s jobs and dependency files:
$ python jobs.py build foo.zipMore
Aliases
To avoid having to enter the server’s URL on every upload (or hard-coding it
into our project’s configuration file, ugh), we can define aliases in
~/.azkabanrc:
[foo]
url = http://url.to.foo.server:port
[bar]
url = http://url.to.bar.server:portWe can now upload directly to each of these URLs with the shorthand:
$ python jobs.py upload -a fooThis has the added benefit that we won’t have to authenticate on every upload. The session ID is cached and reused for later connections.
Pig jobs
A PigJob class is provided, which automatically sets the job type and
adds the corresponding script file to the project.
from azkaban import PigJob
project.add_job('baz', PigJob('/.../baz.pig', {'dependencies': 'bar'}))Customization
Any valid python code can go inside the jobs configuration file. This includes
using loops to add jobs, subclassing the base Job class to better suit
a project’s needs…
2 maintainers
Metadata
2 maintainers
Release files for azkaban 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| azkaban-0.1.0.tar.gz | 5.7 kB | Details |
Release files / azkaban-0.1.0.tar.gz
| Download URL | azkaban-0.1.0.tar.gz |
|---|---|
| Size | 5.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
0d34a3ff5c24fa79422221dc3ff7ed2dec158a017d0a31d271f3c8bd903bcc99
|
|
BLAKE2b-256 checksum How to use checksums |
123c0128465ccee895767b61ac7781a1c302099619bb9a5c9bd3ad9fe797f4f1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
