Python client for Hadoop® YARN API
Project description
Python client for Apache Hadoop® YARN API
Package documentation: python-client-for-hadoop-yarn-api.readthedocs.org
REST API documentation: hadoop.apache.org
Installation
From PyPI
pip install yarn-api-client
From Anaconda (conda forge)
conda install -c conda-forge yarn-api-client
From source code
git clone https://github.com/toidi/hadoop-yarn-api-python-client.git pushd hadoop-yarn-api-python-client python setup.py install popd
Enabling support for Kerberos/SPNEGO Security
To avoid deployment issues on a non Kerberized environment, the requests_kerberos dependency is optional and needs to be explicit installed in order to enable access to YARN console protected by Kerberos/SPNEGO.
pip install requests_kerberos
Usage
CLI interface
bin/yarn_client --help
alternative
python -m yarn_api_client --help
Programmatic interface
from yarn_api_client import ApplicationMaster, HistoryServer, NodeManager, ResourceManager
Changelog
- 0.3.5 Release
Hotfix release to fix internal signature mismatch
- 0.3.4 Release
More flexible support for discovering Hadoop configuration including multiple Resource Managers when HA is configured
Properly support YARN post response codes
- 0.3.3 Release
Properly set Content-Type in PUT requests
Check for HADOOP_CONF_DIR env variable
- 0.3.2 Release
Make Kerberos/SPNEGO dependency optional
- 0.3.1 Release
Fix cluster_application_kill API
- 0.3.0 Release
Add support for YARN endpoints protected by Kerberos/SPNEGO
Moved to requests package for REST API invocation
Remove http_con property, as connections are now managed by requests package
- 0.2.5 Release
Fixed History REST API
- 0.2.4 Release
Added compatibility with HA enabled Resource Manager
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for yarn_api_client-0.3.5-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3e1ce2f1d94c359ca5691d54f8fbad02be6905ce5d65fe2cee9a7d4b93c75b48 |
|
MD5 | abca6952a029c4fab0887fd29e5d6905 |
|
BLAKE2b-256 | 5c258a5a18405e5a5bd2cee539e2fa0035d12ac4df9d457bc37f1038e457d8be |