The AWS Deadline Cloud worker agent can be used to run a worker in an AWS Deadline Cloud fleet
Project description
AWS Deadline Cloud Worker Agent
The AWS Deadline Cloud worker agent can be used to run a worker in an AWS Deadline Cloud fleet. This includes managing the life-cycle of a worker and its assigned work both in the service and on the worker's host.
Deadline Cloud schedules work as worker sessions which are an extension of Open Description (OpenJD) sessions specific to AWS Deadline Cloud. The worker agent initiates session actions, monitors them, and reports the status of running and completed session actions to the service including progress, logs, process exit code, and indicates if the work was canceled or interrupted.
The worker agent behavior follows the AWS Deadline Cloud worker API protocol that specifies the expectation of how the service and workers behave and collaborate through Deadline Cloud's worker APIs.
For guidance on setting up the worker agent for use in a customer-managed fleet, see the "Manage Deadline Cloud customer-managed fleets" topic in the AWS Deadline Cloud User Guide
Compatibility
The worker agent requires Python 3.9 or higher. There are additional platform-specific requirements listed below:
Linux:
- Amazon Linux 2 and 2023 are recommended and tested
sudo
must be installed
Windows:
- Windows Server 2022 is recommended and tested
- Requires CPython implementation of Python
- Python must be installed for all users (e.g. in
C:\Program Files
)
MacOS is intended to be used for testing only and is subject to change.
Versioning
This package's version follows Semantic Versioning 2.0, but is still considered to be in its initial development, thus backwards incompatible versions are denoted by minor version bumps. To help illustrate how versions will increment during this initial development stage, they are described below:
- The MAJOR version is currently 0, indicating initial development
- The MINOR version is currently incremented when backwards incompatible changes are introduced to the public API.
- The PATCH version is currently incremented when bug fixes or backwards compatible changes are introduced to the public API.
Installing program files
Linux
We recommend installing the agent in a Python virtual environment (e.g. using venv
). For
this, run:
# Create venv
python -m venv /opt/deadline/worker
# Activate the virtual environment - you can later type "deactivate" to exit the environment
source /opt/deadline/worker/bin/activate
# Install worker agent program files into the virtual environment
pip install deadline-cloud-worker-agent
Windows
The worker agent runs as a Windows Service which leads to a few installation constraints:
- Python virtual environments are not supported
- Python must be installed for all users
To obtain the program files, run this command in an administrator command-prompt:
pip install deadline-cloud-worker-agent
Setup worker host
The worker host can be prepared to be run using the provided install-deadline-worker
command. This
command performs certain functions to setup the worker host based on arguments provided. The
command performs all worker host setup activities, such as:
- creates an operating system user account (specified by the
--user
argument) on the worker host that the worker will run as.install-deadline-worker
accepts a previously created user. The user defaults todeadline-worker-agent
on Linux anddeadline-worker
on Windows. - creates a job user group (specified by
--group
, defaults todeadline-job-users
) if required. Theinstall-deadline-worker
accepts an existing group. - creates cache, log, and config directories, and an example config file
- [optionally] initializes the config file
- modifies the config file using provided arguments
- [optionally] install/update an operating system service
- [optionally] start the operating system service
NOTE: The install-deadline-worker
command does not support MacOS at this time.
To see the available command-line arguments, run:
On Linux:
Assuming you have installed the worker agent to a Python venv in /opt/deadline/worker
, run:
/opt/deadline/worker/bin/install-deadline-worker --help
On Windows:
Run the following command in an administrator command-prompt:
install-deadline-worker --help
Configuration
State
Running
Setting up the worker host using the install-deadline-worker
command (see "Setup worker host"
above) installs an operating system service. On Linux, this is a systemd service and on Windows this
is a Windows service.
The following commands demonstrate how to manually control the operating system service.
On Linux:
# Start the worker agent
systemctl start deadline-worker
# Stop the worker agent
systemctl stop deadline-worker
# Configure the worker agent to start on boot
systemctl enable deadline-worker
# Configure the worker agent to NOT start on boot
systemctl disable deadline-worker
On Windows:
Using an admin command-prompt:
REM start the service
sc.exe start DeadlineWorker
REM stop the service
sc.exe stop DeadlineWorker
Running Outside of an Operating System Service
NOTE: It is highly recommended to run the worker agent through an OS service in production environments. The OS service automatically handles:
- Restarting the worker agent process if the agent process crashes.
- Starting the worker agent when the host machine starts up.
- Attempting graceful shutdown when the host machine is shutting down.
The worker agent can also be started outside of a service context if required. Run deadline-worker-agent --help
to see a list of supported command line arguments.
NOTE: You must have an AWS region specified in order to run the worker agent from the command line. This can be configured through:
- The
AWS_DEFAULT_REGION
environment variable. - The AWS Configuration File
- Configured manually, or through the command line.
Logging
Contributing
See CONTRIBUTING.md
for information on reporting issues, requesting features, and developer information.
Security
See security issue notifications for more information.
Telemetry
License
This project is licensed under the Apache-2.0 License.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file deadline_cloud_worker_agent-0.27.4.tar.gz
.
File metadata
- Download URL: deadline_cloud_worker_agent-0.27.4.tar.gz
- Upload date:
- Size: 155.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/5.1.1 CPython/3.12.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | ccfd474d1d94a14ec60aef626b6d8acf86585022cfa73fa49faa073bc2c72cce |
|
MD5 | 0a02bc197657b6d09404a8926e0cd87a |
|
BLAKE2b-256 | d171fd454d2f423bf20fb486cf02f46473fdad538e0a390a5dc3b05c43d3135a |
Provenance
The following attestation bundles were made for deadline_cloud_worker_agent-0.27.4.tar.gz
:
Publisher:
release_publish.yml
on aws-deadline/deadline-cloud-worker-agent
-
Statement type:
https://in-toto.io/Statement/v1
- Predicate type:
https://docs.pypi.org/attestations/publish/v1
- Subject name:
deadline_cloud_worker_agent-0.27.4.tar.gz
- Subject digest:
ccfd474d1d94a14ec60aef626b6d8acf86585022cfa73fa49faa073bc2c72cce
- Sigstore transparency entry: 145296576
- Sigstore integration time:
- Predicate type:
File details
Details for the file deadline_cloud_worker_agent-0.27.4-py3-none-any.whl
.
File metadata
- Download URL: deadline_cloud_worker_agent-0.27.4-py3-none-any.whl
- Upload date:
- Size: 191.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/5.1.1 CPython/3.12.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0a17ac02315aa52281eb222cf4448032459d818d45b08e14d5666b634045e135 |
|
MD5 | f1e90e4b250bb3262b5f0ee6356c7362 |
|
BLAKE2b-256 | 90e1f3d0bc329ba2f8ed710af28bfbf74d8021e0b2b8cda500730ccc55a73ece |
Provenance
The following attestation bundles were made for deadline_cloud_worker_agent-0.27.4-py3-none-any.whl
:
Publisher:
release_publish.yml
on aws-deadline/deadline-cloud-worker-agent
-
Statement type:
https://in-toto.io/Statement/v1
- Predicate type:
https://docs.pypi.org/attestations/publish/v1
- Subject name:
deadline_cloud_worker_agent-0.27.4-py3-none-any.whl
- Subject digest:
0a17ac02315aa52281eb222cf4448032459d818d45b08e14d5666b634045e135
- Sigstore transparency entry: 145296577
- Sigstore integration time:
- Predicate type: