Skip to main content

Python package for seamless integration with OneCompute Platform. Streamline job management, workflows, and file operations using intuitive REST APIs. Monitor job progress and efficiently handle file uploads and downloads.

Project description

OneCompute

Python package for integration with the OneCompute cloud platform. Streamline job management, workflows, and file operations over REST APIs. Monitor job progress and efficiently handle file uploads and downloads.

Empower your Python workflows with seamless integration using our advanced OneCompute cloud platform package. Effortlessly manage complex jobs, streamline workflows, and facilitate efficient file operations through our user-friendly REST APIs. Process workflows both locally and on the cloud to optimize performance and resource utilization. Stay on top of job progress with real-time monitoring capabilities and experience hassle-free handling of file uploads and downloads for a truly streamlined cloud computing experience.

Usage

Introduction

This project demonstrates how to run a workflow locally using the OneCompute platform. The provided code snippet utilizes the dnv-oneworkflow Python package to interact with the OneCompute platform and execute a simple workflow locally. The example showcases the setup of the local workflow runtime service and the submission of a job for execution.

Prerequisites

Make sure you have the following prerequisites installed:

  • Python 3.10.x or higher

  • Pip (Python package manager)

  • dnv-oneworkflow Python package for the PythonCommand module.

    Use the following command to install the dnv.oneworkflow package:

    pip install dnv.oneworkflow
    
  • Install the LocalWorkflowRuntimeService using the following command within your Python environment:

    await PackageManager().install_package_async(
        "LocalWorkflowRuntime", "win-x64", PackageManager.Repository.DEV
    )
    

Code

import asyncio
import os

from dnv.onecompute import (
    AutoDeployOption,
    Job,
    LocalWorkflowRuntimeServiceManager,
    OneComputeClient,
    WorkUnit,
)
from dnv.oneworkflow.python_command import PythonCommand


async def run_workflow_locally_async():
    """
    Run a workflow locally using the OneCompute platform.
    """
    # Define constants
    OC_APPS_PATH = os.path.join(os.environ["LOCALAPPDATA"], "OneCompute")
    RUNTIME_SERVICE_PATH = os.path.join(OC_APPS_PATH, "LocalWorkflowRuntime", "wc.exe")
    WORKSPACE_ID = "MyWorkspace"
    SERVICE_NAME = "OneWorkflowWorkerHost"

    # Configure the local workflow runtime service
    workflow_runtime_service = LocalWorkflowRuntimeServiceManager(
        workspace_id=WORKSPACE_ID,
        worker_host_apps_path=OC_APPS_PATH,
        workflow_runtime_executable_path=RUNTIME_SERVICE_PATH,
        console_window_visible=True,
        auto_deploy_option=AutoDeployOption.DEV,
        startup_wait_time=10,
    )

    # Set up the OneCompute client
    url = workflow_runtime_service.workflow_runtime_service_endpoint
    oc_client = OneComputeClient(base_url=url, authenticator=None)

    # Start the local workflow runtime service
    workflow_runtime_service.start_service()

    # Define the Python command for the work unit
    py_cmd = PythonCommand(inline_script="print('Hello OneCompute')")
    work_unit = WorkUnit(py_cmd)
    work_unit.command = SERVICE_NAME

    # Define the job with necessary configurations
    job = Job()
    job.work = work_unit
    job.service_name = SERVICE_NAME
    job.properties = {"OW_WorkspaceId": WORKSPACE_ID}

    # Submit the job and await its termination
    job_monitor = await oc_client.submit_job_async(job)
    await job_monitor.await_job_termination_async()

    # Stop the local workflow runtime service
    workflow_runtime_service.stop_service()


if __name__ == "__main__":
    # Run the main asynchronous function
    asyncio.run(run_workflow_locally_async())

License

MIT

Support

If you encounter any issues, have questions, or want to provide feedback, please get in touch with our support team at software.support@dnv.com. We are committed to continuously improving OneCompute and providing timely assistance to our users.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dnv_onecompute-10.5.0.tar.gz (47.7 kB view details)

Uploaded Source

Built Distribution

dnv_onecompute-10.5.0-py3-none-any.whl (55.3 kB view details)

Uploaded Python 3

File details

Details for the file dnv_onecompute-10.5.0.tar.gz.

File metadata

  • Download URL: dnv_onecompute-10.5.0.tar.gz
  • Upload date:
  • Size: 47.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.13

File hashes

Hashes for dnv_onecompute-10.5.0.tar.gz
Algorithm Hash digest
SHA256 de308891ecf83bf3a80a1795780994ad24d2e8fdfcf0382f931fb7f542d9ef23
MD5 73b00ec3d314bc8be3c532fa0ddbff44
BLAKE2b-256 7aa2c117a383b94342b706c0287bc19954b7a06c70ee76ebff0143ec614b3f03

See more details on using hashes here.

File details

Details for the file dnv_onecompute-10.5.0-py3-none-any.whl.

File metadata

File hashes

Hashes for dnv_onecompute-10.5.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9c17d56e5493cd6250f036a4813c7d756305d0c1d75f852e8b1edba6ba062e0c
MD5 ec1d7240af3bcc8ef76dfc710f791c9a
BLAKE2b-256 cfd1f69731ecc46c6eb96c70d23121585a95a934035cb499a26537c3aef622b8

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page