Skip to main content

Python package for seamless integration with OneCompute Platform. Streamline job management, workflows, and file operations using intuitive REST APIs. Monitor job progress and efficiently handle file uploads and downloads.

Project description

OneCompute

Python package for integration with the OneCompute cloud platform. Streamline job management, workflows, and file operations over REST APIs. Monitor job progress and efficiently handle file uploads and downloads.

Empower your Python workflows with seamless integration using our advanced OneCompute cloud platform package. Effortlessly manage complex jobs, streamline workflows, and facilitate efficient file operations through our user-friendly REST APIs. Process workflows both locally and on the cloud to optimize performance and resource utilization. Stay on top of job progress with real-time monitoring capabilities and experience hassle-free handling of file uploads and downloads for a truly streamlined cloud computing experience.

Usage

Introduction

This project demonstrates how to run a workflow locally using the OneCompute platform. The provided code snippet utilizes the dnv-oneworkflow Python package to interact with the OneCompute platform and execute a simple workflow locally. The example showcases the setup of the local workflow runtime service and the submission of a job for execution.

Prerequisites

Make sure you have the following prerequisites installed:

  • Python 3.10.x or higher

  • Pip (Python package manager)

  • dnv-oneworkflow Python package for the PythonCommand module.

    Use the following command to install the dnv.oneworkflow package:

    pip install dnv.oneworkflow
    
  • Install the LocalWorkflowRuntimeService using the following command within your Python environment:

    await PackageManager().install_package_async(
        "LocalWorkflowRuntime", "win-x64", PackageManager.Repository.DEV
    )
    

Code

import asyncio
import os

from dnv.onecompute import (
    AutoDeployOption,
    Job,
    LocalWorkflowRuntimeServiceManager,
    OneComputeClient,
    WorkUnit,
)
from dnv.oneworkflow.python_command import PythonCommand


async def run_workflow_locally_async():
    """
    Run a workflow locally using the OneCompute platform.
    """
    # Define constants
    OC_APPS_PATH = os.path.join(os.environ["LOCALAPPDATA"], "OneCompute")
    RUNTIME_SERVICE_PATH = os.path.join(OC_APPS_PATH, "LocalWorkflowRuntime", "wc.exe")
    WORKSPACE_ID = "MyWorkspace"
    SERVICE_NAME = "OneWorkflowWorkerHost"

    # Configure the local workflow runtime service
    workflow_runtime_service = LocalWorkflowRuntimeServiceManager(
        workspace_id=WORKSPACE_ID,
        worker_host_apps_path=OC_APPS_PATH,
        workflow_runtime_executable_path=RUNTIME_SERVICE_PATH,
        console_window_visible=True,
        auto_deploy_option=AutoDeployOption.DEV,
        startup_wait_time=10,
    )

    # Set up the OneCompute client
    url = workflow_runtime_service.workflow_runtime_service_endpoint
    oc_client = OneComputeClient(base_url=url, authenticator=None)

    # Start the local workflow runtime service
    workflow_runtime_service.start_service()

    # Define the Python command for the work unit
    py_cmd = PythonCommand(inline_script="print('Hello OneCompute')")
    work_unit = WorkUnit(py_cmd)
    work_unit.command = SERVICE_NAME

    # Define the job with necessary configurations
    job = Job()
    job.work = work_unit
    job.service_name = SERVICE_NAME
    job.properties = {"OW_WorkspaceId": WORKSPACE_ID}

    # Submit the job and await its termination
    job_monitor = await oc_client.submit_job_async(job)
    await job_monitor.await_job_termination_async()

    # Stop the local workflow runtime service
    workflow_runtime_service.stop_service()


if __name__ == "__main__":
    # Run the main asynchronous function
    asyncio.run(run_workflow_locally_async())

License

MIT

Support

If you encounter any issues, have questions, or want to provide feedback, please get in touch with our support team at software.support@dnv.com. We are committed to continuously improving OneCompute and providing timely assistance to our users.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dnv_onecompute-11.1.0.tar.gz (47.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dnv_onecompute-11.1.0-py3-none-any.whl (55.3 kB view details)

Uploaded Python 3

File details

Details for the file dnv_onecompute-11.1.0.tar.gz.

File metadata

  • Download URL: dnv_onecompute-11.1.0.tar.gz
  • Upload date:
  • Size: 47.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.13

File hashes

Hashes for dnv_onecompute-11.1.0.tar.gz
Algorithm Hash digest
SHA256 d4116501bffeef2e24fdb115687d2868516462ceeb9d82a96859a5b69a4b8423
MD5 47734e0f0432936a71b66bcafb3ce23f
BLAKE2b-256 2b2ca2259c0f967acf86d6d0941dc8f7651772c1ed58fc7e7ad19412b5ece419

See more details on using hashes here.

File details

Details for the file dnv_onecompute-11.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for dnv_onecompute-11.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3fb9bb4c051773351be0444970dbefca23a725e8e0d1e10e5e332ba9345a2e34
MD5 fc198c34378d8e12c742c2a655b503b2
BLAKE2b-256 590ee89b8eea8e796ce725bfb99f4dbab817639c0843231075dbb02319dd9955

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page