Skip to main content

A comprehensive library designed to support all major industrial automation protocols within the Databricks ecosystem.

Project description

Databricks Industrial Automation Suite (Databricks Free Edition Hackathon)

Overview

The Databricks Industrial Automation Suite is a comprehensive library designed to support all major industrial automation protocols within the Databricks ecosystem. It enables seamless integration, data exchange, and control across diverse industrial systems, helping enterprises unify and modernize their operational technology (OT) and IT workflows.


Supported Protocols

Protocol Status
OPC UA ✅ Supported
Matter ⬜ Planned
Modbus TCP ⬜ In Progress
HART Communication Protocol ⬜ Planned
MQTT ⬜ Planned

Getting Started

Installation (User Mode)

To install the published package:

%pip install databricks-industrial-automation-suite

Development Setup (Build & Install Locally)

If you want to develop, test, or contribute to the project locally, follow these steps:

Clone the repository

git clone https://github.com/yourusername/databricks-industrial-automation-suite.git
cd databricks-industrial-automation-suite

Install dependencies using Poetry

If you use Poetry (recommended):

poetry install

This creates a virtual environment and installs all dependencies automatically.

To enter that environment:

poetry shell

Build the package

poetry build

This generates distributable files under dist/:

dist/
 ├── databricks_industrial_automation_suite-0.1.0.tar.gz
 └── databricks_industrial_automation_suite-0.1.0-py3-none-any.whl

Install the built package locally

Option 1 — Install from wheel:

pip install dist/databricks_industrial_automation_suite-0.1.0-py3-none-any.whl

Option 2 — Editable install for live code updates:

pip install -e .

Test the installation

Try importing the library or running example scripts:

python
>>> from databricks_industrial_automation_suite.integrations.opcua import OPCUAClient
>>> print("Library loaded successfully!")

Or execute one of the included examples:

python examples/browse_child_nodes.py

Rebuild cleanly (optional)

If you need a fresh build:

rm -rf dist build *.egg-info
poetry build

(Optional) Local virtual environment test

You can also test the install in a clean environment:

python3 -m venv .venv
source .venv/bin/activate
pip install dist/*.whl

Usage Highlights

  • Native OPC UA client connection support (streaming, browsing, and security).
  • Modular, extensible architecture for upcoming industrial protocols.
  • Designed for scalability, observability, and Databricks integration.

Contribution

This suite is under active development. We welcome contributions of:

  • New protocol integrations
  • Documentation improvements
  • Bug fixes or performance enhancements

Please open issues or pull requests on the GitHub repository.


Additional Resources

  • Certificate Management: Use tools like XCA to manage secure client certificates.

  • Testing: You can run an OPC UA demo server locally via Docker:

    docker run -d -p 4840:4840 ghcr.io/falk-werner/opcua-server:latest
    

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

databricks_industrial_automation_suite-0.0.3.tar.gz (13.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file databricks_industrial_automation_suite-0.0.3.tar.gz.

File metadata

File hashes

Hashes for databricks_industrial_automation_suite-0.0.3.tar.gz
Algorithm Hash digest
SHA256 bbb1bc5fb7ece7e5a795b1b176e911eca288eb45a0055fcc01c94079a36ddf28
MD5 a79acafacf4bc2dfd8decb71d013ec69
BLAKE2b-256 625f07c7b2ea48a7ed7fe843f4384e8555731382ae490db60049c89f488c93be

See more details on using hashes here.

File details

Details for the file databricks_industrial_automation_suite-0.0.3-py3-none-any.whl.

File metadata

File hashes

Hashes for databricks_industrial_automation_suite-0.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 1fdd83850b64bd14e0425afd00431eae50b873291f677b30f7fd057e27244fa3
MD5 211f211db8bfa1be74b0b9b57c6f7ecd
BLAKE2b-256 e272e1eda6c62d9a65663d5d6a3a8c493e858a947849b6a19fd1c290d3cd5a55

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page