A comprehensive library designed to support all major industrial automation protocols within the Databricks ecosystem.
Project description
Databricks Industrial Automation Suite (Databricks Free Edition Hackathon)
Overview
The Databricks Industrial Automation Suite is a comprehensive library designed to support all major industrial automation protocols within the Databricks ecosystem. It enables seamless integration, data exchange, and control across diverse industrial systems, helping enterprises unify and modernize their operational technology (OT) and IT workflows.
Supported Protocols
| Protocol | Status |
|---|---|
| OPC UA | ✅ Supported |
| Matter | ⬜ Planned |
| Modbus TCP | ⬜ In Progress |
| HART Communication Protocol | ⬜ Planned |
| MQTT | ⬜ Planned |
Getting Started
Installation (User Mode)
To install the published package:
%pip install databricks-industrial-automation-suite
Development Setup (Build & Install Locally)
If you want to develop, test, or contribute to the project locally, follow these steps:
Clone the repository
git clone https://github.com/yourusername/databricks-industrial-automation-suite.git
cd databricks-industrial-automation-suite
Install dependencies using Poetry
If you use Poetry (recommended):
poetry install
This creates a virtual environment and installs all dependencies automatically.
To enter that environment:
poetry shell
Build the package
poetry build
This generates distributable files under dist/:
dist/
├── databricks_industrial_automation_suite-0.1.0.tar.gz
└── databricks_industrial_automation_suite-0.1.0-py3-none-any.whl
Install the built package locally
Option 1 — Install from wheel:
pip install dist/databricks_industrial_automation_suite-0.1.0-py3-none-any.whl
Option 2 — Editable install for live code updates:
pip install -e .
Test the installation
Try importing the library or running example scripts:
python
>>> from databricks_industrial_automation_suite.integrations.opcua import OPCUAClient
>>> print("Library loaded successfully!")
Or execute one of the included examples:
python examples/browse_child_nodes.py
Rebuild cleanly (optional)
If you need a fresh build:
rm -rf dist build *.egg-info
poetry build
(Optional) Local virtual environment test
You can also test the install in a clean environment:
python3 -m venv .venv
source .venv/bin/activate
pip install dist/*.whl
Usage Highlights
- Native OPC UA client connection support (streaming, browsing, and security).
- Modular, extensible architecture for upcoming industrial protocols.
- Designed for scalability, observability, and Databricks integration.
Contribution
This suite is under active development. We welcome contributions of:
- New protocol integrations
- Documentation improvements
- Bug fixes or performance enhancements
Please open issues or pull requests on the GitHub repository.
Additional Resources
-
Certificate Management: Use tools like XCA to manage secure client certificates.
-
Testing: You can run an OPC UA demo server locally via Docker:
docker run -d -p 4840:4840 ghcr.io/falk-werner/opcua-server:latest
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file databricks_industrial_automation_suite-0.0.3.tar.gz.
File metadata
- Download URL: databricks_industrial_automation_suite-0.0.3.tar.gz
- Upload date:
- Size: 13.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.3.2 CPython/3.11.2 Linux/6.1.0-40-cloud-amd64
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
bbb1bc5fb7ece7e5a795b1b176e911eca288eb45a0055fcc01c94079a36ddf28
|
|
| MD5 |
a79acafacf4bc2dfd8decb71d013ec69
|
|
| BLAKE2b-256 |
625f07c7b2ea48a7ed7fe843f4384e8555731382ae490db60049c89f488c93be
|
File details
Details for the file databricks_industrial_automation_suite-0.0.3-py3-none-any.whl.
File metadata
- Download URL: databricks_industrial_automation_suite-0.0.3-py3-none-any.whl
- Upload date:
- Size: 14.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.3.2 CPython/3.11.2 Linux/6.1.0-40-cloud-amd64
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1fdd83850b64bd14e0425afd00431eae50b873291f677b30f7fd057e27244fa3
|
|
| MD5 |
211f211db8bfa1be74b0b9b57c6f7ecd
|
|
| BLAKE2b-256 |
e272e1eda6c62d9a65663d5d6a3a8c493e858a947849b6a19fd1c290d3cd5a55
|