Unified hardware reverse engineering framework. Extract all information from any system through signals and data. Unknown protocol discovery, state machine extraction, CRC recovery, security analysis. 16+ protocols, IEEE-compliant measurements.
Project description
Oscura
Workflow automation for hardware reverse engineering. Stop juggling seven different tools to analyze one capture. Oscura chains specialized tools (sigrok, ChipWhisperer, scipy) into unified Python workflows—from oscilloscope files to Wireshark dissectors without manual conversions or context switching.
The Problem
Hardware reverse engineering means juggling specialized tools:
- Export oscilloscope waveforms (vendor-specific formats)
- Convert formats for analysis (sigrok, custom scripts)
- Decode protocols (PulseView, separate decoders)
- Infer unknown protocols (Netzob, manual analysis)
- Reverse checksums (CRC RevEng, separate tool)
- Generate documentation (manual Wireshark dissectors, DBC files)
- Repeat for each new capture
Each step requires different tools, manual file conversions, and context switching. Binary reverse engineering solved this decades ago with integrated platforms (Ghidra, radare2, IDA). Hardware RE remains fragmented.
The Solution
Oscura automates complete workflows in Python:
What We Integrate:
- Protocol decoding via sigrok (UART, SPI, I2C, CAN, etc.)
- Signal processing with scipy/numpy
- Side-channel trace formats (ChipWhisperer)
- Automotive protocols (cantools integration)
What We Add:
- Hypothesis-driven RE workflows with differential analysis and confidence scoring
- Automatic Wireshark dissector generation from inferred protocols
- DBC file generation from raw CAN captures (no manual signal definition)
- Multi-format file loading (Tektronix, Rigol, Sigrok, BLF, PCAP, ChipWhisperer)
- CRC/checksum recovery from message-checksum pairs
- Unified Python API eliminating tool-hopping and format conversions
Value proposition: Write one Python script instead of:
- Exporting from oscilloscope software (vendor GUI)
- Converting formats (sigrok-cli, custom scripts)
- Decoding protocols (PulseView manual selection)
- Inferring message formats (Netzob or manual)
- Recovering checksums (CRC RevEng separate invocation)
- Writing dissectors (manual Lua coding)
- Documenting findings (manual reports)
Quick Start
Installation
# Production use
pip install oscura
# Development (recommended - includes all features)
git clone https://github.com/oscura-re/oscura.git
cd oscura
./scripts/setup.sh
Requirements: Python 3.12+ | Dependencies
Workflow Examples
Reverse engineer unknown protocol (differential analysis):
from oscura.sessions import BlackBoxSession
# Create analysis session with hypothesis tracking
session = BlackBoxSession(name="IoT Device RE")
# Differential analysis: idle vs active states
session.add_recording("idle", "idle.bin")
session.add_recording("button_press", "button.bin")
diff = session.compare("idle", "button_press")
# Automatic field detection with confidence scoring
spec = session.generate_protocol_spec()
print(f"Identified {len(spec['fields'])} protocol fields")
# Export validated Wireshark dissector (Lua)
session.export_results("dissector", "protocol.lua")
Generate automotive DBC from raw CAN captures:
from oscura.automotive.can import CANSession
session = CANSession(name="Vehicle RE")
session.add_recording("idle", "idle.blf")
session.add_recording("accelerate", "accel.blf")
# Statistical stimulus-response analysis
diff = session.compare("idle", "accelerate")
print(f"Changed CAN IDs: {diff.details['changed_ids']}")
# Generate DBC file (signal definitions inferred automatically)
session.export_dbc("vehicle.dbc") # Import into CANalyzer, Vehicle Spy, Wireshark
Recover CRC specification from unknown protocol:
from oscura.inference.crc_reverse import CRCReverser
# Just 4 message-checksum pairs needed
messages = [b"\x01\x02\x03", b"\x04\x05\x06", b"\x07\x08\x09", b"\x0a\x0b\x0c"]
checksums = [0x12, 0x34, 0x56, 0x78]
# Recover complete CRC specification
reverser = CRCReverser(message_bits=8)
crc = reverser.find_crc(list(zip(messages, checksums)))
print(f"Polynomial: 0x{crc.polynomial:02X}")
print(f"Init: 0x{crc.init_value:02X}, XOR out: 0x{crc.xor_out:02X}")
print(f"Standard: {crc.standard_name or 'Custom'}") # Matches CRC-8, CRC-16, etc.
Auto-detect protocol from oscilloscope capture:
import oscura as osc
# Load Tektronix/Rigol waveform
trace = osc.load("mystery_device.wfm")
# Statistical protocol detection (timing, voltage levels, bit patterns)
result = osc.auto_decode(trace)
print(f"Detected {result.protocol}: {len(result.frames)} frames decoded")
6 working examples demonstrating core workflows and analysis patterns.
Core Capabilities
Unique Contributions
| Capability | What We Provide | Why It Matters |
|---|---|---|
| Hypothesis-Driven RE | BlackBoxSession with differential analysis, field detection, confidence scoring, audit trails | Systematic unknown protocol analysis vs manual guesswork |
| DBC Auto-Generation | Statistical CAN signal inference from captures → DBC export | Open-source alternative to Vector CANalyzer ($$$) |
| Wireshark Dissector Generation | Infer protocol → generate validated Lua dissector | End-to-end automation (others require manual YAML specs) |
| Multi-Format File Loading | Oscilloscopes (Tektronix WFM, Rigol), logic analyzers (Sigrok, VCD), automotive BLF | Eliminate format conversion steps |
| Statistical Protocol Auto-Detect | Waveform analysis (timing, voltage, patterns) → protocol identification | Goes beyond sigrok's signal name matching |
| Unified Workflow API | Single Python script: oscilloscope file → decode → infer → export dissector | Replace 7-tool chains with one script |
| CRC Recovery | Message-checksum pairs → polynomial, init, XOR out, reflection | Practical automation (CRC RevEng is more robust for edge cases) |
| Automotive Security Analysis | Stimulus-response correlation, hypothesis testing, UDS/OBD-II decoding | Research-focused (CANToolz covers security, python-can covers low-level) |
| State Machine Extraction (Passive) | RPNI algorithm for passive observation (vs Netzob's active L* requiring oracle) | Different use case from existing tools |
| Evidence-Based Discovery | Confidence scoring, hypothesis tracking, statistical validation, reproducible audit trails | Scientific rigor for research publication |
Integration Capabilities
| Category | Implementation | Best Alternative |
|---|---|---|
| Protocol Decoding | Integrated sigrok decoders (UART, SPI, I2C, CAN, LIN, JTAG, etc.) via Python API | sigrok directly (100+ decoders) |
| Side-Channel Analysis | Load ChipWhisperer traces, basic DPA/CPA implementations | ChipWhisperer (superior capabilities) |
| Signal Processing | IEEE-based measurements using scipy/numpy | scipy.signal directly or MATLAB |
| CAN Parsing | cantools integration for DBC parsing and message encoding | cantools + python-can |
| File Format Conversion | Loaders for 13+ formats with unified API | Vendor software + manual export |
Our philosophy: Integrate best-in-class tools rather than reimplementing them. Add value through workflow automation and novel analysis methods.
When to Use Oscura
Choose Oscura when:
- You need end-to-end workflows (capture → analysis → documentation) in Python
- You're reverse engineering unknown protocols with differential analysis
- You want DBC files generated from CAN captures without CANalyzer ($$$)
- You need Wireshark dissectors generated automatically from inferred protocols
- You're working with multiple oscilloscope/LA formats and want unified API
- You value reproducible research with hypothesis tracking and confidence scoring
Use specialized tools directly when:
- You only need protocol decoding → sigrok has 100+ decoders
- You're doing side-channel attacks → ChipWhisperer is superior
- You only need signal processing → scipy/MATLAB are more optimized
- You need the most robust CRC recovery → CRC RevEng handles edge cases better
- You have vendor-specific needs → vendor tools have more format support
Oscura's sweet spot: Chaining multiple RE steps in scripted workflows with novel hypothesis-driven analysis.
Where This Excels
Security Research
- Protocol reverse engineering with hypothesis tracking and validation
- Automotive ECU security via CAN stimulus-response analysis
- Attack surface mapping through state machine extraction
- Cryptographic implementation validation (use ChipWhisperer for attacks, Oscura for trace analysis workflows)
Right-to-Repair & Modernization
- Document undocumented protocols with generated Wireshark dissectors
- Replicate vintage hardware (1960s-present logic family auto-detection)
- Overcome vendor lock-in through protocol reverse engineering
- Generate interoperable interfaces without vendor cooperation
Academic Research
- Reproducible workflows with evidence tracking and audit trails
- Statistical validation with confidence scoring
- IEEE-based measurements for publishable results (181/1241/1459/2414)
- 22,000+ comprehensive tests, 80%+ coverage ensure reliability
Industrial & Automotive
- CAN bus security research with open-source DBC generation
- Signal integrity validation for high-speed designs
- Component characterization without datasheets
- Compliance testing (EMC, automotive standards)
Built On
Oscura integrates proven open-source tools:
| Component | What We Use | Why |
|---|---|---|
| Protocol Engine | sigrok libsigrokdecode | 100+ mature, community-supported protocol decoders |
| Signal Processing | scipy/numpy | Industry-standard numerical computing |
| Side-Channel Traces | ChipWhisperer formats | De facto standard for side-channel research |
| CAN Protocols | cantools, python-can | Robust CAN message parsing and encoding |
| Testing | pytest, Hypothesis | Property-based testing for algorithm validation |
| Type Safety | mypy | Static type checking (strict mode) |
Our contribution: Unified API + novel hypothesis-driven RE workflows + format handling + export automation.
Technical Foundation
Quality Metrics
Production-ready validation:
- 22,000+ comprehensive tests with property-based validation (Hypothesis)
- 80%+ code coverage with branch coverage enabled
- Pre-commit hooks (format, lint, type check) enforce consistency
- Merge queue CI prevents untested code from landing
- Nightly stress tests validate edge cases and memory usage
- Security scanning (Bandit, Safety) on every commit
View current metrics: CI Dashboard | Coverage Reports
Standards Implementation
We implement measurements based on IEEE specifications:
| Standard | Coverage | Hardware RE Relevance |
|---|---|---|
| IEEE 181 | Pulse timing, rise/fall, overshoot, duty cycle | Protocol physical layer validation |
| IEEE 1241 | SNR, SINAD, THD, SFDR, ENOB | ADC characterization for side-channel analysis |
| IEEE 1459 | Active/reactive power, harmonics, power factor | Power supply profiling, fault injection targets |
| IEEE 2414 | TIE, period jitter, RJ/DJ decomposition, BER | Clock glitch detection, timing attack analysis |
Architecture Principles
Built for extensibility:
- Type-safe: MyPy strict mode, comprehensive type hints
- Modular: Protocol decoders, loaders, and analyzers are plug-and-play
- Memory-efficient: Lazy loading, memory-mapped files, chunked processing (TB-scale datasets)
- Documented: Google-style docstrings, 95% documentation coverage
- Reproducible: Hypothesis tracking, confidence scoring, full audit trails
Learn By Doing
Working Examples
Core functionality demonstrated with working code:
- Side-Channel Analysis - DPA/CPA attacks, trace analysis
- ML Signal Classification - Machine learning for signal identification
- Wireshark Dissector Generation - Auto-generate protocol dissectors
- DBC File Generation - CAN bus DBC export
- LIN Bus Analysis - LIN protocol decoding
- Web Dashboard - Interactive visualization
Run Your First Example
# Install development dependencies
./scripts/setup.sh
# Side-channel analysis demo
python examples/side_channel_analysis_demo.py
# ML signal classification
python examples/ml_signal_classification_demo.py
Command-Line Interface
# Signal characterization
oscura characterize capture.wfm
# Protocol decoding with auto-detection
oscura decode uart_capture.wfm --protocol uart --baud 115200
# Batch processing entire directories
oscura batch '*.wfm' --analysis characterize
# Differential analysis (compare baseline to modified)
oscura compare baseline.wfm modified.wfm
# Interactive REPL for exploration
oscura shell
Why This Exists
Legitimate Use Cases
Hardware reverse engineering serves critical needs across security, repair, modernization, and defense:
Security Research: Vulnerability discovery requires understanding how hardware actually works, not how vendors claim it works. Protocol reverse engineering reveals authentication bypasses. State machine analysis maps attack surfaces.
Right-to-Repair: Proprietary protocols and vendor lock-in prevent owners from fixing their own equipment. Reverse engineering restores agency. Open documentation enables interoperable replacements.
Modernization: Legacy systems run critical infrastructure but use obsolete components. Replication requires extracting specifications from working hardware when documentation is lost or was never public.
National Defense: Intelligence and threat assessment depend on understanding adversary capabilities. Forensic analysis of captured equipment requires comprehensive signal analysis and protocol decoding.
Academic Research: Understanding existing systems informs better designs. Teaching security requires demonstrating real vulnerabilities. Open tools advance the field collectively.
The Open Source Philosophy
We believe security through obscurity is a temporary business model at best and a vulnerability at worst. Real security comes from open scrutiny, not information hiding. Real value comes from services and expertise, not gatekeeping knowledge.
Vendors who hide protocol specifications aren't protecting trade secrets—they're preventing interoperability and limiting repair. We're building tools to level that playing field.
Join the Effort
Hardware reverse engineering requires diverse expertise: signal processing, protocol design, automotive systems, vintage computing, embedded security. No single person knows it all. We need your knowledge.
- Reverse engineered a proprietary protocol? Contribute the decoder.
- Built workflow automation techniques? Add them to the framework.
- Work with file formats we don't support? Write a loader.
- Found vulnerabilities using these tools? Share sanitized case studies.
- Teaching hardware security? Use Oscura and improve the documentation.
Every contribution pools our collective expertise and makes the next reverse engineering project easier for everyone.
Getting Involved
Contributing
# Clone and setup development environment
git clone https://github.com/oscura-re/oscura.git
cd oscura
./scripts/setup.sh # Complete setup with hooks
# Run quality checks (required before commit)
./scripts/check.sh # Linting, type checking, tests
./scripts/test.sh # Full test suite with coverage
# Validate everything passes
python3 .claude/hooks/validate_all.py # Must show 5/5 passing
What We Need:
| Contribution Type | Examples | Impact |
|---|---|---|
| Workflow Automation | New analysis pipelines, export formats, integration scripts | Core value proposition |
| File Format Loaders | Oscilloscope/LA formats not yet supported | Eliminate conversion steps |
| Inference Algorithms | Better state machine learning, field detection, pattern discovery | Improve automatic analysis quality |
| Protocol Decoders | Proprietary protocols you've reversed | Enable others to analyze same systems |
| Hardware Integration | DAQ systems, instrument drivers, live capture workflows | Enable real-time analysis |
| Real-World Validation | Test on your captures, report issues | Ensure reliability across use cases |
| Documentation & Case Studies | Tutorials, sanitized RE workflows, academic papers using Oscura | Lower entry barrier, demonstrate capabilities |
Contributing Guide | Architecture Documentation
Community
- Issues: GitHub Issues - Bug reports, feature requests
- Discussions: GitHub Discussions - Questions, ideas, collaboration
- Security: SECURITY.md - Responsible disclosure process
Documentation
User Guides
- Quick Start Guide - Installation and first steps
- Black-Box Protocol Analysis - Unknown protocol RE workflow
- Side-Channel Analysis - Using ChipWhisperer traces with Oscura
- Hardware Acquisition - Direct instrument control
- Complete Workflows - End-to-end pipelines
API Reference
- API Documentation - Complete function reference
- Session Management - Interactive analysis sessions
- CLI Reference - Command-line interface
Development
- Architecture - Design principles and patterns
- Testing Guide - Test suite architecture
- CHANGELOG - Version history and migration guides
Project Status
Current Version: 0.6.0 (2026-01-25)
Active Development Areas:
- Hypothesis-driven RE workflows and confidence scoring
- Automotive protocol analysis (CAN-FD, J1939, OBD-II, UDS)
- Unknown protocol inference (state machines, field detection, CRC recovery)
- Multi-format file loading and export automation
- Vintage computing support (retro logic families, IC identification, 1960s-present)
Stability: Production-ready for security research, right-to-repair, academic use. APIs may evolve as we add capabilities—breaking changes documented in CHANGELOG.
Release History | Roadmap Discussions
Citation
If Oscura contributes to your research, please cite:
@software{oscura2026,
title = {Oscura: Hardware Reverse Engineering Framework},
author = {Oscura Contributors},
year = {2026},
url = {https://github.com/oscura-re/oscura},
version = {0.6.0}
}
Machine-readable: CITATION.cff
Legal
License: MIT License - Permissive use, modification, distribution
Disclaimer: This framework is intended for legitimate security research, right-to-repair, academic study, and authorized testing. Users are responsible for compliance with applicable laws and regulations. Unauthorized access to systems or networks is illegal and unethical.
Dependencies: Built with Python, NumPy, SciPy, Matplotlib, Hypothesis. See pyproject.toml for complete dependency list.
Supported by: Security researchers, right-to-repair advocates, academic institutions, and the open source community.
Oscura - Illuminate what others obscure.
Hardware systems are black boxes by design, obscured through proprietary protocols, cryptographic obfuscation, and undocumented interfaces. Whether imposed by vendors, governments, or the passage of time—we bring light to the darkness. Join us in building the workflow automation framework that hardware reverse engineering deserves.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file oscura-0.6.0.tar.gz.
File metadata
- Download URL: oscura-0.6.0.tar.gz
- Upload date:
- Size: 3.0 MB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3f562a2aea254b1630875c63c66577fb0025cf105cb36c6c65bbdfe5c6af6baa
|
|
| MD5 |
da5e0ae78228934ce62f3f9bbd7c51a7
|
|
| BLAKE2b-256 |
8dc2b3dbd06c0f70335d1da22e37a46958fd95ed08633e62ea0ee6ccc91d3a49
|
Provenance
The following attestation bundles were made for oscura-0.6.0.tar.gz:
Publisher:
release.yml on oscura-re/oscura
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
oscura-0.6.0.tar.gz -
Subject digest:
3f562a2aea254b1630875c63c66577fb0025cf105cb36c6c65bbdfe5c6af6baa - Sigstore transparency entry: 870283767
- Sigstore integration time:
-
Permalink:
oscura-re/oscura@3aeab663191371236abb8886765fa0fa4b3f3e14 -
Branch / Tag:
refs/tags/v0.6.0 - Owner: https://github.com/oscura-re
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@3aeab663191371236abb8886765fa0fa4b3f3e14 -
Trigger Event:
push
-
Statement type:
File details
Details for the file oscura-0.6.0-py3-none-any.whl.
File metadata
- Download URL: oscura-0.6.0-py3-none-any.whl
- Upload date:
- Size: 2.1 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b93adcd2f0f5f1a364816bcab20ab6dd62e31fd8778bd83816bc590f677b4bcc
|
|
| MD5 |
9659ee49223ed857d53ad7b17895e92a
|
|
| BLAKE2b-256 |
24b680582d215cf05438963d508bb44d7ee91449a25d87fcfe4babee66923b7b
|
Provenance
The following attestation bundles were made for oscura-0.6.0-py3-none-any.whl:
Publisher:
release.yml on oscura-re/oscura
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
oscura-0.6.0-py3-none-any.whl -
Subject digest:
b93adcd2f0f5f1a364816bcab20ab6dd62e31fd8778bd83816bc590f677b4bcc - Sigstore transparency entry: 870283771
- Sigstore integration time:
-
Permalink:
oscura-re/oscura@3aeab663191371236abb8886765fa0fa4b3f3e14 -
Branch / Tag:
refs/tags/v0.6.0 - Owner: https://github.com/oscura-re
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@3aeab663191371236abb8886765fa0fa4b3f3e14 -
Trigger Event:
push
-
Statement type: