Skip to main content

Reference patterns for reliable enterprise integration, workflow automation, and system-of-record synchronization.

Project description

integration-automation-patterns

CI PyPI Python License Downloads]


The problem this solves

Enterprise systems that span CRM + ERP + messaging fail in predictable ways: duplicate event processing, partial transaction failures, and lost messages under retry. This library provides reference implementations of the patterns that solve these problems structurally — idempotent event envelopes, field-level authority boundaries, distributed saga orchestration, and transactional outbox — so integration logic is explicit, testable, and broker-agnostic.


Architecture

Inbound Event
     │
     ▼
EventEnvelope
(event_id, idempotency_key, source, schema_version, metadata)
     │
     ├─ Duplicate Check ──────────────────────────────────────────┐
     │   event_id already processed? → skip, return cached result │
     │                                                             │
     ├─ Authority Check ──────────────────────────────────────────┤
     │   SyncBoundary.detect_conflict()                           │
     │   Which system owns this field?                            │
     │   Conflict → raise ConflictError, log authority boundary   │
     │                                                             │
     ├─ Retry Policy ─────────────────────────────────────────────┤
     │   Exponential backoff, max attempts                        │
     │   CircuitBreaker: CLOSED → OPEN → HALF_OPEN recovery       │
     │                                                             │
     └─ Outbox → DB Transaction → Reliable Publish ───────────────┘
         Write event in same DB tx as domain change
         Relay process delivers to broker independently

Installation

pip install integration-automation-patterns

30-second example

from integration_automation_patterns.event_envelope import EventEnvelope, DeliveryStatus
from integration_automation_patterns.sync_boundary import SyncBoundary, FieldAuthority

# Idempotent event envelope — safe to process multiple times
event = EventEnvelope(
    event_id="evt_8f3a1b",
    source="salesforce",
    event_type="contact.updated",
    payload={"email": "alice@example.com", "phone": "+1-555-0100"},
    schema_version="1.0",
)

# Field-level authority — who owns each field across systems?
boundary = SyncBoundary(
    authorities={
        "email": FieldAuthority(owner="salesforce", read_others=["erp", "itsm"]),
        "phone": FieldAuthority(owner="erp", read_others=["salesforce"]),
    }
)

conflicts = boundary.detect_conflict(
    incoming_system="salesforce",
    fields={"email": "alice@example.com", "phone": "+1-555-0100"},
)
# conflicts → {"phone": ConflictDetail(owner="erp", incoming_system="salesforce")}

if not conflicts:
    event.mark_delivered()

See docs/implementation-note-01.md for a full walkthrough.


Pattern catalog

Pattern Class Problem Solved
Idempotent Event EventEnvelope Duplicate processing under at-least-once delivery
Authority Model SyncBoundary Field-level conflict detection across systems
Circuit Breaker CircuitBreaker Cascading failure isolation with automatic recovery
Saga SagaOrchestrator Multi-step distributed transaction with compensation
Outbox OutboxPublisher Reliable event publish in the same DB transaction
Kafka Envelope KafkaEnvelope Partition routing, schema versioning, DLQ support
Webhook Validation WebhookHandler HMAC-SHA256 signature verification + idempotency
Change Data Capture CDCEvent Typed INSERT/UPDATE/DELETE with Debezium parsing

Repository structure

src/integration_automation_patterns/
├── event_envelope.py         # Reliable event transport + retry + delivery status
├── sync_boundary.py          # Bi-directional SOR sync with field authority
├── circuit_breaker.py        # CLOSED/OPEN/HALF_OPEN state machine
├── saga.py                   # Distributed saga orchestrator + compensation
├── outbox.py                 # Transactional outbox for at-least-once delivery
├── kafka_envelope.py         # Kafka-aware envelope: partition key, DLQ, schema
├── webhook_handler.py        # HMAC-SHA256 webhook verification
└── cdc_event.py              # Change Data Capture event types (Debezium-compatible)
docs/
├── architecture.md
├── implementation-note-01.md  # Event-driven integration reliability
├── implementation-note-02.md  # Idempotency in enterprise event processing
└── adr/

See ECOSYSTEM.md for the full broker, connector, and framework coverage matrix.


Published notes


Contributing

Contributions are welcome. Please read CONTRIBUTING.md for guidelines. Run pytest tests/ -v to verify your changes before opening a pull request.


Citation

If you use these patterns in research or production, please cite:

@software{rana2026iap,
  author    = {Rana, Ashutosh},
  title     = {integration-automation-patterns: Enterprise integration reliability patterns},
  year      = {2026},
  url       = {https://github.com/ashutoshrana/integration-automation-patterns},
  license   = {MIT}
}

Or use GitHub's "Cite this repository" button above (reads CITATION.cff).


Part of the enterprise AI patterns trilogy

Library Focus Regulation
enterprise-rag-patterns What to retrieve FERPA identity-scoped RAG
regulated-ai-governance What agents may do FERPA, HIPAA, GLBA policy enforcement
integration-automation-patterns How data flows Event-driven enterprise integration

License

MIT — see LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

integration_automation_patterns-0.10.0.tar.gz (59.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file integration_automation_patterns-0.10.0.tar.gz.

File metadata

File hashes

Hashes for integration_automation_patterns-0.10.0.tar.gz
Algorithm Hash digest
SHA256 9302a7c06a75c434d403132dc877ea6f7442f5f36665f30cd5aa3938fd0bdb92
MD5 9422b0502c576793213558d050f6cd20
BLAKE2b-256 7780398bc2f3ddbb32b4709d925215594ef4a6f0a2821b7b3be81a60e4ce4760

See more details on using hashes here.

Provenance

The following attestation bundles were made for integration_automation_patterns-0.10.0.tar.gz:

Publisher: publish.yml on ashutoshrana/integration-automation-patterns

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file integration_automation_patterns-0.10.0-py3-none-any.whl.

File metadata

File hashes

Hashes for integration_automation_patterns-0.10.0-py3-none-any.whl
Algorithm Hash digest
SHA256 69c860994e3cb0e4d7c5e71de5b327f045222012d41743d24619b20f6f99696f
MD5 1ec75baed8af90c31b669027f33ce89b
BLAKE2b-256 6cfb66a233d625abb2f6da1728916d2315ca31e06fc0bb4b0eb845417db0217e

See more details on using hashes here.

Provenance

The following attestation bundles were made for integration_automation_patterns-0.10.0-py3-none-any.whl:

Publisher: publish.yml on ashutoshrana/integration-automation-patterns

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page