Skip to main content

Reference patterns for reliable enterprise integration, workflow automation, and system-of-record synchronization.

Project description

integration-automation-patterns

CI PyPI Python License Downloads]


The problem this solves

Enterprise systems that span CRM + ERP + messaging fail in predictable ways: duplicate event processing, partial transaction failures, and lost messages under retry. This library provides reference implementations of the patterns that solve these problems structurally — idempotent event envelopes, field-level authority boundaries, distributed saga orchestration, and transactional outbox — so integration logic is explicit, testable, and broker-agnostic.


Architecture

Inbound Event
     │
     ▼
EventEnvelope
(event_id, idempotency_key, source, schema_version, metadata)
     │
     ├─ Duplicate Check ──────────────────────────────────────────┐
     │   event_id already processed? → skip, return cached result │
     │                                                             │
     ├─ Authority Check ──────────────────────────────────────────┤
     │   SyncBoundary.detect_conflict()                           │
     │   Which system owns this field?                            │
     │   Conflict → raise ConflictError, log authority boundary   │
     │                                                             │
     ├─ Retry Policy ─────────────────────────────────────────────┤
     │   Exponential backoff, max attempts                        │
     │   CircuitBreaker: CLOSED → OPEN → HALF_OPEN recovery       │
     │                                                             │
     └─ Outbox → DB Transaction → Reliable Publish ───────────────┘
         Write event in same DB tx as domain change
         Relay process delivers to broker independently

Installation

pip install integration-automation-patterns

30-second example

from integration_automation_patterns.event_envelope import EventEnvelope, DeliveryStatus
from integration_automation_patterns.sync_boundary import SyncBoundary, FieldAuthority

# Idempotent event envelope — safe to process multiple times
event = EventEnvelope(
    event_id="evt_8f3a1b",
    source="salesforce",
    event_type="contact.updated",
    payload={"email": "alice@example.com", "phone": "+1-555-0100"},
    schema_version="1.0",
)

# Field-level authority — who owns each field across systems?
boundary = SyncBoundary(
    authorities={
        "email": FieldAuthority(owner="salesforce", read_others=["erp", "itsm"]),
        "phone": FieldAuthority(owner="erp", read_others=["salesforce"]),
    }
)

conflicts = boundary.detect_conflict(
    incoming_system="salesforce",
    fields={"email": "alice@example.com", "phone": "+1-555-0100"},
)
# conflicts → {"phone": ConflictDetail(owner="erp", incoming_system="salesforce")}

if not conflicts:
    event.mark_delivered()

See docs/implementation-note-01.md for a full walkthrough.


Pattern catalog

Pattern Class Problem Solved
Idempotent Event EventEnvelope Duplicate processing under at-least-once delivery
Authority Model SyncBoundary Field-level conflict detection across systems
Circuit Breaker CircuitBreaker Cascading failure isolation with automatic recovery
Saga SagaOrchestrator Multi-step distributed transaction with compensation
Outbox OutboxPublisher Reliable event publish in the same DB transaction
Kafka Envelope KafkaEnvelope Partition routing, schema versioning, DLQ support
Webhook Validation WebhookHandler HMAC-SHA256 signature verification + idempotency
Change Data Capture CDCEvent Typed INSERT/UPDATE/DELETE with Debezium parsing

Repository structure

src/integration_automation_patterns/
├── event_envelope.py         # Reliable event transport + retry + delivery status
├── sync_boundary.py          # Bi-directional SOR sync with field authority
├── circuit_breaker.py        # CLOSED/OPEN/HALF_OPEN state machine
├── saga.py                   # Distributed saga orchestrator + compensation
├── outbox.py                 # Transactional outbox for at-least-once delivery
├── kafka_envelope.py         # Kafka-aware envelope: partition key, DLQ, schema
├── webhook_handler.py        # HMAC-SHA256 webhook verification
└── cdc_event.py              # Change Data Capture event types (Debezium-compatible)
docs/
├── architecture.md
├── implementation-note-01.md  # Event-driven integration reliability
├── implementation-note-02.md  # Idempotency in enterprise event processing
└── adr/

See ECOSYSTEM.md for the full broker, connector, and framework coverage matrix.


Published notes


Contributing

Contributions are welcome. Please read CONTRIBUTING.md for guidelines. Run pytest tests/ -v to verify your changes before opening a pull request.


Citation

If you use these patterns in research or production, please cite:

@software{rana2026iap,
  author    = {Rana, Ashutosh},
  title     = {integration-automation-patterns: Enterprise integration reliability patterns},
  year      = {2026},
  url       = {https://github.com/ashutoshrana/integration-automation-patterns},
  license   = {MIT}
}

Or use GitHub's "Cite this repository" button above (reads CITATION.cff).


Part of the enterprise AI patterns trilogy

Library Focus Regulation
enterprise-rag-patterns What to retrieve FERPA identity-scoped RAG
regulated-ai-governance What agents may do FERPA, HIPAA, GLBA policy enforcement
integration-automation-patterns How data flows Event-driven enterprise integration

License

MIT — see LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

integration_automation_patterns-0.4.0.tar.gz (41.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

integration_automation_patterns-0.4.0-py3-none-any.whl (36.3 kB view details)

Uploaded Python 3

File details

Details for the file integration_automation_patterns-0.4.0.tar.gz.

File metadata

File hashes

Hashes for integration_automation_patterns-0.4.0.tar.gz
Algorithm Hash digest
SHA256 eb2259ad5161640a1edabae33f1fac5b95f740b3936a695229a20c70879c9941
MD5 ed1a558771886664ca3f41895d55a895
BLAKE2b-256 5f2f2063cef9b3c78b37d29e367ab1cfc0315b7be37418d109e73e70bdd78f70

See more details on using hashes here.

Provenance

The following attestation bundles were made for integration_automation_patterns-0.4.0.tar.gz:

Publisher: publish.yml on ashutoshrana/integration-automation-patterns

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file integration_automation_patterns-0.4.0-py3-none-any.whl.

File metadata

File hashes

Hashes for integration_automation_patterns-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a0814adcb7b416d743091e6c82905f6d4dcc88c135ed9c7dd4758049191454ef
MD5 4ab0ad293cdde8384bbd50032e9a72ce
BLAKE2b-256 c01e532fbd389dad4ef5422f5dc770f54e52e237524f7973dfd866c01a2bc2cb

See more details on using hashes here.

Provenance

The following attestation bundles were made for integration_automation_patterns-0.4.0-py3-none-any.whl:

Publisher: publish.yml on ashutoshrana/integration-automation-patterns

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page