Skip to main content

NetBox plugin to sync Forward Networks data into NetBox via built-in NQE queries

Project description

Forward NetBox Plugin

forward_netbox is a NetBox plugin that syncs Forward Networks inventory into NetBox through direct Forward API connectivity and NQE while preserving the branch-backed sync, diff, and merge workflow.

Release Compatibility

Plugin Release NetBox Version Status
v0.3.0 4.5.8 validated; 4.5.x only Current unsupported release

Version History

Release Summary
v0.3.0 Adds the NetBox 4.5.8-validated harness architecture with first-class validation runs, drift policies, query-fetch boundaries, model-result reporting, and Playwright-covered UI workflow validation.
v0.2.4 Hardens native multi-branch resilience with adaptive shard splitting and retry on branch-budget overflow, plus model-density tracking to keep large initial syncs within NetBox branching guidance.
v0.2.3 Adds native sync preflight validation before full multi-branch planning so invalid model/query rows fail earlier in the UI/API run path.
v0.2.2 NQE-only correction release: filters zero-length prefixes, broadens interface coverage for IP assignment targets, and enforces inventory part_id length limits.
v0.2.1 Makes NetBox-native multi-branch execution the only UI/API sync path and exposes the branch budget in the sync form.
v0.2.0 Adds NetBox-native multi-branch baseline syncs for large datasets, uses NetBox outbound proxy routing for Forward API calls, and keeps branch event queues bounded during large imports.
v0.1.6.0 Adds explicit diff baselines, Forward nqe-diffs execution for eligible query_id maps, and updated large-dataset guidance for baseline versus incremental syncs.
v0.1.5.1 Patch release that validates and hardens null-VRF coalesce behavior and inventory-item serial bounds against the live dataset.
v0.1.5 Fixes null VRF coalesce handling, imports loopback interfaces for IP attachment, and hardens inventory-item identity fallbacks.
v0.1.4.2 CI/package patch release that applies repository formatting/import-order fixes and publishes a clean artifact line.
v0.1.4.1 Patch release that bounds built-in dcim.virtualchassis names/domains to NetBox field limits.
v0.1.4 Hardened built-in NQE mappings and docs for large real-world datasets.
v0.1.3 Enforced deterministic model identity contracts during sync ingestion.
v0.1.2 Improved ingestion safety, diagnostics, and compatibility with custom NetBox data.
v0.1.1 Added pagination, shared built-in NQE helpers, and release/doc cleanup.
v0.1.0 Initial unsupported NetBox plugin release with built-in Forward sync workflow and seeded NQE maps.

Support Disclaimer

This repository is provided for use at your own risk. It is an unsupported release and is not an officially supported Forward Networks product. There is no warranty, support commitment, or compatibility guarantee beyond the version table above.

Features

  • Branch-backed sync, diff, and merge flow through netbox_branching
  • Forward Sources, NQE Maps, Syncs, and Ingestions
  • Built-in shipped NQE maps seeded automatically after migration
  • Support for either published Forward query_id references or raw NQE query text
  • Explicit identity contracts per map (coalesce_fields) with strict sync-time ambiguity detection
  • Repository-authored built-in queries can share local helper modules and still execute as flattened raw NQE when bundled
  • Automatic paging across multi-page Forward NQE result sets during sync execution
  • Snapshot-aware execution with latestProcessed or an explicit Forward snapshot per sync
  • Ingestion records that preserve the selected snapshot mode, resolved snapshot ID, and Forward snapshot metrics
  • Built-in coverage for:
    • dcim.site
    • dcim.manufacturer
    • dcim.devicerole
    • dcim.platform
    • dcim.devicetype
    • dcim.device
    • dcim.virtualchassis
    • dcim.interface
    • dcim.macaddress
    • dcim.inventoryitem
    • ipam.vlan
    • ipam.vrf
    • ipam.prefix for IPv4 and IPv6
    • ipam.ipaddress

Quickstart

  1. Install the plugin into the same Python environment as NetBox:

Install the wheel or source archive from GitHub Releases:

pip install /path/to/forward_netbox-0.3.0-py3-none-any.whl
  1. Enable both plugins in the NetBox configuration:
PLUGINS = [
    "netbox_branching",
    "forward_netbox",
]
  1. Apply migrations:
python manage.py migrate
  1. Open NetBox and create a Forward Source.
  2. Select a Forward network for that source.
  3. Create a Forward Sync, choose the snapshot selector, and enable the NetBox models you want to sync.
  4. Run an adhoc ingestion, review the staged branch diff, review the recorded snapshot details and metrics, and merge when the changes look correct.

For large datasets, prefer committed Forward Org Repository queries referenced by query_id, leave Snapshot at latestProcessed, and treat the first clean merge as the baseline. Later latestProcessed runs can then use Forward nqe-diffs instead of replaying every model as a full snapshot sync.

Test It Yourself

Use this quick validation flow after installation:

  1. Create a Forward Source using https://fwd.app or your custom Forward URL.
  2. Enter a Forward username and password, then confirm the Network field populates from the live Forward tenant.
  3. Open NQE Maps and verify the built-in maps are present.
  4. Create a Forward Sync tied to the source, leaving Snapshot at latestProcessed for the first run.
  5. Run the sync from the sync detail page.
  6. Review the generated Forward Ingestion, Issues, snapshot details, snapshot metrics, and change diff.
  7. Merge the branch and confirm the synced objects appear in NetBox.

Local Validation

The repository now includes local validation tasks:

  • invoke forward_netbox.lint
  • invoke forward_netbox.check
  • invoke forward_netbox.test
  • invoke forward_netbox.docs
  • invoke forward_netbox.package
  • invoke forward_netbox.ci

For a live Forward smoke run outside CI, set these environment variables and run the smoke task locally:

export FORWARD_SMOKE_USERNAME='your-forward-username'
export FORWARD_SMOKE_PASSWORD='your-forward-password'
export FORWARD_SMOKE_NETWORK_ID='your-network-id'
invoke forward_netbox.smoke-sync

Optional smoke-sync variables:

  • FORWARD_SMOKE_URL defaults to https://fwd.app
  • FORWARD_SMOKE_SNAPSHOT_ID defaults to latestProcessed
  • FORWARD_SMOKE_MODELS accepts a comma-separated subset such as dcim.site,dcim.device,dcim.interface
  • invoke forward_netbox.smoke-sync --validate-only runs live snapshot/query validation without executing an ingestion
  • invoke forward_netbox.smoke-sync --plan-only prints the native NetBox Branching shard plan without creating branches
  • invoke forward_netbox.smoke-sync --max-changes-per-branch 10000 stages and merges large baselines in multiple native branches
  • invoke forward_netbox.smoke-sync --no-auto-merge --max-changes-per-branch 10000 stages one shard and pauses for review

Normal UI/API sync jobs always use native multi-branch execution, with a default branch budget of 10000 changes. Auto merge controls whether shards advance automatically or pause for review after each shard.

Documentation

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

forward_netbox-0.3.0.tar.gz (92.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

forward_netbox-0.3.0-py3-none-any.whl (127.0 kB view details)

Uploaded Python 3

File details

Details for the file forward_netbox-0.3.0.tar.gz.

File metadata

  • Download URL: forward_netbox-0.3.0.tar.gz
  • Upload date:
  • Size: 92.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.4

File hashes

Hashes for forward_netbox-0.3.0.tar.gz
Algorithm Hash digest
SHA256 72f0c9c1c48f7b512529024a4445f89c373d39c4fd948881bd7791cff1229f2c
MD5 774e4f0b97171b36092956d974fa4962
BLAKE2b-256 997aa55e7d65acd8f59f662efde6376bc8fe5c91d14caa345f115706c66bbb1e

See more details on using hashes here.

File details

Details for the file forward_netbox-0.3.0-py3-none-any.whl.

File metadata

  • Download URL: forward_netbox-0.3.0-py3-none-any.whl
  • Upload date:
  • Size: 127.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.4

File hashes

Hashes for forward_netbox-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 96c544ded45b72e783ef625edfeffeba83f2c17be677ddd7be56dc236d5b8116
MD5 8f8ae7d9a17da53fd580d50074b8bde9
BLAKE2b-256 2c7194187a58d924748e17b3c2d39c68066909c543dab656165e59381d7e4ac0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page