Skip to main content

Poll data from devices and store them into Netbox

Project description

Netbox Network Importer

Tool to analyze and synchronize an existing network with a Netbox (SOT).

The main use cases for the network importer:

  • Import an existing network into a Netbox
  • Check the differences between the running network and the Netbox

Install

  1. Clone repository
    • git clone git@gitlab.cesnet.cz:701/done/netbox_network_importer.git
  2. Go into the repository
    • cd netbox_network_importer
  3. Create virtualenv
    • python3 -m venv venv
  4. Activate it
    • source venv/bin/activate
  5. Install the tool
    • pip install .

Pre-requisite

To operate, the Netbox Network Importer is dependent on the following items:

  • Access to Netbox API
  • Access to Network Devices via SSH
  • Created Custom Field on Netbox
   {
    "display": "Ignore Importer",
    "content_types": [
        "dcim.interface",
    ],
    "type": {
        "value": "boolean",
        "label": "Boolean (true/false)"
    },
    "object_type": null,
    "data_type": "boolean",
    "name": "ignore_importer",
    "label": "Ignore Importer",
    "description": "Will be ignored when processed by Network Importer",
    "required": true,
    "filter_logic": {
        "value": "exact",
        "label": "Exact"
    },
    "default": false,
    "weight": 100,
   }

Inventory

A device inventory must be available in NetBox.

To be able to connect to the device the following information needs to be defined :

  • Primary ip address
  • Platform (must be a one of the following ['iosxr', 'ios', 'iosxe'])

Configuration file

The information to connect to NetBox must be provided via the configuration file. The configuration file below present standard options that can be provided to control the behavior of the Netbox Network Importer.

Netbox Network Importer try to find the configuration file at:

  • /home/<user>/.config/netbox_network_importer/config.yml
  • /etc/netbox_network_importer/config.yml
  • Or you can set path to configuratin file like:
    • netbox_network_importer --config path_to_dir_with_config/ synchronize
---
netbox:
  NETBOX_API_TOKEN: "API_TOKEN"
  NETBOX_INSTANCE_URL: "https://netbox.done-test.cesnet.cz/"
  NETBOX_GRAPHQL_URL: "https://netbox.done-test.cesnet.cz/graphql/"
tacacs:
  TACACS_USERNAME: "username"
  TACACS_PASSWORD: "password"

config:
  LOG_DIR: "path_where_output.log_will_be_stored"
  LOG_LEVEL: "DEBUG"
  OUTPUT_DIR: "output_folder_where_results_will_be_stored"

Execute

The Netbox Network Importer runs only in apply mode.

  • In check mode, no modification will be made to the SOT, the differences will be printed on the screen
  • In apply mode, the NETBOX will be updated with:
    • interfaces
    • IPs
    • vlans
    • LAGs

Apply Mode

The Netbox Network Importer will attempt to create/update or delete all elements in the Netbox that do not match what has been observed in the network. It will ignore devices or interfaces on certain circumstances:

  • Device status must be Active, otherwise the device is skipped
  • Device primary_ip must be properly set, otherwise the device is skipped
  • Device platform must include one of the following values [ios, iosxr, iosxe], otherwise the device is skipped
  • If interface has attribute Ignore Importer set to True, then the processing on the Interface will be skipped and ignored

Execution:

  • netbox_network_importer synchronize # runs the importer
  • netbox_network_importer synchronize -d Rxx # runs importer on device Rxx from Netbox
  • netbox_network_importer synchronize -p iosxe # runs importer on all devices with platform iosxe
  • netbox_network_importer synchronize -d Rxx -d Ryy # runs importer on devices Rxx and Ryy

Help

~/netbox_network_importer$ netbox_network_importer --help
Usage: netbox_network_importer [OPTIONS] COMMAND [ARGS]...

Options:
  -c, --configs PATH  path to folder with configurations
  --help              Show this message and exit.

Commands:
  pyats        Connect to device using pyats and pynetbox and print...
  synchronize  Run set of Nornir task to update data in Netbox from...

~/NETBOX/netbox_network_importer$ netbox_network_importer synchronize --help
Usage: netbox_network_importer synchronize [OPTIONS]

  Run set of Nornir task to update data in Netbox from network devices

  Args:     devices (str): device name filter, can be used multiple times
  platforms (str): platform name filter, can be used multiple times
  no_progress_bar (bool): use to hide progress bar Returns:     dict:
  Dictionary of hosts, it's actions and results

Options:
  -d, --devices TEXT    Run on specificied devices
  -p, --platforms TEXT  Run on specificied platforms
  --no-progress-bar
  --help                Show this message and exit.```
---

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

netbox_network_importer-1.1.4.tar.gz (25.7 kB view details)

Uploaded Source

File details

Details for the file netbox_network_importer-1.1.4.tar.gz.

File metadata

  • Download URL: netbox_network_importer-1.1.4.tar.gz
  • Upload date:
  • Size: 25.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 colorama/0.4.4 importlib-metadata/4.6.4 keyring/23.5.0 pkginfo/1.8.2 readme-renderer/34.0 requests-toolbelt/0.9.1 requests/2.25.1 rfc3986/1.5.0 tqdm/4.57.0 urllib3/1.26.5 CPython/3.10.6

File hashes

Hashes for netbox_network_importer-1.1.4.tar.gz
Algorithm Hash digest
SHA256 7bc3ca23b2ec7325c8bf83e0ee145927a2fbc4e1de8ea79bfbe5b4edcd8f9515
MD5 c3b014fdc3f7c5e63cfd0079e8fb2eb9
BLAKE2b-256 880ad8d75d40d6153672ae3440ed0fb2508763ba0fb97c66ae3ca06689e3460e

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page