Skip to main content

nGraph - Intel's graph compiler and runtime for Neural Networks

Project description

nGraph Compiler stack

nGraph is an open-source graph compiler for Artificial Neural Networks (ANNs). The nGraph Compiler stack provides an inherently efficient graph-based compilation infrastructure designed to be compatible with the many upcoming processors, like the Intel Nervana™ Neural Network Processor (Intel® Nervana™ NNP), while also unlocking a massive performance boost on any existing hardware targets in your neural network: both GPUs and CPUs. Using its flexible infrastructure, you will find it becomes much easier to create Deep Learning (DL) models that can adhere to the "write once, run anywhere" mantra that enables your AI solutions to easily go from concept to production to scale.

Frameworks using nGraph to execute workloads have shown up to 45X performance boost compared to native implementations.

Using the Python API

nGraph can be used directly with the Python API described here, or with the C++ API described in the core documentation. Alternatively, its performance benefits can be realized through frontends such as TensorFlow, PaddlePaddle and ONNX. You can also create your own custom framework to integrate directly with the nGraph Ops for highly-targeted graph execution.

Installation

nGraph is available as binary wheels you can install from PyPI. nGraph binary wheels are currently tested on Ubuntu 16.04. To build and test on other systems, you may want to try building from sources.

Installing nGraph Python API from PyPI is easy:

pip install ngraph-core

Usage example

Using nGraph's Python API to construct a computation graph and execute a computation is simple. The following example shows how to create a minimal (A + B) * C computation graph and calculate a result using 3 numpy arrays as input.

import numpy as np
import ngraph as ng

A = ng.parameter(shape=[2, 2], name='A', dtype=np.float32)
B = ng.parameter(shape=[2, 2], name='B', dtype=np.float32)
C = ng.parameter(shape=[2, 2], name='C', dtype=np.float32)
# >>> print(A)
# <Parameter: 'A' ([2, 2], float)>

model = (A + B) * C
# >>> print(model)
# <Multiply: 'Multiply_14' ([2, 2])>

runtime = ng.runtime(backend_name='CPU')
# >>> print(runtime)
# <Runtime: Backend='CPU'>

computation = runtime.computation(model, A, B, C)
# >>> print(computation)
# <Computation: Multiply_14(A, B, C)>

value_a = np.array([[1, 2], [3, 4]], dtype=np.float32)
value_b = np.array([[5, 6], [7, 8]], dtype=np.float32)
value_c = np.array([[9, 10], [11, 12]], dtype=np.float32)

result = computation(value_a, value_b, value_c)
# >>> print(result)
# [[ 54.  80.]
#  [110. 144.]]

print('Result = ', result)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for ngraph-core, version 0.25.0
Filename, size & hash File type Python version Upload date
ngraph_core-0.25.0-cp27-cp27m-macosx_10_14_x86_64.whl (47.1 MB) View hashes Wheel cp27
ngraph_core-0.25.0-cp27-cp27mu-manylinux1_x86_64.whl (87.1 MB) View hashes Wheel cp27
ngraph_core-0.25.0-cp35-cp35m-macosx_10_14_x86_64.whl (47.1 MB) View hashes Wheel cp35
ngraph_core-0.25.0-cp35-cp35m-manylinux1_x86_64.whl (87.2 MB) View hashes Wheel cp35
ngraph_core-0.25.0-cp36-cp36m-macosx_10_14_x86_64.whl (47.1 MB) View hashes Wheel cp36
ngraph_core-0.25.0-cp36-cp36m-manylinux1_x86_64.whl (87.2 MB) View hashes Wheel cp36
ngraph_core-0.25.0-cp37-cp37m-macosx_10_14_x86_64.whl (47.1 MB) View hashes Wheel cp37
ngraph_core-0.25.0-cp37-cp37m-manylinux1_x86_64.whl (87.4 MB) View hashes Wheel cp37

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page