Skip to main content

A Python package for direct implementation of ReLU network.

Project description

ReLU neural network

rectified linear activation function

What is ReLU ?

ReLU is defined as g(x) = max(0,x). It is 0 when x is negative and equal to x when positive. Due to it’s lower saturation region, it is highly trainable and decreases the cost function far more quickly than sigmoid.

acitation functions

Inline-style: alt text

ReLU acitation function

Inline-style: alt text

direct implementation of ReLU neural networks


pip install ReLUs


pip3 install ReLUs

parameters for the model to train

layers_sizes   (e.g.  layers_size=[13,5,5,1])
num_iters      (e.g. num_iters=1000)
learning_rate (e.g. learning_rate=0.03)

training the model

model_name =  model(X_train, Y_train, layer_sizes, num_iters, learning_rate)

train and test accuracy

train_acc, test_acc = compute_accuracy(X_train, X_test, Y_train, Y_test, model_name)

making predictions



Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release. See tutorial on generating distribution archives.

Built Distribution

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page