Unit - 3
Introduction to Neural Network
Neural Networks
● Neural networks, also known as artificial neural networks (ANNs) or
simulated neural networks (SNNs).
● An Artificial neural network refers to a collection of connected
computational units or nodes (called neurons) along with biologically
inspired computer programs designed to simulate the way in which the
natural neural networks of human brain process information.
Natural Neural Network
● Dendrites - It is a tree branch which receives information from other cells.
● Cell Body - It contains the nucleus where the protein is made which is
transmitted through dendrites and axons.
● Axons and Axon Terminals - It takes the output from the nucleus and transfers
it to another neuron. Axon terminals at the end of axons are connected to the
dendrites of another neuron through a small gap called synapse
● Synapse – Information signal transfers through synapse to the connected
neuron's dendrites
Structure of Artificial Neural Network(ANN)
Layers of ANN
● Input Layer - The first layer of Neural Network is called the input layer, whose role is to acquire
data and feed it to the neural network. The input layer carries out no processing , it just takes
the input data and passes it on to the next connected layer.
● Hidden Layer - Input layer is connected to a hidden layer , The role of hidden layer is to
process inputs and carry out the task . The processing at at the hidden layers is carried out as:
Sum of weighted inputs + Activation Function + Hidden rules
There can be multiple hidden layers in an ANN , depending upon the complexity of task being
performed . Hidden Layers are not visible to the user . The processed output of hidden layer is
fed to subsequent hidden layer of the network.
● Output Layer - After the processed data travels through multiple hidden layers , it is finally fed
to the final layer known as output layer. It provides output to the user . At this layer no
processing is done.
Artificial Neural Networks
The components of ANN are :
● Neuron - A neuron or a node is a basic unit of neural network that receives
information, performs simple calculations and passes it further.
● Weighted input - Weight is the parameter within a neural network that transforms
input data within the network's hidden layers. As an input enters the node, it gets
multiplied by a weight value and the resulting output is either observed, or passed to
the next layer in the neural network.
● Activation function - The activation function decides whether a neuron should be
activated or not by calculating the weighted sum and further adding bias to it. It is the
decision making mechanism.
● Bias - Bias is the constant value that is added to shift the activation function towards
right or left.
Application Of Neural Network
● Face Recognition
● Speech Recognition
● Self - driven vehicles
● Medical Diagnosis etc.