PDF] The Method of Steepest Descent for Feedforward Artificial Neural Networks

This paper implements the method of Steepest Descent in single and multilayer feedforward artificial neural networks and calculates the three new update weight equations for taking different activation function in different processing unit separately. In this paper, we implement the method of Steepest Descent in single and multilayer feedforward artificial neural networks. In all previous works, all the update weight equations for single or multilayer feedforward artificial neural networks has been calculated by choosing a single activation function for various processing unit in the network. We, at first, calculate the total error function separately for single and multilayer feedforward artificial neural networks and then calculate the three new update weight equations for taking different activation function in different processing unit separately single and multilayer feedforward artificial neural networks. An example is given to show usefulness of this implementation.

Fundamentals of Artificial Neural Networks and Deep Learning

Applied Sciences, Free Full-Text

Understand the Impact of Learning Rate on Neural Network

Feed Forward Neural Networks — How To Successfully Build Them in

Feedforward neural network - Wikipedia

PDF] Introduction to multi-layer feed-forward neural networks

Gradient Descent With Momentum from Scratch

Mathematics, Free Full-Text

Backpropagation from scratch with Python - PyImageSearch

An Introduction to Deep Feedforward Neural Networks

Feedforward Neural Networks Brilliant Math & Science Wiki

Neural nets learn to program neural nets with with fast weights (1991)

What are Neural Networks?