[MINI] Feed Forward Neural Networks

Data Skeptic · Mar 24, 2017 · 15m

Feed Forward Neural Networks

In a feed forward neural network, neurons cannot form a cycle. In this episode, we explore how such a network would be able to represent three common logical operators: OR, AND, and XOR. The XOR operation is the interesting case.

Below are the truth tables that describe each of these functions.

AND Truth Table

Input 1 Input 2 Output

0 0 0

0 1 0

1 0 0

1 1 1

OR Truth Table

Input 1 Input 2 Output

0 0 0

0 1 1

1 0 1

1 1 1

XOR Truth Table

Input 1 Input 2 Output

0 0 0

0 1 1

1 0 1

1 1 0

The AND and OR functions should seem very intuitive. Exclusive or (XOR) if true if and…