The Perceptron is one of the earliest and simplest types of artificial neural networks. It serves as the foundation for modern deep learning models. The perceptron is used for binary classification tasks, where the output is either 0 or 1. Understanding this model helps you grasp how neural networks learn and make decisions.<\/p>\n\n\n\n
What is a Perceptron?<\/strong> Mathematical Representation<\/strong> Where:<\/p>\n\n\n\n Activation Function<\/strong> This makes it suitable for binary classification problems.<\/p>\n\n\n\n Working of a Perceptron<\/strong><\/p>\n\n\n\n Training the Perceptron<\/strong> Perceptron Learning Rule<\/strong> This process helps the model improve its predictions over time.<\/p>\n\n\n\n Example in Python<\/strong><\/p>\n\n\n\n Limitations of Perceptron<\/strong><\/p>\n\n\n\n Importance in Deep Learning<\/strong><\/p>\n\n\n\n Lesson Summary<\/strong>
A perceptron is a single neuron model that takes multiple inputs, applies weights, adds a bias, and passes the result through an activation function to produce an output.<\/p>\n\n\n\n
The perceptron computes an output using the following formula:<\/p>\n\n\n\n\n
z = (w1 \u00d7 x1) + (w2 \u00d7 x2) + … + (wn \u00d7 xn) + b<\/li>\n\n\n\n
output = f(z)<\/li>\n<\/ul>\n\n\n\n\n
The perceptron typically uses a step function<\/strong> as the activation function:<\/p>\n\n\n\n\n
\n
The perceptron learns by adjusting its weights based on errors:<\/p>\n\n\n\n\n
Weights are updated using the formula:
w = w + learning_rate \u00d7 (actual \u2212 predicted) \u00d7 input<\/p>\n\n\n\nimport numpy as np# Sample data
X = np.array([[0,0], [0,1], [1,0], [1,1]])
y = np.array([0, 0, 0, 1])# Initialize weights and bias
weights = np.zeros(2)
bias = 0
learning_rate = 0.1# Training loop
for epoch in range(10):
for i in range(len(X)):
z = np.dot(X[i], weights) + bias
prediction = 1 if z >= 0 else 0
error = y[i] - prediction
weights += learning_rate * error * X[i]
bias += learning_rate * errorprint(\"Weights:\", weights)
print(\"Bias:\", bias)<\/pre>\n\n\n\n\n
\n
In this lesson, you learned about the perceptron model, its structure, mathematical formulation, training process, and limitations. The perceptron is a fundamental concept that lays the groundwork for understanding more complex neural networks in deep learning.<\/p>\n\n\n