Question - What is Bias and Variance in Machine Learning?
Answer -
- Bias is the difference between the average prediction of a model and the correct value of the model. If the bias value is high, then the prediction of the model is not accurate. Hence, the bias value should be as low as possible to make the desired predictions.
- Variance is the number that gives the difference of prediction over a training set and the anticipated value of other training sets. High variance may lead to large fluctuation in the output. Therefore, a model’s output should have low variance.
The following diagram shows the bias-variance trade-off:
Here, the desired result is the blue circle at the center. If we get off from the blue section, then the prediction goes wrong.