ML-specialization-notes icon indicating copy to clipboard operation
ML-specialization-notes copied to clipboard

Fix Information Gain Calculation in Decision Tree Algorithm

Open ElmekaouiHaitham opened this issue 1 year ago • 0 comments

This pull request corrects the formula for calculating Information Gain in the decision tree algorithm. The previous formula was incorrect as it incorrectly applied the root entropy to the weighted purities of the left and right child nodes. The corrected formula now properly calculates Information Gain by multiplying the root entropy with the weighted sum of the entropies of the left and right child nodes.

ElmekaouiHaitham avatar Aug 26 '24 18:08 ElmekaouiHaitham