Home / Tag Archives: Information gain

Tag Archives: Information gain

203.3.5 Information Gain in Decision Tree Split

Information Gain Information Gain= entropyBeforeSplit – entropyAfterSplit Easy way to understand Information gain= (overall entropy at parent node) – (sum of weighted entropy at each child node) Attribute with maximum information is best split attribute Information Gain- Calculation Entropy Ovearll = 100% (Impurity) Entropy Young Segment = 99% Entropy Old …

Read More »