Home / Tag Archives: Entropy calculation

Tag Archives: Entropy calculation

204.3.4 How to Calculate Entropy for Decision Tree Split?

Entropy Calculation – Example Entropy at root Total population at root 100 [50+,50-] Entropy(S) = −p+log2p+−p−log2p− −0.5log2(0.5)−0.5log2(0.5) -(0.5)(-1) – (0.5)(-1) 1 100% Impurity at root     Entropy(S)=−p+log2p+−p−log2p− Entropy Calculation Gender Splits the population into two segments Segment-1 : Age=”Young” Segment-2: Age=”Old” Entropy at segment-1 Age=”Young” segment has 60 records …

Read More »