Entropy of each feature with respect to the target variable

The entropy of two variables f₁ and f₂ is defined as follows:

Here, v represents each possible value of f₂, P(v) is the probability of each value, and S(v) was defined in the previous equation.