Balancing between over-weighting and under-weighting in supervised term weighting.

•Show the importance of the trade-off between over-weighting and under-weighting.•Propose a revision of add-one smoothing on delta smoothed idf (dsidf).•Present three regularization techniques to reduce over-weighting.•Propose a new supervised term weighting scheme, regularized entropy (re).