Detecting entropy increase in categorical data using maximum entropy distribution approximations
IISE TRANSACTIONS(2017)
Abstract
We propose a statistical monitoring method to detect the increase of entropy in categorical data. First, we propose a distribution estimationmethod to approximate the probability distribution of the observed categorical data. The problem is formulated as a convex optimization problem, which involves finding the distribution that maximizes Shannon's entropy with the constraint defined by the given confidence intervals on possible distributions. Then we use this procedure to estimate the non-parametric, maximum entropy distribution of an observed data sample and use it for statistical monitoring based on a chi(2)-test statistic. This monitoring scheme was found to be effective in detecting entropy increases in the observed data based on various numerical studies and a real-world case study.
MoreTranslated text
Key words
Maximum entropy approximation,statistical process monitoring,information-theoretic measures,non-parametric distributions,chi(2) test
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined