The mysterious optimality of Naive Bayes: Estimation of the probability in the system of "classifiers"

Bayes Classifiers are widely used currently for recognition, identification and knowledge discovery. The fields of application are, for example, image processing, medicine, chemistry (QSAR). However, by mysterious way the Naive Bayes Classifier usually gives a very nice and good presentation of recognition. More complex models of Bayes Classifier cannot improve it considerably. We demonstrate here a very nice and simple proof of the Naive Bayes Classifier optimality that can explain this interesting fact. The derivation in the current paper is based on a paper of the author written in 2002.