Completing the logarithmic scoring rule for assessing probability distributions

Abstract

We propose and motivate an expanded version of the logarithmic score for forecasting distributions, termed the Total Log score. It incorporates the usual logarithmic score, which is recognised as incomplete and has been mistakenly associated with the likelihood principle. The expectation of the Total Log score equals the Negentropy plus the Negextropy of the distribution. We examine both discrete and continuous forms of the scoring rule, and we discuss issues of scaling for scoring assessments. The analysis suggests the dual tracking of the quadratic score along with the usual log score when assessing the qualities of probability distributions. An application to the sequential scoring of forecast distributions for the daily rate of stock returns displays the usefulness of the proposal.