Fundamentals of Statistics contains material of various lectures and courses of H. Lohninger on statistics, data analysis and here for more.

Mallows Cp Statistic

C.L. Mallows developed a method to find adequate models by plotting a special statistic against the number of variables+1.

Cp = SSres/MSres - N + 2p,

  SSres is the residual sum of squares for the model with p-1 variables,
  MSres is the residual mean square when using all available variables,
  N is the number of observations, and
  p is the number of variables used for the model plus one.

The general procedure to find an adequate model by means of the Cp statistic is to calculate Cp for all possible combinations of variables and the Cp values against p. The model with the lowest Cp value approximately equal to p is the most "adequate" model.

Last Update: 2012-10-08