Fundamentals of Statistics contains material of various lectures and courses of H. Lohninger on statistics, data analysis and chemometrics......click here for more. 
Home Basic Concepts Decimal Places and Precision  
See also: standard deviation  
Decimal Places and PrecisionBeginners in the field often ignore some simple facts concerning the number of significant digits of a result. The use of pocket calculators usually results in values with too many decimal places, regardless of whether this is meaningful. In general, one should use only as many decimal places as are compatible with the precision of your experiments. It may therefore be necessary to determine the precision of a measurement by repeating it several times and calculating the standard deviation.
In addition to the signal variation the accuracy of measurements may become even worse for quantities which are determined by the calculation of differences or ratios.


Home Basic Concepts Decimal Places and Precision 