Cloud Hosting

Have you ever wondered what the difference is between standard deviation and standard error?

If you havent, heres why you should care.

Standard deviation measures the dispersion variability of the data in relation to the mean. In other words, the closer to zero the standard deviation is, the closer to the mean the values are in the studied data set. The standard distribution gives us valuable information in terms of the percentage of data within one, two and three standard deviations from the mean.

Lets use R to generate some random data:

Now, lets generate a normally distributed graph:

When we calculate the mean of a particular sample, were not interested in the mean of that sample. Instead, we want to draw conclusions about the population from which the sample comes. We usually collect representative sample data because were limited in terms of resources for collecting information about the whole population. So, well use it as an estimate of the whole population mean.

More on DataUnderstanding Box Plots

Of course, there will be different means for different samples from the same population This is called the sampling distribution of the mean.You can use the standard deviation of the sampling distribution to estimate the variance between the means of different samples. This is the standard error of the estimate of the mean. This is where everybody gets confused. The standard error is a type of standard deviation for the distribution of the means.

In short, standard error measures the precision of the estimate of the sample mean.

The standard error is strictly dependent on the sample size. As a result, the standard error falls as the sample size increases. If you think about it, the bigger the sample, the closer the sample mean is to the population mean, and thus, the closer the estimate is to the actual value.

R code for computing standard error below:

More on Data16 Data Modeling Tools You Should Know

If you need to draw conclusions about the spread and variability of the data, use standard deviation.

If youre interested in finding how precise the sample mean is or youre testing the differences between two means, then standard error is your metric.

Excerpt from:

The Difference Between Standard Deviation and Standard Error - Built In