MATH 11400 	Statistics 1	2008-09
5. Sampling variation: (a) Simulation based methods, (b) Central Limit Theorem

Aims | Objectives | Reading | Handouts & Problem Sheets | Questions | Links

Return to the Statistics1 course information page

Aims

In the previous sections we have seen several different ways of estimating a population parameter, or population quantity of interest, from a given set of sample data. However, the sample data is just one of many possible samples that could be drawn from the population. Each sample would have different values, and so would give a different value for the estimate. In this section we use simulation based methods to investigate how the value of an estimate would vary as we took different independent random samples and hence evaluate and compare the performance of different estimators.

Many estimators are based on the sum - or the mean value - of the observations in a random sample from an underlying population distribution. The exact distribution of these quantities may be difficulty to compute, and will usually vary with the underlying population distribution. The Central Limit Theorem gives a simple way of approximating the distribution of the sum or mean, that depends only on the population mean and the population variance. It also provides a plausible explanation for the fact that the distribution of many random variables studied in physical experiments are approximately Normal, in that their value may represent the overall addition of a number of individual randon factors.


Objectives

The following objectives will help you to assess how well you have mastered the relevant material. By the end of this section you should be able to:


Suggested Reading

RossChapter 10 Sections 10.1-10.3 Simulation
RiceChapter 8 Sections 8.4 Method of Moments (Example C)
Sections 8.5 Method of Maximum Likelihood (Example C)
Sections 8.8 Concluding Remarks
RiceChapter 5 Section 5.3 Convergence in distribution and the Central Limit Theorem


Handouts and Problem Sheets

Copies of Handouts, Problem Sheets and Solution Sheets for the unit will be made available each week on the Statistics 1 course pages on
Blackboard.


Questions - set this week

PROBLEM SHEET 5 -- Questions 1, 3, 4


Interesting links

Rice Virtual Lab in Statistics
This site was introduced in the web page for section 1, and contains is a very nice collection of applets, simulations, demonstrations and information on many aspects of statistics. Particularly worth visiting this week is an applet which explores various aspects of sampling distributions. When the applet begins, a histogram of a normal distribution is displayed at the top of the screen, and you can see how sample quantities relate to population quantities for different distributions, different statistics, different sample sizes, different numbers of repeated samples and so on.

Also worth visiting this week is an applet which illustrates the Central Limit Theorem by exploring how the Normal distribution can be used to approximate the Binomial distribution.

Vestac
The Vestac site, also introduced in section 1, has some simple applets for visualising the distribution of a sample mean and the distribution of a sample variance. First, select the Basics link; then select the appropriate picture icon (continuous pdf or discrete pmf) above the required distribution; then choose the type of distribution (Normal, Uniform, Binomial, Poisson etc.).

Note that I have no control over the content or availability of these external web pages. The links may be slow to load, or may sometimes fail altogether - please email me to report if a link goes down. Similarly applets may be slow to load or run, but beware that you may experience problems if you try to exit them before they have finished loading.


Return to the Statistics1 information page


Dr E J Collins,
Department of Mathematics,
University of Bristol, Bristol, BS8 1TW, UK
Email: E.J.Collins@bristol.ac.uk
Telephone: +44 (0) 117 928 7977; Fax: +44 (0) 117 928 7999