1 Inference for a Single Population Proportion (p)
2 Sampling Distribution of the Sample Proportionwhere n = sample size and x = the observed number of “successes” in the sample p = estimate of population proportion p = proportion of sample having a specified attribute = ^ x n
3 Sampling Distribution of the Sample ProportionThe histograms below show the estimated sampling distribution of the sample proportion based upon 1000 samples of the drawn for the given sample size (n). For larger samples, the sampling distribution of the sample proportion is approximately normal.
4 Sampling Distribution of the Sample ProportionProvided n is “sufficiently large”, the sampling distribution is normal, generally The mean of the sampling distribution is p = true population proportion Standard deviation of the sampling distribution or the standard error of sample proportion is given by: * 5 is also used.
5 Implications for Inference (n “large”)CI for Population Proportion (p) Test Statistic (Ho: p = po) z-values from standard normal 90% = % = % = 2.578 Effect Size
6 Hypothesis Testing for a Population Proportion (p)Null Hypothesis Ho: p = po Alternative Hypotheses p-value (upper-tailed) z P-value z P-value (lower-tailed)
7 Hypothesis Testing for a Population Proportion (p)Null Hypothesis Ho: p = po Alternative Hypotheses p-value (two-tailed) z - z For two-tailed tests in general it is preferable to simply construct a confidence interval for the parameter of interest and see if the hypothesized value under the null hypothesis is contained in the CI. If it is we fail to reject Ho and if it is not then we reject Ho.
8 Example: Treatment of Kidney CancerHistorically, one in five kidney cancer patients survive 5 years past diagnosis, i.e. 20%. An oncologist using an experimental therapy treats n = 40 kidney cancer patients and 16 of them survive at least 5 years. Is there evidence that patients receiving the experimental therapy have a higher 5-year survival rate?
9 Step 1: Formulate Hypothesesp = the proportion of kidney cancer patients receiving the experimental therapy that survive at least 5 years. Step 2: Determine test criteria Choose may want to consider smaller?) Use large sample test ? Definitely questionable as we have… np = (40)(.20) = 8 > 5 and n(1-p) = (40)(.80) = 32 > 5
10 Step 3: Collect data and compute test statisticThe observed 5-yr. survival rate for kidney cancer patients undergoing the experimental therapy is standard errors above the historical rate!
11 Step 4: Compute p-value Step 5: Make Decision and Interpret z = 3.16 P-value = .0008 It is highly unlikely we would obtain a 40% 5-yr. survival rate in our sample, if in fact the 5-yr. survival rate for the population of patients treated with the experimental therapy was truly 20%. Step 5: Make Decision and Interpret We have very strong evidence to suggest the 5-year survival rate for kidney cancer patients undergoing the experimental therapy is greater than the current 5-yr. survival rate of 20% (p = .0008).
12 Step 6: Quantify significant resultsConfidence Interval Effect Size
13 Power Calculation For power use softwareBaseline proportion is the proportion under the null hypothesis (.20 or 20% here) Difference to detect is the absolute difference between p under alternative and p under null (i.e., = .20) Power is calculated once sample size and difference information is entered (here, Power = .935).
14 Power Curve for n = 40 and po = .20For a difference of .20 Power = .935 as seen on previous slide
15 Sample Size and CI’s for pSuppose we wish to estimate p using a 95% CI and have a margin of error of 3%. What sample size do we need to use? Recall the CI for p is given by: MARGIN OF ERROR (E)
16 Sample Size and CI’s for pHere for a 95% CI we want E = .03 or 3% After some wonderful algebraic manipulation Oh, oh! We don’t know p-hat !! “Guesstimate” Use p-hat from pilot or prior study. Largest n we would ever need comes when p-hat = .50.
17 Sample Size and CI’s for pInformed approach Conservative approach (i.e. worst case scenario) Standard normal values 90% = % = % = 2.578
18 Sample Size and CI’s for pOriginal Question: Suppose we wish to estimate p using a 95% CI and have a margin of error of 3%. What sample size do we need to use? Assume that we estimate the 5 yr. survival rate for a new kidney cancer therapy, and we know historical that it this survival rate is around 20%. Using informed approach
19 Sample Size and CI’s for pOriginal Question: Suppose we wish to estimate p using a 95% CI and have a margin of error of 3%. What sample size do we need to use? Assume that we estimate the 5 yr. survival rate for a new kidney cancer therapy, and we know historical that it this survival rate is around 20%. Using conservative approach This is why in media polls you they usually report a sampling error of + 3% and that the poll was based on a sample of n = 1000 individuals.
20 Small Sample Inference for p: Binomial Exact TestWhen the sample size is “small” the sampling distribution cannot be approximated by a standard normal distribution. However, regardless of sample size the EXACT sampling distribution of the number of “successes” in n independent trials ALWAYS has a Binomial Distribution. Thus if we knew more about the binomial distribution we could use it to find p-values when conducting a hypothesis test and also when constructing confidence intervals for the pop. proportion p.
21 Binomial Probability DistributionA binomial random variable X is defined to the number of “successes” in n independent trials where the P(“success”) = p is constant Notation: X ~ BIN(n,p) In the definition above notice the following conditions need to be satisfied for a binomial experiment: There is a fixed number of n trials carried out. The outcome of a given trial is either a “success” or “failure”. The probability of success (p) remains constant from trial to trial. The trials are independent, the outcome of a trial is not affected by the outcome of any other trial.
22 Binomial DistributionIf X ~ BIN(n, p), then where
23 Binomial DistributionIf X ~ BIN(n, p), then E.g. when n = 3 and p = .50 there are 8 possible equally likely outcomes (e.g. flipping a coin) SSS SSF SFS FSS SFF FSF FFS FFF X=3 X=2 X=2 X=2 X=1 X=1 X=1 X=0 P(X=3)=1/8, P(X=2)=3/8, P(X=1)=3/8, P(X=0)=1/8 Now let’s use binomial probability formula instead…
24 Binomial DistributionIf X ~ BIN(n, p), then E.g. when n = 3, p = .50 find P(X = 2) SSF SFS FSS
25 Example: Treatment of Kidney CancerIn our example we had n = 40 patients and if we assume the experimental therapy is no better than current treatments then probability of 5-year survival is p = .20. Thus the number of patients in our study surviving at least 5 years has a binomial distribution, i.e. X ~ BIN(40,.20).
26 Example: Treatment of Kidney CancerX ~ BIN(40,.20), find the probability that exactly 16 patients survive at least 5 years. This requires some calculator gymnastics and some scratchwork! Also, keep in mind for a p-value we need to find the probability of having 16 or more patients surviving at least 5 yrs. Remember p-value is defined as evidence as extreme or more extreme.
27 Example: Treatment of Kidney CancerSo we actually need to find: p-value = P(X = 16) + P(X = 17) + … + P(X = 40) + … EXACT p-value = YIPES!
28 Example: Treatment of Kidney CancerX ~ BIN(40,.20), find the probability that 16 or more patients survive at least 5 years. USE COMPUTER! Binomial Exact Test p-value calculator in JMP Enter n = sample size x = observed # of “successes” po = proportion under Ho p-values are computed automatically for all three possible alternatives
29 Example: Treatment of Kidney CancerX ~ BIN(40,.20), find the probability that 16 or more patients survive at least 5 years. USE COMPUTER! Binomial Exact Test p-value calculator in JMP Exact p-value = Contrasting this EXACT p-value (p = .0029) to the one calculated earlier using the normal approximation (p = .0008) we see a fairly substantial difference! MORAL: USE EXACT WHEN n is SMALL !!!
30 Exact CI for p using the binomial distributionFind LCL and UCL for p by finding probabilities that meet the following requirements: P(X > x|p = LCL) = and P(X < x|p = UCL) = Use computer to find these probabilities. e.g. for 95% confidence
31 Exact CI for p using the binomial distributionFind a 95% CI for p for the kidney cancer study For the lower confidence limit we find LCL = .248 or .249
32 Exact CI for p using the binomial distributionFind a 95% CI for p for the kidney cancer study For the upper confidence limit we find UCL = .566 or .567 Therefore based on an EXACT 95% confidence interval we estimate that the success rate of the experimental therapy is between 24.8% and 56.7%.
33 Summary of Inference for a Single Population Proportion (p)When n is “large” use large sample methods based on the sampling distribution being approximately normal. (Easy) When n is “small” use exact methods based on the binomial distribution, which requires specific software or tables. (Hard) Exact methods can always be used! In general, precise estimates of a population proportion requires a large samples size, e.g. media polls which typically use n = 1,000.