Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
Chapter 1: The New Statistics
Test Bank
Multiple Choice
1. A variable that is statistically controlled in an analysis is a(n) ______.
a. an independent variable
b. a dependent variable
c. a covariate
d. a manipulated variable
Ans: C
Cognitive Domain: Knowledge
Answer Location: 1.1: Required Background
Difficulty Level: Easy
2. In past years, many investigators have failed to report ______.
a. the effect size
b. the sample sizes
c. descriptive statistics
d. obtained p values
Ans: A
Cognitive Domain: Knowledge
Answer Location: 1.2: What is the “New Statistics”?
Difficulty Level: Easy
3. A primary concern of investigators has been, and often still is, obtaining a p value of
______.
a. .10
b. .05
c. .01
d. .000
Ans: B
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
4. A major change advocated by New Statistics is ______.
a. reduced emphasis on effect size
b. focus on the results of single studies
c. not reporting confidence intervals
d. understanding the limitations of significance tests
Ans: D
, Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
Cognitive Domain: Knowledge
Answer Location: 1.2: What is the “New Statistics”?
Difficulty Level: Easy
5. A primary change proposed by advocates of New Statistics involves summarizing
effect sizes from a number of studies using ______.
a. Bayesian statistics
b. meta-analysis
c. multivariate analysis
d. descriptive statistics
Ans: B
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
6. An emphasis of New Statistics is ______.
a. using increasingly precise p values
b. developing new methods of statistical analysis
c. reducing emphasis on confidence interval interpretation
d. adopting a more critical perspective when considering significance
Ans: D
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
7. Which of the following types of information is provided to investigators by NHST?
a. whether the hypothesis of the study has been proven
b. the probability that the research hypothesis is true
c. the probability of obtaining results about the H0 based on one sample
d. the exact probability of obtaining the same results on replication
Ans: C
Cognitive Domain: Analysis
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Hard
8. When reading an article that reports the results of multiple statistical tests, readers
should remember that multiple tests ______.
a. provide inaccurate information about the risks of Type I errors
b. provide inaccurate information about the risks of Type II errors
c. enhance understanding of cause and effect relationships
d. provide reliable information about the size and importance of effects
Ans: A
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
, Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
9. An advocate of New Statistics would object to a research report that included a
statement like the ______.
a. results of our study are consistent with a recent meta-analysis
b. significant results should be interpreted cautiously due to the large sample size
c. results of our study approached statistical significance
d. results of our study provide support for our initial hypothesis
Ans: C
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
10. If a statistical analysis yields p = .03, a research report can include a statement like
______.
a. the results of our study are likely to be replicated
b. the evidence is consistent with the hypothesis of our study
c. there is a 97% chance that the null hypothesis of our study is false
d. the results of our study cannot be explained by chance
Ans: B
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
11. An advocate of New Statistics would support a p value reported as ______.
a. p = .0000
b. p < .01
c. p < .05
d. p = .025
Ans: D
Cognitive Domain: Knowledge
Answer Location: 1.4: Problems with NHST Logic
Difficulty Level: Easy
12. A problem with NHST logic is that it ______.
a. eliminates the need to think in terms of double negatives
b. encourages investigators to describe study results in terms of uncertainty
c. cannot tell investigators what they want to know
d. is used consistently and correctly in the majority of studies
Ans: C
Cognitive Domain: Comprehension
Answer Location: 1.4: Problems with NHST Logic
Difficulty Level: Medium
13. An important assumption underlying the use of an independent samples t test or
one-way ANOVA is that ______.
a. the grouping variables are normally distributed in the population
, Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
b. the variances of the groups on the dependent variable are equal
c. all participants respondents responded to both the pretest and the posttest
d. all scores in each group lie within one standard deviation of the mean
Ans: B
Cognitive Domain: Comprehension
Answer Location: 1.5.1: Violations of Assumptions
Difficulty Level: Medium
14. An important assumption underlying the use of Pearson r is that ______.
a. the relationship between the two variables is linear
b. the variances of the X and Y scores are equal
c. all participants respondents responded to both the pretest and the posttest
d. all scores in each variable lie within one standard deviation of the variable mean
Ans: A
Cognitive Domain: Comprehension
Answer Location: 1.5.1: Violations of Assumptions
Difficulty Level: Medium
15. A frequent violation of the rules for using NHST is ______.
a. performing only one significance test
b. selecting random samples from the population of interest
c. selecting the statistical test after data collection
d. selecting the criterion p value before analyzing the data
Ans: C
Cognitive Domain: Analysis
Answer Location: 1.5.2: Violations of Rules for Use of NHST
Difficulty Level: Hard
16. If scores on an attitude scale can range from 0 to 60 with most scores lying between
20 and 45, scores of 7 and 57 could be ______.
a. likelihood errors
b. probability errors
c. extraneous variables
d. outliers
Ans: D
Cognitive Domain: Analysis
Answer Location: 1.5.2: Violations of Rules for Use of NHST
Difficulty Level: Hard
17. Another term describing the process of testing the reproducibility of research results
by repeating studies in different settings with different participants is ______.
a. replication.
b. generalization
c. normalization
d. refutation
Ans: A
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
Chapter 1: The New Statistics
Test Bank
Multiple Choice
1. A variable that is statistically controlled in an analysis is a(n) ______.
a. an independent variable
b. a dependent variable
c. a covariate
d. a manipulated variable
Ans: C
Cognitive Domain: Knowledge
Answer Location: 1.1: Required Background
Difficulty Level: Easy
2. In past years, many investigators have failed to report ______.
a. the effect size
b. the sample sizes
c. descriptive statistics
d. obtained p values
Ans: A
Cognitive Domain: Knowledge
Answer Location: 1.2: What is the “New Statistics”?
Difficulty Level: Easy
3. A primary concern of investigators has been, and often still is, obtaining a p value of
______.
a. .10
b. .05
c. .01
d. .000
Ans: B
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
4. A major change advocated by New Statistics is ______.
a. reduced emphasis on effect size
b. focus on the results of single studies
c. not reporting confidence intervals
d. understanding the limitations of significance tests
Ans: D
, Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
Cognitive Domain: Knowledge
Answer Location: 1.2: What is the “New Statistics”?
Difficulty Level: Easy
5. A primary change proposed by advocates of New Statistics involves summarizing
effect sizes from a number of studies using ______.
a. Bayesian statistics
b. meta-analysis
c. multivariate analysis
d. descriptive statistics
Ans: B
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
6. An emphasis of New Statistics is ______.
a. using increasingly precise p values
b. developing new methods of statistical analysis
c. reducing emphasis on confidence interval interpretation
d. adopting a more critical perspective when considering significance
Ans: D
Cognitive Domain: Knowledge
Answer Location: 1.2: What Is the “New Statistics”?
Difficulty Level: Easy
7. Which of the following types of information is provided to investigators by NHST?
a. whether the hypothesis of the study has been proven
b. the probability that the research hypothesis is true
c. the probability of obtaining results about the H0 based on one sample
d. the exact probability of obtaining the same results on replication
Ans: C
Cognitive Domain: Analysis
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Hard
8. When reading an article that reports the results of multiple statistical tests, readers
should remember that multiple tests ______.
a. provide inaccurate information about the risks of Type I errors
b. provide inaccurate information about the risks of Type II errors
c. enhance understanding of cause and effect relationships
d. provide reliable information about the size and importance of effects
Ans: A
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
, Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
9. An advocate of New Statistics would object to a research report that included a
statement like the ______.
a. results of our study are consistent with a recent meta-analysis
b. significant results should be interpreted cautiously due to the large sample size
c. results of our study approached statistical significance
d. results of our study provide support for our initial hypothesis
Ans: C
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
10. If a statistical analysis yields p = .03, a research report can include a statement like
______.
a. the results of our study are likely to be replicated
b. the evidence is consistent with the hypothesis of our study
c. there is a 97% chance that the null hypothesis of our study is false
d. the results of our study cannot be explained by chance
Ans: B
Cognitive Domain: Application
Answer Location: 1.3: Common Misinterpretations of p Values
Difficulty Level: Medium
11. An advocate of New Statistics would support a p value reported as ______.
a. p = .0000
b. p < .01
c. p < .05
d. p = .025
Ans: D
Cognitive Domain: Knowledge
Answer Location: 1.4: Problems with NHST Logic
Difficulty Level: Easy
12. A problem with NHST logic is that it ______.
a. eliminates the need to think in terms of double negatives
b. encourages investigators to describe study results in terms of uncertainty
c. cannot tell investigators what they want to know
d. is used consistently and correctly in the majority of studies
Ans: C
Cognitive Domain: Comprehension
Answer Location: 1.4: Problems with NHST Logic
Difficulty Level: Medium
13. An important assumption underlying the use of an independent samples t test or
one-way ANOVA is that ______.
a. the grouping variables are normally distributed in the population
, Instructor Resource
Warner, Applied Statistics II, 3e
SAGE Publishing, 2021
b. the variances of the groups on the dependent variable are equal
c. all participants respondents responded to both the pretest and the posttest
d. all scores in each group lie within one standard deviation of the mean
Ans: B
Cognitive Domain: Comprehension
Answer Location: 1.5.1: Violations of Assumptions
Difficulty Level: Medium
14. An important assumption underlying the use of Pearson r is that ______.
a. the relationship between the two variables is linear
b. the variances of the X and Y scores are equal
c. all participants respondents responded to both the pretest and the posttest
d. all scores in each variable lie within one standard deviation of the variable mean
Ans: A
Cognitive Domain: Comprehension
Answer Location: 1.5.1: Violations of Assumptions
Difficulty Level: Medium
15. A frequent violation of the rules for using NHST is ______.
a. performing only one significance test
b. selecting random samples from the population of interest
c. selecting the statistical test after data collection
d. selecting the criterion p value before analyzing the data
Ans: C
Cognitive Domain: Analysis
Answer Location: 1.5.2: Violations of Rules for Use of NHST
Difficulty Level: Hard
16. If scores on an attitude scale can range from 0 to 60 with most scores lying between
20 and 45, scores of 7 and 57 could be ______.
a. likelihood errors
b. probability errors
c. extraneous variables
d. outliers
Ans: D
Cognitive Domain: Analysis
Answer Location: 1.5.2: Violations of Rules for Use of NHST
Difficulty Level: Hard
17. Another term describing the process of testing the reproducibility of research results
by repeating studies in different settings with different participants is ______.
a. replication.
b. generalization
c. normalization
d. refutation
Ans: A
