A university administered a geometry test to a new batch of exchange students. All of the students
received failing grades because they were unfamiliar with the language, English, that was used to
administer the test. The test was designed to evaluate the students' knowledge of geometry but it
reflected their knowledge and proficiency in English instead. This scenario is an example of _____. -
Answers measurement error
If X is used to represent an observed score, T to represent a true score, and E to represent error, then
X=_____. - Answers T + E
A statistic useful in describing sources of test score variability is the variance ____ (σ2). - Answers
variance
If σ2 represents the total variance, σ2thσth2 represents the true variance, and σ2eσe2 represents the
error variance, then the relationship of the variances in an observed distribution of test scores can be
expressed as _____. - Answers σ2= σ2th+σ2e
True or false: In the language of psychometrics, reliability refers to consistency in measurement. -
Answers true
In an observed distribution of test scores, the proportion of the total variance attributed to true
variance refers to _____. - Answers reliability
The term _____ refers to the inherent uncertainty associated with any measurement, even after care
has been taken to minimize preventable mistakes. - Answers measurement error
The variation among items within a test as well as variation among items between tests is known as
_____. - Answers content sampling
Identify the component of an observed test score that has nothing to do with a testtaker's ability. -
Answers error
Variance is expressed as the _____. - Answers standard deviation squared
In the context of sources of error variance during test administration, identify an example of a
testtaker variable. - Answers the effect of medication on a respondent
Identify a potential source of error variance during test administration. - Answers examiner-related
variables
The reliability of a test is greater when the _____. - Answers proportion of the total variance
attributed to true variance is large
From the perspective of a test creator, a challenge in test development is to _____. - Answers
maximize the proportion of the total variance that is true variance and to minimize the proportion of
the total variance that is error variance
An estimate of reliability obtained by correlating pairs of scores from the same people on two
different administrations of the same test is known as _____. - Answers test-retest reliability
True or false: The alternate-forms and parallel-forms reliability of a test are an indication of whether
two forms of a test are really equivalent. - Answers true
A student attempting an entrance examination is unable to concentrate due to certain emotional
problems. In this scenario, the potential source of error variance during test administration is the
_____. - Answers testtaker variable
An estimate of the extent to which item sampling and other errors have affected test scores on
versions of the same test when, for each form of the test, the means and variances of observed test
scores are equal is known as _____. - Answers parallel forms reliability
True or false: The level of professionalism exhibited by examiners is a source of error variance. -
Answers true
Which of the following is a useful measure of reliability when it is impractical or undesirable to assess
reliability with two tests or to administer a test twice? - Answers split-half reliability
In an observed distribution of test scores, the proportion of the total variance attributed to true
variance refers to _____. - Answers reliability
Identify a true statement about test-retest reliability estimates. - Answers This measure is
appropriate when evaluating the reliability of a test that purports to measure something that is
relatively stable over time.
The degree of the relationship between various forms of a test can be evaluated by means of an
alternate-forms or parallel-forms coefficient of reliability known as the _____. - Answers coefficient
of equivalence