Assessment in Counseling Mid-Term 3 Questions
with 100% Correct answers |Verified Solutions
Classical Test Theory - ✔✔true score model, set of psychometric procedures that can test
the reliability, difficulty, and discriminatory properties of test items and scales, how
measurement impacts our understanding of individual's true ability levle on a test or
measurement, test score can be achieved by individual actually comprised multiple items.
where X=T+E or True Scores is the the True score plus the Error.
Systematic Error - ✔✔test is being used and it consistently measures something other than
the trait it was designed to assess, imperfect construct validity
Unsystematic Error - ✔✔collection of factors that contribute to the variation in scores across
administrations of a test or instrument, also called random error
Sources of Measurement Error - ✔✔1. Systematic error
2. Unsystematic Error
3.time sampling error
4. content sampling error
5.test administration error
6. test taker variables
Time Sampling Error - ✔✔results from repeated administrations of a test to the same
individual, there could be carryover effect, practice effect or fatigue
Carryover effect - ✔✔time sampling error when an experimental treatment continues to
affect a participant long after the treatment is administered
,Practice effect - ✔✔a time sampling error when individuals improve their scores across test
administrations as a result of increased familiarity and comfort with a test and the content that
is being assessed
Fatigue - ✔✔time sampling error, when clients tire from multiple administrations of a test
content sampling error - ✔✔also known as domain sampling errors, development and
construction of tests, when tests do not adequately assess the construct the test was designed
to assess
Test Administration Error - ✔✔When standardized administration protocol for test is not
followed as specified
Test Taker Variables - ✔✔individual differences in test takers that cannot be accounted fro
by the test administrator
Methods of Estimating Reliability - ✔✔1. Test-Retest Reliability
2. Adequate forms reliability
3. Internal Consistency
4. Inter-rater Agreement
Test-Retest reliability - ✔✔assessing how reliable or stable scores on an instrument are over
time, using the same test on two separate occasions, most commonly used method
Alternate Forms Reliability - ✔✔assessing stability using different but equivalent versions of
a test, measuring the same information but different versions of the test,
internal consistency - ✔✔used to determine whether errors associated with the content
sampling are present, looking at individual items if those items are consistent with one another
and represent a singular construct or trait that is being measured by the test
, Methods for assessing internal consistency - ✔✔split-half method, Kuder-richardsons
formulas, cronbach's alpha, for example if an english test had reading, writing, and speaking
how to make sure that each of these test someones ability to know english
Split-Half Method for assessing internal consistency - ✔✔taking a test and dividing into two
comparable halves, test is administered at once and a correlation is computed between the
results of the two halves, i.e.: taking a test and all the odd numbers are one half of the test and
even numbers different half and taking the average of an odd versus even numbers
Kuder-Richardson for assessing internal consistency - ✔✔alternative to the split-half
method, test is administered at once, statistical process is applied to determine split-half
reliability of all possible combinations of test halves that can be created by separating the
items, i.e. only true versus false
crombach's alpha for assessing internal consistency - ✔✔also referred to coefficient alpha,
used when there is no right or wrong answer to the test item, intercorrelations of every
possible item
Inter-rater agreement - ✔✔used to assess level of agreement between two or more raters in
their evaluation of a particular item, extremely objective, Interrater reliability=number of
agreements divided by the total number of obseravtions
What is good reliability - ✔✔.8-.9 published
.75 good enough threshold for clinical
.8 is good enough for research
SEM - ✔✔Standard error of Measurement, the standard deviation of the normal distribution,
the smaller the SEM the less variance therefore higher reliability, the higher the SEM the lower
the reliability
with 100% Correct answers |Verified Solutions
Classical Test Theory - ✔✔true score model, set of psychometric procedures that can test
the reliability, difficulty, and discriminatory properties of test items and scales, how
measurement impacts our understanding of individual's true ability levle on a test or
measurement, test score can be achieved by individual actually comprised multiple items.
where X=T+E or True Scores is the the True score plus the Error.
Systematic Error - ✔✔test is being used and it consistently measures something other than
the trait it was designed to assess, imperfect construct validity
Unsystematic Error - ✔✔collection of factors that contribute to the variation in scores across
administrations of a test or instrument, also called random error
Sources of Measurement Error - ✔✔1. Systematic error
2. Unsystematic Error
3.time sampling error
4. content sampling error
5.test administration error
6. test taker variables
Time Sampling Error - ✔✔results from repeated administrations of a test to the same
individual, there could be carryover effect, practice effect or fatigue
Carryover effect - ✔✔time sampling error when an experimental treatment continues to
affect a participant long after the treatment is administered
,Practice effect - ✔✔a time sampling error when individuals improve their scores across test
administrations as a result of increased familiarity and comfort with a test and the content that
is being assessed
Fatigue - ✔✔time sampling error, when clients tire from multiple administrations of a test
content sampling error - ✔✔also known as domain sampling errors, development and
construction of tests, when tests do not adequately assess the construct the test was designed
to assess
Test Administration Error - ✔✔When standardized administration protocol for test is not
followed as specified
Test Taker Variables - ✔✔individual differences in test takers that cannot be accounted fro
by the test administrator
Methods of Estimating Reliability - ✔✔1. Test-Retest Reliability
2. Adequate forms reliability
3. Internal Consistency
4. Inter-rater Agreement
Test-Retest reliability - ✔✔assessing how reliable or stable scores on an instrument are over
time, using the same test on two separate occasions, most commonly used method
Alternate Forms Reliability - ✔✔assessing stability using different but equivalent versions of
a test, measuring the same information but different versions of the test,
internal consistency - ✔✔used to determine whether errors associated with the content
sampling are present, looking at individual items if those items are consistent with one another
and represent a singular construct or trait that is being measured by the test
, Methods for assessing internal consistency - ✔✔split-half method, Kuder-richardsons
formulas, cronbach's alpha, for example if an english test had reading, writing, and speaking
how to make sure that each of these test someones ability to know english
Split-Half Method for assessing internal consistency - ✔✔taking a test and dividing into two
comparable halves, test is administered at once and a correlation is computed between the
results of the two halves, i.e.: taking a test and all the odd numbers are one half of the test and
even numbers different half and taking the average of an odd versus even numbers
Kuder-Richardson for assessing internal consistency - ✔✔alternative to the split-half
method, test is administered at once, statistical process is applied to determine split-half
reliability of all possible combinations of test halves that can be created by separating the
items, i.e. only true versus false
crombach's alpha for assessing internal consistency - ✔✔also referred to coefficient alpha,
used when there is no right or wrong answer to the test item, intercorrelations of every
possible item
Inter-rater agreement - ✔✔used to assess level of agreement between two or more raters in
their evaluation of a particular item, extremely objective, Interrater reliability=number of
agreements divided by the total number of obseravtions
What is good reliability - ✔✔.8-.9 published
.75 good enough threshold for clinical
.8 is good enough for research
SEM - ✔✔Standard error of Measurement, the standard deviation of the normal distribution,
the smaller the SEM the less variance therefore higher reliability, the higher the SEM the lower
the reliability
