Assessment in Counseling Mid-Term 3
Questions with 100% Correct answers
|Verified Solutions
What is good reliability - ✔✔.8-.9 published
.75 good enough threshold for clinical
.8 is good enough for research
SEM - ✔✔Standard error of Measurement, the standard deviation of the normal
distribution, the smaller the SEM the less variance therefore higher reliability, the higher the
SEM the lower the reliability
Factors that Affect Reliability - ✔✔-the length of the test
-the test or instrument being used is designed for the population being assessed
-increased heterogeneity of the group used to norm the instrument
-use an optimal time interval between test administrations
Validity - ✔✔Accuracy, a measure of an instrument's ability to accurately assess a given trait
or variable, what is validated is the application of instruments and how the results are
interpreted
Validity's importance for counselors - ✔✔speaks truthfulness of data, to provide
more effective services, helps advance field, accountability
Relationship between validity and reliability - ✔✔reliability and validity not mutually
exclusive concepts, for an assessment to be valid it must be reliable, reliability necessary
but not sufficient condition for validity
V needs R
R doesn't need V
,1900s validity criterion - ✔✔-if it was predicitive
-just looking at the correlation between two things
Source of Validity: Content Validity - ✔✔the ability of an instrument to assess or measure a
construct of interest, when questions or items sufficiently sample from the entire universe of
items for which the instrument was designed to sample, make sure well-established construct,
then domains or subcategories of that construct are identified, used by looking at similar
constructs of past tests
elements of validity - ✔✔content, criterion, and construct
Process of content validity - ✔✔1. content validation is made sure a well-
established construct is being used
2. domains or subcategories of that construct are identified
3.instrument is developed
4. put through a panel of experts
5. content validity ratio
Panel of experts - ✔✔field experts: research published in the field or its presented in
their own clinical work
lay experts: non-professionals with personal experiences, someone who is affected
content validity ratio - ✔✔ratio of the number of raters who evaluate an item and the
number of raters who deem an item to be an essential component of the construct being
measured, Negative CVR-item is not essential, positive CVR: vlues indicate the item is
essential, the higher the CVR value the better the item is at assessing an essential component
of the construct of interest
, Criterion-related validity: sources of validity - ✔✔assess whether a test reflects a certain
set of abilities, test scores are compared to a known standard or outcome, used when
researchers are interested in understanding the degree to which an assessment instrument
predicts a specific outcome measure of a criterion, comparing similar tests to that you know
that your criteria is similar to that of another test
criterion - ✔✔the standard or outcome measured
how to obtain criterion validity evidence - ✔✔concurrent validity, predictive validity
Concurrent validity - ✔✔assessed when the test score and criterion performance
measured are collected at approximately the same time
Questions with 100% Correct answers
|Verified Solutions
What is good reliability - ✔✔.8-.9 published
.75 good enough threshold for clinical
.8 is good enough for research
SEM - ✔✔Standard error of Measurement, the standard deviation of the normal
distribution, the smaller the SEM the less variance therefore higher reliability, the higher the
SEM the lower the reliability
Factors that Affect Reliability - ✔✔-the length of the test
-the test or instrument being used is designed for the population being assessed
-increased heterogeneity of the group used to norm the instrument
-use an optimal time interval between test administrations
Validity - ✔✔Accuracy, a measure of an instrument's ability to accurately assess a given trait
or variable, what is validated is the application of instruments and how the results are
interpreted
Validity's importance for counselors - ✔✔speaks truthfulness of data, to provide
more effective services, helps advance field, accountability
Relationship between validity and reliability - ✔✔reliability and validity not mutually
exclusive concepts, for an assessment to be valid it must be reliable, reliability necessary
but not sufficient condition for validity
V needs R
R doesn't need V
,1900s validity criterion - ✔✔-if it was predicitive
-just looking at the correlation between two things
Source of Validity: Content Validity - ✔✔the ability of an instrument to assess or measure a
construct of interest, when questions or items sufficiently sample from the entire universe of
items for which the instrument was designed to sample, make sure well-established construct,
then domains or subcategories of that construct are identified, used by looking at similar
constructs of past tests
elements of validity - ✔✔content, criterion, and construct
Process of content validity - ✔✔1. content validation is made sure a well-
established construct is being used
2. domains or subcategories of that construct are identified
3.instrument is developed
4. put through a panel of experts
5. content validity ratio
Panel of experts - ✔✔field experts: research published in the field or its presented in
their own clinical work
lay experts: non-professionals with personal experiences, someone who is affected
content validity ratio - ✔✔ratio of the number of raters who evaluate an item and the
number of raters who deem an item to be an essential component of the construct being
measured, Negative CVR-item is not essential, positive CVR: vlues indicate the item is
essential, the higher the CVR value the better the item is at assessing an essential component
of the construct of interest
, Criterion-related validity: sources of validity - ✔✔assess whether a test reflects a certain
set of abilities, test scores are compared to a known standard or outcome, used when
researchers are interested in understanding the degree to which an assessment instrument
predicts a specific outcome measure of a criterion, comparing similar tests to that you know
that your criteria is similar to that of another test
criterion - ✔✔the standard or outcome measured
how to obtain criterion validity evidence - ✔✔concurrent validity, predictive validity
Concurrent validity - ✔✔assessed when the test score and criterion performance
measured are collected at approximately the same time
