Answers
What is a conceptual variable? How the variable is defined at a theoretical level
What is an operational definition? How the variable will be measured or manipulated
What are the three types of reliability? test-retest, interrater reliability, and internal reliability
What is test-retest reliability? The measure produces consistent scores every time it is used
, What is interrater reliability? The measure produces consistent scores no matter who does the measuring
What is internal reliability? The participant provides a consistent pattern of responses, regardless of how
they are asked
Which types of reliability can be analyzed with Interrater Reliability and Test-Retest Reliability
scatterplots?
How is internal reliability assessed? Cronbachs alpha
What is reliability? How consistent the results of a measure are
What is validity? whether the operationalization is measuring what is supposed to measure
How are reliability and validity related? A test must be reliable to be valid
How are reliability and validity distinct? A measure can be reliable but not valid.
A measure cannot be valid without being reliable
What is face validity? It looks like what you want to measure
What is content validity? The measure contains all the parts that your theory says it should contain
What is criterion validity? Your measure is correlated with a relevant behavioral outcome
What is convergent validity? The extent to which the measure correlates with other measures of
theoretically similar constructs
What is discriminant validity? The extent to which the measure does not correlate strongly with measures of
theoretically dissimilar constructs
Why is criterion validity important? It assesses whether the measure is associated with outcomes that it should be
associated with according the theory
What's the difference between correlations and known- correlational evidence examines the relationship between test scores and a
groups evidence? criterion variable.
Known-groups evidence examines whether the test distinguishes between
groups already known to differ
Known-Groups Paradigm A method for establishing criterion validity, in which a researcher tests two or
more groups that are known to differ on the variable of interest, to ensure that
they score differently on a measure of that variable.
What is Cronbach's alpha A correlation-based statistic that measures a scale's internal reliability. Also
called coefficient alpha
What types of questions wording problems can leading, double-barreled, negatively worded
threaten construct validity?
Leading Question When a question's wording leads to a particular response
Double Barreled Questions Asking two questions in one