Criteria for the evaluation of social research:
- Reliability > repeatable & consistent
- Replicability > replicate the findings of others
- Validity > integrity of the conclusions
o Measurement validity > whether a measure that is devised for a concept really does
reflect the concept that it is supposed to be denoting
o Internal validity > whether a conclusion that incorporates a causal relationship
between two or more variables holds water
o External validity > whether the results of a study can be generalized beyond the
specific research context
o Ecological validity > whether social scientific findings are applicable to
people’s everyday, natural social settings
o Inferential validity > whether the authors of a report of research produce inferences
and draw conclusions that are warranted by their research and findings generated
from it
> criteria mainly for quantitative research, qualitative researchers propose different criteria:
- Trustworthiness > criterion of how good a qualitative study is:
o Credibility > parallels with internal validity: how believable are findings
o Transferability > parallels with external validity: do the findings apply to other
contexts
o Dependability > parallels reliability: are the findings likely to apply at other times
o Confirmability > parallels objectivity: has the investigator allowed his/her values to
intrude to a high degree
- Authenticity > concerning broader political impact of research
o Fairness > does the research fairly represent different viewpoints among members of
the social setting?
o Ontological authenticity > does the research help members to arrive at a better
understanding of their social milieu?
o Educative authenticity > does the research help members to appreciate better the
perspectives of other members of their social setting?
o Catalytic authenticity > has the research acted as an impetus to members to engage
in action to change their circumstances?
o Tactical authenticity > has the research empowered members to take the steps
necessary for engaging in action?
Other qualitative:
- Reliability and validity:
External reliability > the degree to which a study can be replicated (= difficult)
Internal reliability > whether, when there is more than one observer, members of the
research team agree about what they see and hear
External validity > whether there is a correspondence between researchers’
observations and the theoretical ideas they develop
Internal validity > the degree to which findings can be generalized across social
settings
, Criteria for indicators:
- Reliability > consistency of a measure of a concept. 3 factors involved:
Stability > stable over time? Results do not fluctuate
Internal reliability > are the indicators that make up the scale consistent?
Inter-rater reliability > subjective judgement involved: lack of consistency in their
decisions
- Measurement validity > refers to the issue of whether an indicator that is devised to gauge a
concept really measures that concept. Establishing validity:
Face validity > the measure apparently reflects the content of the concept in
question
Concurrent validity > the researcher employs a criterion on which cases are known to
differ and that is relevant to the concept in question
Predictive validity > researcher uses a future criterion measure, rather than a
contemporary one
Construct validity > researcher is encouraged to deduce hypotheses from a theory
that is relevant to the concept
Convergent validity > the validity of a measure ought to be gauged by comparing it to
measures of the same concept developed through other methods
Variables:
Dichotomous > nominal > ordinal > interval/ratio
Averages:
- Mean > gemiddelde
- Median > mid-point
- Mode > most frequent
Kwalitatief > verband tussen variabelen
Kwantitatief > achterliggende gedachtes achterhalen
- Reliability > repeatable & consistent
- Replicability > replicate the findings of others
- Validity > integrity of the conclusions
o Measurement validity > whether a measure that is devised for a concept really does
reflect the concept that it is supposed to be denoting
o Internal validity > whether a conclusion that incorporates a causal relationship
between two or more variables holds water
o External validity > whether the results of a study can be generalized beyond the
specific research context
o Ecological validity > whether social scientific findings are applicable to
people’s everyday, natural social settings
o Inferential validity > whether the authors of a report of research produce inferences
and draw conclusions that are warranted by their research and findings generated
from it
> criteria mainly for quantitative research, qualitative researchers propose different criteria:
- Trustworthiness > criterion of how good a qualitative study is:
o Credibility > parallels with internal validity: how believable are findings
o Transferability > parallels with external validity: do the findings apply to other
contexts
o Dependability > parallels reliability: are the findings likely to apply at other times
o Confirmability > parallels objectivity: has the investigator allowed his/her values to
intrude to a high degree
- Authenticity > concerning broader political impact of research
o Fairness > does the research fairly represent different viewpoints among members of
the social setting?
o Ontological authenticity > does the research help members to arrive at a better
understanding of their social milieu?
o Educative authenticity > does the research help members to appreciate better the
perspectives of other members of their social setting?
o Catalytic authenticity > has the research acted as an impetus to members to engage
in action to change their circumstances?
o Tactical authenticity > has the research empowered members to take the steps
necessary for engaging in action?
Other qualitative:
- Reliability and validity:
External reliability > the degree to which a study can be replicated (= difficult)
Internal reliability > whether, when there is more than one observer, members of the
research team agree about what they see and hear
External validity > whether there is a correspondence between researchers’
observations and the theoretical ideas they develop
Internal validity > the degree to which findings can be generalized across social
settings
, Criteria for indicators:
- Reliability > consistency of a measure of a concept. 3 factors involved:
Stability > stable over time? Results do not fluctuate
Internal reliability > are the indicators that make up the scale consistent?
Inter-rater reliability > subjective judgement involved: lack of consistency in their
decisions
- Measurement validity > refers to the issue of whether an indicator that is devised to gauge a
concept really measures that concept. Establishing validity:
Face validity > the measure apparently reflects the content of the concept in
question
Concurrent validity > the researcher employs a criterion on which cases are known to
differ and that is relevant to the concept in question
Predictive validity > researcher uses a future criterion measure, rather than a
contemporary one
Construct validity > researcher is encouraged to deduce hypotheses from a theory
that is relevant to the concept
Convergent validity > the validity of a measure ought to be gauged by comparing it to
measures of the same concept developed through other methods
Variables:
Dichotomous > nominal > ordinal > interval/ratio
Averages:
- Mean > gemiddelde
- Median > mid-point
- Mode > most frequent
Kwalitatief > verband tussen variabelen
Kwantitatief > achterliggende gedachtes achterhalen
