(EDAPT WEEK 5 NOTES)
EVIDENCE BASED
Complex Adult Health
,WEEK 5 EVIDENCE BASED EDAPT NOTES
VALIDITY OF RESEARCH:
Quality research helps nurses improve the health and lives of clients and communities. But
what does quality research mean and how do we know if research is of good quality?
Which term explains an influence that can distort study results or conclusions?
Bias is any influence that can distort study results or conclusions.
Validity is the extent a tool or method measures what it is supposed to measure. Reliability
is the measure of consistency. Credibility relates to the trustworthiness of results .
Validity is the extent a tool or method measures what it is supposed to
measure. Reliability is the measure of consistency.
Validity versus reliability:
How do you know a research article you read is quality evidence? It sounds professional,
uses research-type language, is written by professionals, and has amazing results, but is it
credible?
In 1998, a paper was published in a prestigious peer-reviewed journal linking the measles,
mumps, and rubella (MMR) vaccine to autism. The study was critically flawed but the
damage was done and caused a wave of mistrust in vaccines.
Which situation is not possible?
To be valid, a measurement or instrument must also be reliable. Therefore, you cannot
have low reliability and high validity.
TYPES OF VALIDITY:
Now you understand that validity tells you an instrument or method measures what it is
supposed to measure. For example, our study wants to determine whether music therapy
can help reduce pain during burn wound treatment in young children. A valid study would
be one that measures pain accurately and at the correct times. A valid instrument would be
a pain scale that accurately measures pain in young children.
You can already see that validity, which we thought just meant accurate, is a little more
complicated. There are several different types of validity. It is essential to understand these
different types when reviewing and appraising research. View the slideshow below to learn
each type of validity.
Validity
Results satisfy objectives
, Internal validity: The study establishes a trustworthy cause-and-effect relationship between
a treatment and an outcome.
External validity: How the study results are applicable in other settings or the
generalizability of the study results.
Construct validity: Does the test measure what it is supposed to measure?
Content validity: Are the test items fully representative of the entire domain it is intended
to measure?
Conclusion validity: The conclusions of the study are reasonable.
Inter-rater or intercoder reliability is the extent to which two different raters or coders
(researchers) reach the same conclusion about a code or item.
Test-retest reliability is repeatability of a test. It can reproduce the same results when
administered multiple times; for instance, testing a population before an intervention, then
after an intervention, or in the control group administering the same test without an
intervention.
Parallel form’s reliability is when different versions of an instrument both measure the
same thing; for instance, exam version A measures the same thing as exam version B.
Intra-rater reliability is the degree to which the same rater or coder reaches the same
conclusion about a code or item over time.
QUALITY AND QUANTITY RESEARCH:
Quality is just as important in qualitative research as in quantitative research. However,
validity and reliability look a bit different in qualitative research. Reliability can be
challenging due to the nature of qualitative research. Inter-rater and intra-rater reliability
are two factors that are relevant to qualitative research.
Validity in qualitative research relates to the appropriateness of the methods, processes,
and instruments in addressing the research question. For example, are the results and
conclusions validly based on the sample, context, and data? If researchers draw
conclusions that are not based on data, the study is not valid.
Triangulation is one method to help ensure validity in qualitative research that involves
using multiple methods or data sources to show the convergence of the data (Carter et al.,
2014). For instance, one might survey a sample population, then utilize interviews and
focus groups to ensure that data from the survey is like data from the interviews and focus
groups. If the survey data is very different from that of one of the other instruments, the
study may lack validity.
Credibility, or trustworthiness, is an essential concept in qualitative research (Galdas,
2017). For example, are the researchers trustworthy, is the process appropriately