CAOT NOTCE Exam – Research Questions And
Answers Verified 100% Correct
When to use a formative evaluation, evaluability assessment or needs assessment? -
ANSWER- •During the development of a new program.
•When an existing program is being modified or is being used in a new setting or with a
new population.
What a formative evaluation, evaluability assessment or needs assessment shows? -
ANSWER- - whether the proposed program elements are likely to be needed,
understood, and accepted by the population you want to reach.
• The extent to which an evaluation is possible, based on the goals and objectives.
Why is a formative evaluation, evaluability assessment or needs assessment useful? -
ANSWER- - It allows for modifications to be made to the plan before full
implementation begins.
•Maximizes the likelihood that the program will succeed.
When to use a process evaluation or program monitoring? - ANSWER- - as soon as
program implementation begins
- during operation of an existing program
What a process evaluation or program monitoring shows? - ANSWER- •How well the
program is working.
•The extent to which the program is being implemented as designed.
•Whether the program is accessible and acceptable to its target population.
Why a process evaluation or program monitoring is useful? - ANSWER- - Provides an
early warning for any problems that may occur.
•Allows programs to monitor how well their program plans and activities are working.
When to use an outcome evaluation, objectives-based evaluation? - ANSWER- •After
the program has made contact with at least one person or group in the target
population.
What an outcome evaluation or objectives-based evaluation shows - ANSWER- The
degree to which the program is having an effect on the target population's behaviors.
Why a outcome evaluation or objectives-based evaluation is useful - ANSWER- Tells
whether the program is being effective in meeting it's objectives.
, When to use an economic evaluation, cost analysis, cost-effectiveness evaluation, cost-
benefit analysis, or cost-utility analysis - ANSWER- At the beginning of a program.
•During the operation of an existing program.
What a economic evaluation, cost analysis, cost-effectiveness evaluation, cost-benefit
analysis, or cost-utility analysis shows - ANSWER- What resources are being used in a
program and their costs (direct and indirect) compared to outcomes.
Why is an economic evaluation, cost analysis, cost-effectiveness evaluation, cost-
benefit analysis, or cost-utility analysis useful? - ANSWER- Provides program managers
and funders a way to assess cost relative to effects. "How much bang for your buck"
When to use an impact evaluation - ANSWER- - During the operation of an existing
program at appropriate intervals.
-At the end of a program.
What an impact evaluation shows - ANSWER- The degree to which the program meets
its ultimate goal on an overall rate of STD transmission (how much has program X
decreased the morbidity of an STD beyond the study population).
Why is an impact evaluation useful? - ANSWER- Provides evidence for use in policy
and funding decisions.
What is the best first step for a therapist to learn about a treatment approach? -
ANSWER- study peer-reviewed literature on the topic
test-retest reliability - ANSWER- the same group of people is tested at 2 different times
with the same test.
interrater reliability - ANSWER- correlation between the scores of two independent
observerse. A good test/assessment will be developed to keep this high. Done through
standardization of administration and scoring guidelines
construct validity - ANSWER- asks whether the procedure we are using is actually an
adequate definition of the construct we are actually measuring
face validity - ANSWER- does a procedure appear to measure what it claims to
measure?
Answers Verified 100% Correct
When to use a formative evaluation, evaluability assessment or needs assessment? -
ANSWER- •During the development of a new program.
•When an existing program is being modified or is being used in a new setting or with a
new population.
What a formative evaluation, evaluability assessment or needs assessment shows? -
ANSWER- - whether the proposed program elements are likely to be needed,
understood, and accepted by the population you want to reach.
• The extent to which an evaluation is possible, based on the goals and objectives.
Why is a formative evaluation, evaluability assessment or needs assessment useful? -
ANSWER- - It allows for modifications to be made to the plan before full
implementation begins.
•Maximizes the likelihood that the program will succeed.
When to use a process evaluation or program monitoring? - ANSWER- - as soon as
program implementation begins
- during operation of an existing program
What a process evaluation or program monitoring shows? - ANSWER- •How well the
program is working.
•The extent to which the program is being implemented as designed.
•Whether the program is accessible and acceptable to its target population.
Why a process evaluation or program monitoring is useful? - ANSWER- - Provides an
early warning for any problems that may occur.
•Allows programs to monitor how well their program plans and activities are working.
When to use an outcome evaluation, objectives-based evaluation? - ANSWER- •After
the program has made contact with at least one person or group in the target
population.
What an outcome evaluation or objectives-based evaluation shows - ANSWER- The
degree to which the program is having an effect on the target population's behaviors.
Why a outcome evaluation or objectives-based evaluation is useful - ANSWER- Tells
whether the program is being effective in meeting it's objectives.
, When to use an economic evaluation, cost analysis, cost-effectiveness evaluation, cost-
benefit analysis, or cost-utility analysis - ANSWER- At the beginning of a program.
•During the operation of an existing program.
What a economic evaluation, cost analysis, cost-effectiveness evaluation, cost-benefit
analysis, or cost-utility analysis shows - ANSWER- What resources are being used in a
program and their costs (direct and indirect) compared to outcomes.
Why is an economic evaluation, cost analysis, cost-effectiveness evaluation, cost-
benefit analysis, or cost-utility analysis useful? - ANSWER- Provides program managers
and funders a way to assess cost relative to effects. "How much bang for your buck"
When to use an impact evaluation - ANSWER- - During the operation of an existing
program at appropriate intervals.
-At the end of a program.
What an impact evaluation shows - ANSWER- The degree to which the program meets
its ultimate goal on an overall rate of STD transmission (how much has program X
decreased the morbidity of an STD beyond the study population).
Why is an impact evaluation useful? - ANSWER- Provides evidence for use in policy
and funding decisions.
What is the best first step for a therapist to learn about a treatment approach? -
ANSWER- study peer-reviewed literature on the topic
test-retest reliability - ANSWER- the same group of people is tested at 2 different times
with the same test.
interrater reliability - ANSWER- correlation between the scores of two independent
observerse. A good test/assessment will be developed to keep this high. Done through
standardization of administration and scoring guidelines
construct validity - ANSWER- asks whether the procedure we are using is actually an
adequate definition of the construct we are actually measuring
face validity - ANSWER- does a procedure appear to measure what it claims to
measure?
