Outcome/Impact Evaluation Designs
A, Non-Experimental Design
• Outcomes only tracked for intervention group (those that received the service)
Pre-test Treatment Post-test
Single Group - post-test only X 0
Single Group - pre- and posttest 0 X 0
X = intervention is administered 0 = measurement is taken
B. Quasi Experimental Design
• Collect data on two+ study groups (intervention group and comparison group)
• Intervention and comparison groups:
o identified from pre-existing or self-selected groups
o not formed through a random assignment process
• NOTE: Pre-existing differences between the intervention and comparison groups at the outset
of the intervention may lead to inaccurate estimates of the program’s effects.
Pre-test Treatment Post-test
Intervention Group 0 X 0
Comparison Group 0 0
X = intervention is administered 0 = measurement is taken
C. Experimental Design
• Collect data on two+ study groups (intervention group and comparison group)
• Random assignment techniques (e.g., lottery draw) are used by the evaluator to assign study
participants to either the intervention or the control group.
• NOTE: Random assignment ensures study groups are equivalent PRIOR to intervention.
Considered most credible design for producing evidence of program impact.
Pre-test Treatment Post-test
Intervention Group - Randomly assigned 0 X 0
Control Group - Randomly assigned 0 0
X = intervention is administered 0 = measurement is taken
2/2017 Adapted from CNCS Evaluation Core Curriculum by Susan Hyatt, Big Purpose Big Impact