Traditional Case Management Program Evaluation: A 7-Step Model

1. Review/define program’s strategic goals.

• Review strategic goals of program.

• Determine whether views of all major stakeholders are represented.

• If views of all major stakeholders are not represented, interview stakeholders to determine views.

• Define major goals based on stakeholder interviews.

2. Match case management interventions to outcomes.

• Define major goals of program.

• Determine whether goals are stated in measurable terms.

• If goals are not stated in measurable terms, rewrite them.

• Match case management interventions to outcomes.

3. Control for practice variation.

• Match case management interventions to outcomes.

• Determine whether all case managers provide core elements of the intervention.

• If all case managers do not provide core elements, analyze available process outcome data trends for significant variation.

• Review practice protocol with case managers and repeat orientation to the intervention.

• Select target outcome indicators.

4. Select outcome measurement tools.

• Select target outcome indicators.

• Determine whether tools exist for measuring those indicators.

• If there are no tools for measuring those indicators, conduct a search for measurement tools.

• Select outcome measurement tools.

5. Select a design for the study.

• Select a design.

• Determine whether it will support desired conclusions.

• If design does not support desired conclusions, explore alternative designs.

• Determine whether budget will support study design.

• If budget will not support study design, explore alternative designs.

6. Collect, analyze, and present data.

• Collect and analyze data.

• Determine whether findings support predicted conclusions.

• If findings do not support predicted conclusions, identify and analyze sources of error in data collection and analysis.

• Identify limitations of study.

7. Disseminate and use the findings.

• Identify limitations of the study.

• Prepare findings for dissemination and report them to others inside and outside your organization.

• Identify improvements for practice and evaluation.