Determining Level of Effectiveness

DETERMINING LEVEL OF EFFECTIVENESS
Operational Criteria Definitions

Transparency: Both the criteria (e.g., how to find evidence, what qualifies as evidence, how to judge quality of evidence) and the process (e.g., who reviews the evidence) of review should be open for observation by public description. For example, results should be published in peer reviewed journal.

Research: Accumulated scientific evidence based on randomized controlled trials, quasi-experimental studies, and in some cases less rigorously controlled studies. Research should be published in appropriate peer reviewed journals and available for review.

Standardization: An intervention must be standardized so that it can be reliably replicated elsewhere by others. Standardization typically involves a description that clearly defines the essential elements of the practice, as evidenced in a manual or toolkit.

Replication: Replication of research findings means that more than one study and more than one group of researchers have found similar positive effects resulting from the practice.

Fidelity Scale: A fidelity scale is used to verify that an intervention is being implemented in a manner consistent with the treatment model – or the research that produced the practice. The scale has been shown to be reliable and valid.

Meaningful Outcomes: Effective interventions must show that they can help consumers to achieve important goals or outcomes related to impairments and/or risk factors.