Using collaborative logic analysis evaluation to test the program theory of an intensive interdisciplinary pain treatment for youth with pain‐related disability

Abstract

Abstract : Pediatric pain rehabilitation programs are complex and involve multiple stakeholders. Mapping the program components to its anticipated outcomes (i.e., its theory) can be difficult and requires stakeholder engagement. Evidence is lacking however on how best to engage them. Logic analysis, a theory-based evaluation, which tests the coherence of a program’s theory using scientific evidence and experiential knowledge, may hold some promise. Its use is rare in pediatric pain rehabilitation and few methodological details are available. This article provides a description of a collaborative logic analysis methodology used as the first step in the evaluation of an intensive interdisciplinary pain treatment program designed for youth with pain-related disability. A three-step direct logic analysis process was used. A 13-member expert panel, composed of clinicians, teachers, managers, youth with pain-related disability and their parents were engaged in each step. First, a logic model was constructed through document analysis, expert panel surveys and focus-group discussions. Then, a scoping review, focused on pediatric self-management, building self-efficacy, and fostering participation helped create a conceptual framework. Finally, an examination of the logic model against the conceptual framework by the expert panel followed, and recommendations were formulated. Overall, the collaborative logic analysis process helped raised awareness of clinicians’ assumptions about the program causal mechanism, identified program components most valued by youth and their parents; and recognized the program features supported by scientific and experiential knowledge, detected gaps and highlighted emerging trends. In addition to proving a consumer-focused program evaluation option, collaborative logic analysis methodology holds promise as a novel strategy to engage stakeholders and to translate pediatric pain rehabilitation evaluation research knowledge to key stakeholders.