Health systems in the United States have an acute need to better understand how they can most effectively implement evidence-based practices (EBPs) to improve care for their patients. Although the definition can vary, EBPs are clinical interventions that have been tested through research andshown to improve patient outcomes. Research has shown that successfully getting EBP into routine care can require implementation strategies, defined as "methods or techniques used to enhance the adoption, implementation, and sustainability of a clinical program or practice." Many such strategies have been developed and tested, but much of the evidence for these strategies has focused on a given clinical setting or on a particular strategy. However,implementation strategies are intended to be applied across a wide range of EBPs. Thus, without a comprehensive synthesis across settings and strategies, it is difficult to understand the evidence in a broad context. This level of understanding is necessary for practitioners and others seeking to navigate the evidence across the full array of strategies to inform their choices. Therefore, this project sought to answer the following questions: 1. What is the quantitative evidence for the effectiveness of various implementation strategies to improve health, alone or in combination with other strategies? 2. What are the current gaps in the quantitative evidence for implementation strategy effectiveness? Read More Subscribe to the Policy Currents newsletter Email Subscribe Related Content ResearchEvidence on the Effectiveness of Implementation Strategies: A Visual ToolJul 26, 2024 ResearchEvidence on the Effectiveness of Implementation Strategies to Promote Evidence-Based Practices: Brief SummaryAug 1, 2024 Topics Biomedical ResearchEvidence Based Health Practice Document Details Document Details Copyright: Public DomainPublisher: Patient-Centered Outcomes Research Institute (PCORI)Availability: Non-RAND Year: 2023 Pages: 126 Document Number: EP-70493 Research conducted by RAND Health Care This publication is part of the RAND external publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations. RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.

Problematic rates of alcohol, e-cigarette, and other drug use among US adolescents highlight the need for effective implementation of evidence-based programs (EBPs), yet schools and community organizations have great difficulty implementing and sustaining EBPs. Although a growing number of studies show that implementation support interventions can improve EBP implementation, the literature on how to improve sustainability through implementation support is limited. This randomized controlled trial advances the literature by testing the effects of one such implementation intervention—Getting To Outcomes (GTO)—on sustainability of CHOICE, an after-school EBP for preventing substance use among middle-school students. CHOICE implementation was tracked for 2 years after GTO support ended across 29 Boys and Girls Club sites in the greater Los Angeles area. Predictors of sustainability were identified for a set of key tasks targeted by the GTO approach (e.g., goal setting, evaluation, collectively called "GTO performance") and for CHOICE fidelity using a series of path models. One year after GTO support ended, we found no differences between GTO and control sites on CHOICE fidelity. GTO performance was also similar between groups; however, GTO sites were superior in conducting evaluation. Better GTO performance predicted better CHOICE fidelity. Two years after GTO support ended, GTO sites were significantly more likely to sustain CHOICE implementation when compared with control sites. This study suggests that using an implementation support intervention like GTO can help low-resource settings continue to sustain their EBP implementation to help them get the most out of their investment.

Problematic rates of alcohol, e-cigarette, and other drug use among US adolescents highlight the need for effective implementation of evidence-based programs (EBPs), yet schools and community organizations have great difficulty implementing and sustaining EBPs. Although a growing number of studies show that implementation support interventions can improve EBP implementation, the literature on how to improve sustainability through implementation support is limited. This randomized controlled trial advances the literature by testing the effects of one such implementation intervention—Getting To Outcomes (GTO)—on sustainability of CHOICE, an after-school EBP for preventing substance use among middle-school students. CHOICE implementation was tracked for 2 years after GTO support ended across 29 Boys and Girls Club sites in the greater Los Angeles area. Predictors of sustainability were identified for a set of key tasks targeted by the GTO approach (e.g., goal setting, evaluation, collectively called "GTO performance") and for CHOICE fidelity using a series of path models. One year after GTO support ended, we found no differences between GTO and control sites on CHOICE fidelity. GTO performance was also similar between groups; however, GTO sites were superior in conducting evaluation. Better GTO performance predicted better CHOICE fidelity. Two years after GTO support ended, GTO sites were significantly more likely to sustain CHOICE implementation when compared with control sites. This study suggests that using an implementation support intervention like GTO can help low-resource settings continue to sustain their EBP implementation to help them get the most out of their investment.

Community organizations can have difficulty implementing evidence-based prevention programs. More research is needed on implementation support interventions designed to help these organizations implement programs with quality.,Preparing to Run Effective Programs (PREP) is a randomized controlled trial testing Getting To Outcomes (GTO), a 2-year implementation support intervention. It compares 15 Boys and Girls Club sites implementing CHOICE (control group), a five-session evidence-based alcohol and drug prevention program, with 14 similar sites implementing CHOICE supported by GTO (intervention group). PREP replicates a previous GTO study that had the same design, but featured a teen pregnancy prevention program instead. All sites received typical CHOICE training. Fourteen intervention sites received GTO manuals, training, and onsite technical assistance to help practitioners complete implementation best practices specified by GTO (i.e., GTO steps). During the first year, technical assistance providers helped the intervention group adopt, plan, and deliver CHOICE. Then, this group was trained on evaluation and quality improvement steps of GTO using feedback reports summarizing their own data, which yielded revised plans for subsequent implementation of CHOICE. This paper presents results regarding GTO's impact on CHOICE fidelity (adherence, quality of delivery, dosage) and the proximal outcomes of the youth participants (aged 10–14)-attitudes and intentions regarding cigarettes, alcohol, and marijuana use. Fidelity was assessed at all sites by observer ratings and attendance logs. Proximal outcomes were assessed via survey at baseline, 3, and 6 months.,After 1 year, fidelity and proximal outcomes were similar between Intervention and control groups. After 2 years (which included GTO quality improvement activities that took place between years 1 and 2), intervention sites had higher ratings of CHOICE adherence and quality of delivery (dosage remained similar). Proximal outcomes did not differ between groups in either year, although there was universally high endorsement of prosocial responses to those outcomes from the start.,Findings suggest that systematic implementation support provided by GTO can help community organizations achieve better fidelity. Findings replicate the implementation results from a previous GTO study using the same design, but with a different evidence-based program and different fidelity measures. Although proximal outcomes did not change, in large part due to ceiling effects, the implementation findings suggest GTO can support a variety of programs.

The goal of this project was to enhance the capacity of local health departments to translate and implement evidence-based programs in emergency preparedness by using the Getting To Outcomes approach. Our evaluation determined that local health department staff reported improved capacities. A "Getting To Outcomes Guide for Community Emergency Preparedness" guidebook was produced and is available online.

Evidence-based treatment for co-occurring disorders is needed within programs that serve homeless Veterans to assist with increasing engagement in care and to prevent future housing loss. A specialized co-occurring disorders treatment engagement intervention called Maintaining Independence and Sobriety Through Systems Integration, Outreach and Networking - Veterans Edition (MISSION-Vet) was implemented within the Housing and Urban Development - Veterans Affairs Supportive Housing (HUD-VASH) Programs with and without an implementation strategy called Getting To Outcomes (GTO). While implementation was modest for the GTO group, no one adopted MISSION in the non-GTO group. This paper reports Veteran level outcome data on treatment engagement and select behavioral health outcomes for Veterans exposed to the MISSION-Vet model compared to Veterans without access to MISSION-Vet.,This hybrid Type III trial compared 81 Veterans in the GTO group to a similar group of 87 Veterans with mental health and substance use disorders from the caseload of staff in the non-GTO group. Comparisons were made on treatment engagement, negative housing exits, drug and alcohol abuse, inpatient hospitalizations, emergency department visits and income level over time, using mixed-effect or Cox regression models.,Treatment engagement, as measured by the overall number of case manager contacts with Veterans and others (e.g. family members, health providers), was significantly higher among Veterans in the GTO group (B = 2.30, p = .04). Supplemental exploratory analyses between Veterans who received "higher" and "lower" intensity MISSION-Vet services in the GTO group failed to show differences in alcohol and drug use, inpatient hospitalization and emergency department use.,Despite modest MISSION-Vet fidelity among staff treating Veterans in the GTO group, differences were found in treatment engagement. However, this study failed to show differences in alcohol use, drug use, mental health hospitalizations and negative housing exits over time among those Veterans receiving higher intensity MISSION-Vet services versus low intensity services. This project suggests that MISSION-Vet could be used in HUD-VASH to increase engagement among Veterans struggling with homelessness, a group often disconnected from care.

Chronic insomnia is among the most reported complaints of Veterans and military personnel referred for mental health services. It is highly comorbid with medical and psychiatric disorders, and is associated with significantly increased healthcare utilization and costs. Evidence-based psychotherapy, namely Cognitive Behavioral Therapy for Insomnia (CBTI), is an effective treatment and recommended over prescription sleep medications. While CBTI is part of a nationwide rollout in the Veterans Health Administration to train hundreds of providers, access to treatment is still limited for many Veterans due to limited treatment availability, low patient and provider knowledge about treatment options, and Veteran barriers such as distance and travel, work schedules, and childcare. Uptake of a briefer, more primary-care-friendly treatment into routine clinical care in Veterans Affairs (VA) primary care settings, where insomnia is typically first recognized and diagnosed, may effectively and efficiently increase access to effective insomnia interventions and help decrease the risks and burdens related to chronic insomnia.,This hybrid type I trial is composed of two aims. The first preliminarily tests the clinical non-inferiority of Brief Behavioral Treatment for Insomnia (BBTI) versus the current "gold standard" treatment, CBTI. The second is a qualitative needs assessment, guided by the Consolidated Framework for Implementation Research (CFIR), to identify potential factors that may affect successful implementation and integration of behavioral treatments for insomnia in the primary care setting. To identify potential implementation factors, individual interviews are conducted with the Veterans who participate in the clinical trial, as well as VA primary care providers and nursing staff.,It is increasingly important to better understand barriers to, and facilitators of, implementing insomnia interventions in order to ensure that Veterans have the best access to care. Furthermore, it is important to evaluate the potential for new avenues of treatment delivery, like BBTI in the primary care setting, which can benefit Veterans who may not have adequate access to specialty mental health providers trained in CBTI.

U.S. schools and community organizations face a difficult battle to keep kids safe and drug-free. They need tools to help them choose programs that will work best for youth. The National Registry of Evidence-based Programs and Practices is such a tool, but its future is uncertain.

Incorporating evidence-based integrated treatment for dual disorders into typical care settings has been challenging, especially among those serving Veterans who are homeless. This paper presents an evaluation of an effort to incorporate an evidence-based, dual disorder treatment called Maintaining Independence and Sobriety Through Systems Integration, Outreach, and Networking-Veterans Edition (MISSION-Vet) into case management teams serving Veterans who are homeless, using an implementation strategy called Getting To Outcomes (GTO).,This Hybrid Type III, cluster-randomized controlled trial assessed the impact of GTO over and above MISSION-Vet Implementation as Usual (IU). Both conditions received standard MISSION-Vet training and manuals. The GTO group received an implementation manual, training, technical assistance, and data feedback. The study occurred in teams at three large VA Medical Centers over 2 years. Within each team, existing sub-teams (case managers and Veterans they serve) were the clusters randomly assigned. The trial assessed MISSION-Vet services delivered and collected via administrative data and implementation barriers and facilitators, via semi-structured interview.,No case managers in the IU group initiated MISSION-Vet while 68% in the GTO group did. Seven percent of Veterans with case managers in the GTO group received at least one MISSION-Vet session. Most case managers appreciated the MISSION-Vet materials and felt the GTO planning meetings supported using MISSION-Vet. Case manager interviews also showed that MISSION-Vet could be confusing; there was little involvement from leadership after their initial agreement to participate; the data feedback system had a number of difficulties; and case managers did not have the resources to implement all aspects of MISSION-Vet.,This project shows that GTO-like support can help launch new practices but that multiple implementation facilitators are needed for successful execution of a complex evidence-based program like MISSION-Vet.

Research is needed to evaluate the impact of implementation support interventions over and above typical efforts by community settings to deploy evidence-based prevention programs.,Enhancing Quality Interventions Promoting Healthy Sexuality is a randomized controlled trial testing Getting To Outcomes (GTO), a 2-year implementation support intervention. It compares 16 Boys and Girls Club sites implementing Making Proud Choices (MPC, control group), a structured teen pregnancy prevention evidence-based program with 16 similar sites implementing MPC augmented with GTO (intervention group). All sites received training and manuals typical for MPC. GTO has its own manuals, training, and onsite technical assistance (TA) to help practitioners complete key programming practices specified by GTO. During the first year, TA providers helped the intervention group adopt, plan, and deliver MPC. This group then received training on the evaluation and quality improvement steps of GTO, including feedback reports summarizing their data, which were used in a TA-facilitated quality improvement process that yielded revised plans for the second MPC implementation. This paper presents results regarding GTO's impact on performance of the sites (i.e., how well key programming practices were carried out), fidelity of MPC implementation, and the relationship between amount of TA support, performance, and fidelity. Performance was measured using ratings made from a standardized, structured interview conducted with participating staff at all 32 Boys and Girls Clubs sites after the first and second years of MPC implementation. Multiple elements of fidelity (adherence, classroom delivery, dosage) were assessed at all sites by observer ratings and attendance logs.,After 2 years, the intervention sites had higher ratings of performance, adherence, and classroom delivery (dosage remained similar). Higher performance predicted greater adherence in both years.,These findings suggest that in typical community-based settings, manuals and training common to structured EBPs may be sufficient to yield low levels of performance and moderate levels of fidelity but that systematic implementation support is needed to achieve high levels of performance and fidelity.

BACKGROUND: The Housing and Urban Development-Veterans Affairs Supportive Housing (HUD-VASH) program is one of the largest initiatives to end Veteran homelessness. However, mental health and substance use disorders continue to reduce client stability and impede program success. HUD-VASH programs do not consistently employ evidence-based practices that address co-occurring mental health and substance use disorders. This paper presents a study protocol to evaluate the implementation of an evidence-based, co-occurring disorder treatment called Maintaining Independence and Sobriety Through Systems Integration, Outreach, and Networking--Veterans Edition (MISSION-Vet) in HUD-VASH using an implementation strategy called Getting To Outcomes (GTO). METHODS/DESIGN: In three large VA Medical Centers, this Hybrid Type III trial will randomize case managers and their clients by HUD-VASH sub-teams to receive either MISSION-Vet Implementation as Usual (IU--standard training and access to the MISSION-Vet treatment manuals) or MISSION-Vet implementation augmented by GTO. In addition to testing GTO, effectiveness of the treatment (MISSION-Vet) will be assessed using existing Veteran-level data from the HUD-VASH data monitoring system. This project will compare GTO and IU case managers and their clients on the following variables: (1) fidelity to the MISSION-Vet intervention; (2) proportion of time the Veteran is housed; (3) mental health, substance use, and functional outcomes among Veterans; and (4) factors key to the successful deployment of a new treatment as specified by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) model. DISCUSSION:This project is an important step for developing an implementation strategy to increase adoption of evidence-based practice use in VA homeless programs, and to further examine efficacy of MISSION-Vet in HUD-VASH. This project has important implications for program managers, policy makers, and researchers within the homelessness field. VA Central IRB approval for this study was granted in October 2011. The three sites were trained on MISSION-Vet and GTO in the first half of 2013. The first GTO planning meetings began after training occurred, between January 2013 and November 2013, across the three sites. The data collection--via a fidelity measure embedded into the VA Computerized Patient Record System--began as each site initiated MISSION-Vet, between April 2013 and January 2014.

Prevention support systems (PSSs) are designed to help communities implement evidence-based practices (EBPs). Little is known about the factors that influence their adoption. In this article, the authors examined adoption of a PSS for substance abuse prevention called Getting To Outcomes (GTO) among staff in two community coalitions with varying levels of exposure to it over a 2-year period. A multistage regression model was used to determine the relative predictive power of organizational, innovation-related, and practitioner characteristics on adoption. Findings indicate that GTO adoption occurred through increased exposure, especially via staff training. Perceptions of the system's complexity moderated this effect. Individuals with high GTO exposure were less likely to adopt it if they perceived it as complex. Other organizational, innovation-related, and practitioner characteristics did not predict adoption. Results from this study are useful for understanding the factors associated with PSS adoption and suggest ways to increase their use in typical delivery settings.

Substance abuse is, and has always been, an indisputable fact of life. People -- especially young people -- abuse various legal and illegal substances for any number of reasons: to intensify feelings, to achieve deeper consciousness, to escape reality, to self-medicate. And as substance-abusing teenagers mature, they pose particular challenges to the professionals charged with keeping them clean and sober and helping them maintain recovery into adulthood. Adolescent Substance Abuse: Evidence-Based Approaches to Prevention and Treatment offers clear, interdisciplinary guidance that grounds readers in the many contexts -- developmental, genetic, social, and familial among them -- crucial to creating effective interventions and prevention methods. Its contributors examine current findings regarding popularly used therapies, including psychopharmacology, residential treatment, school- and community-based programs, group homes, and specific forms of individual, family, and group therapy. The current chapter focuses on community prevention for adolescent substance abuse. First, the authors provide an overview of the different type of prevention programs and environmental strategies available for youth and discuss the prevalence of alcohol and drug use and consequences among this population. The chapter then focuses on factors that may contribute to both initiation and escalation of alcohol and drug use. The authors then discuss theories that ground community interventions and describe specific community-based prevention efforts that have been implemented across the United States. The authors also discuss the outcomes from these prevention efforts. They conclude by providing recommendations.

Two hundred and sixty people with psychiatric disabilities who were socially isolated and withdrawn were randomly assigned to one of three conditions to facilitate their engagement in social and recreational activities: They were (a) not matched with a volunteer partner (N = 70), (b) matched with a volunteer partner who had a personal history of psychiatric disability (N = 95), or (c) matched with a volunteer partner with no history of psychiatric disability (N = 95). Participants and volunteers received a $28 stipend each month to cover the expenses of their activities. Comprehensive assessments of symptoms, functional impairment, self-esteem, and satisfaction were made at baseline, after 4 months, and after 9 months. While all participants appeared to improve in terms of symptom reduction and increases in functioning and self-esteem, differences between conditions were found only when participants' degree of contact with their partner was considered. While participants assigned to the nonconsumer volunteer partner condition improved in terms of their social functioning and self-esteem when meeting with their partners, those who were assigned to consumer partners only improved when they did not. Findings highlight the important role of participants' expectations and perceptions in designing and evaluating psychosocial interventions for people with psychiatric disabilities.