Difference between revisions of "Effective Action Planning and Implementation"

From SAFE Solutions
Jump to navigation Jump to search
user>Pkalch
 
(42 intermediate revisions by 7 users not shown)
Line 1: Line 1:
Return to [[Opioid_Top-Level_Strategy_Map|Opioid_Top-Level_Strategy_Map]]&nbsp;or [[ZOOM_MAP_-_Improve_Alignment_&_Teamwork_Among_Existing_Programs_and_Opioid-Related_Coalitions|Zoom Map - Improve Alignment & Teamwork Among Existing Programs & Opioid-Related Coalitions]]&nbsp;or [[ZOOM_MAP_-_Improve_Treatment_&_Enable_Recovery_for_People_with_SUDs|Zoom Map - Improve Treatment & Enable Recovery for People with SUD's]] <div class="wiki" id="content_view" style="display: block">
----


&nbsp;
&nbsp;


&nbsp;
= Introductory Paragraph =
 
&nbsp;
 
= Background =
<div class="_">
After bringing stakeholders together, gathering and analyzing data, and identifying needs and priorities in terms of services and programs, the next step is for the coalition to collectively develop an action plan that addresses those identified needs, and then, support its implementation.&nbsp; Working together in close coordination during this process is as important as ever, so that all stakeholders have buy-in and are accountable.&nbsp; While the experience of communities varies, there are some common principles that consistently appear.&nbsp;
</div>
= Key Components to an Effective Action Plan =
 
Substance misuse and substance use disorder is a complex problem whose solutions are numerous across the continuum of care.&nbsp; What specific solutions are put into an action plan will vary widely, as will the approach different communities take.&nbsp; Some communities, like Dayton, Ohio, have a complex organizational structure to their Community Overdose Action Team, which includes a planning section charged with development and revision of an action plan.&nbsp; This section works closely with the data unit to provide status reports to the larger group and evaluate different initiatives within the plan.&nbsp; Most community coalitions have less structure where specific tasks, like creating an action plan, are done by the entire coalition or where all or most members provide input.&nbsp; Whatever the scope of the effort, there are some key components needed to develop an effective action plan.&nbsp; Communities should also note that action plans are living documents and they will need to be constantly reviewed and revised to address new realities and lessons learned along the way.&nbsp;&nbsp;
 
== Setting Clear Strategies ==
 
When gaps and additional service needs are identified, the community coalition can begin to map out a set of actions and strategies to achieve desired outcomes.&nbsp; These outcomes first need to be agreed upon by the community coalition.&nbsp; From there, a set of action items can be added to achieve each intended outcome. Many community coalitions - especially those with a large number of members - will break into working groups or committees around each strategy or objective.&nbsp; Naturally those members who are subject matter experts and work in specific fields can take the lead in developing a plan and outlining the details for that specific strategy.
 
When formulating these plans, it is important that expectations are realistic and that the actions identified can be achieved.&nbsp; Even when action plans are revised due to changing data and lessons learned, achieving progress is important to keeping participants energized and motivated so communities may consider planning for small and early wins first.
 
== Identifying Members to Lead Implementation of Strategies ==


It is important for all participants to know what part of the action plan they are responsible for leading the implementing.&nbsp; This lays the groundwork of expectations between members and trust that each participant will carry out their portion of the plan.&nbsp; These responsibilities should be clearly spelled out in writing so there is no confusion or misunderstanding.&nbsp;&nbsp; Although a coalition member may be helping to coordinate the activities of members, it is the responsibility of each member to be accountable and help achieve progress.&nbsp;
The last three steps in the SPF approach build upon the Assessment phase in which community-specific needs are identified and sufficient Capacity-Building has occurred to be able to implement solutions. The Planning, Implementation, and Evaluation phases are tightly interwoven. Since all three phases utilize the Assessment data in an integrated way, they are presented together in this single article. The Planning phase can be summarized as using the buy-in and wisdom of the coalition members to prioritize which goals ''can be'' realistically achieved and which actions ''should be'' implemented. Since the Evaluation phase will provide metrics on the effective ness of those actions and progress towards those goals, it is important for planning priorities to be established with evaluation processes and outcomes in mind. If the Planning phase fully engages the coalition membership, there is likely to be more buy-in and accountability during the Implementation phase, as well as a deeper celebration of successful outcomes in the Evaluation phase.


= Key Information =


== Developing Short- and Long-Term Goals with Timelines ==
'''Planning'''


Once the group as a whole or sub-group agrees to an action plan, it is important to create timelines to complete each activity.&nbsp; As steps are taken to address both short- and longer-term goals, trust is built between the members working toward a common outcome.&nbsp; As with the actions themselves, the timelines need to be reasonable and achievable.&nbsp; Having a range of timelines helps keep members engaged and have a sense of accomplishment.&nbsp; Some coalitions will have short-term goals that can be achieved in 30 or 60 days, mid-term goals that are several months out, and long-term goals that can be expected to take a year or more.
Substance misuse is a complex problem which a community can address by numerous strategies. An action plan requires the coalition to make choices about which solutions to implement. The specific approaches different communities will choose to take varies widely. The by-word for the planning process is prioritization which helps to simplify both the complexities of the task at hand and to focus on achieving results. Realizing that the Planning phases is the mid-point of the five SPF phases provides an opportunity to use two navigational points -- the data-driven and outcomes orientation of SPF. The data-driven component is based upon the Assessment phase and ensures that Implementation choices are grounded in the current needs of the community and not upon previous efforts, which may feel subjectively easier, but be less objectively effective. The outcomes component ensures that the Planning phase identifies strategies can be measured in the Evaluation phase, that they are based upon best practices, and that they align to S.M.A.R.T. goals. This acronym stands for Specific, Measurable, Achievable, Relevant, and Time-Bound. A small number of optimal SMART goals will drive the Implementation phase and can be developed by the coalition by balancing three simple criteria -- ''impact'' and ''capacity'' and ''timing'':


== Identifying Resources ==
*Impact. The Assessment phase will invariably identify numerous gaps and additional service needs. Since the coalition cannot provide solutions to all problems at once, it is useful to identify those outcomes which are immediately achievable. If certain coalition members are skeptical that any level of change is likely on a certain potential goal, then it may be better to shift focus to goals which will have more buy-in. Some of this may be influenced by what coalition members feel that the community-at-large will be most likely to support. Working on strategies which will have the highest impact helps the coalition to have successes which can build traction for more success.


Part of creating an achievable action plan is identifying and securing any financial and other resources that are necessary.&nbsp; There are a variety of funding sources that&nbsp;support planning&nbsp;and programs.&nbsp; Sources of funding&nbsp;include:
*Capacity. When formulating an action plans, it is important that expectations are realistic and that select actions which are prioritized can be achieved by the coalition. It is important for communities to consider planning for small and early wins first, so that tangible progress will keep participants energized and motivated. Part of creating an achievable action plan is identifying and securing any financial and other resources that are necessary. There are a variety of funding sources that support planning and programs. These include local, state, or federal government grants, funding through philanthropic organizations, and support from the business community or fundraising campaigns. The action plan should identify steps to secure financial resources to meet their goals and objectives. More funding is not always feasible, so coalitions may need to consider alternate, innovative avenues in their action plans.


Local or state government.&nbsp; (grants or direct funding)
*Timing. Once the coalition agrees to an action plan, it is important to create timelines to complete each activity. As steps are taken to address both short- and longer-term goals, trust is built between the members working toward a common outcome. The timelines need to be reasonable and achievable. Having a range of timelines helps keep members engaged and have a sense of accomplishment. Some coalitions will have short-term goals that can be achieved in 30 or 60 days, mid-term goals that are several months out, and long-term goals that can be expected to take a year or more.


Federal grants.
The following guidelines are useful in developing an action plan:


Philanthropic Organizations
*Ensure that a diversity of populations within a given community are served. Due to differences in language, culture, and experiences, communities addressing any public health issue must develop action plans that can achieve desired outcomes for all people within the community.
*Include a variety of strategies to work across the continuum of care, with implementations in prevention, recovery, and access to treatment services.
*If the coalition is large enough to have a sub-committee to perform the Assessment phase and to develop a suite of possible interventions, then they should engage the full coalition in the process of prioritizing the specific strategies to implement.
*If possible include strategies which impact broad systemic and policy changes.
*Strategies should increase awareness, build education, enhance skills, build capacity, improve access, or fill gaps.
*Action plans are living documents and will need to be constantly reviewed and revised to address the new realities and lessons which are learned through the Evaluation phase. Decision makers need to be willing to experiment and constantly adjust the approaches they take. Even at the local level, aspects of the substance use epidemic change, sometimes quite rapidly. Leaders need to continually collect and analyze data in order to detect these changes and make adjustments.


Support from the business/corporate community.
''' Implementation'''


Grassroots and direct fundraising campaigns and events.
During the Implementation phase of SPF, a set of action items can be added to achieve the intended outcome of each SMART goal. Many community coalitions, especially those with a large number of members, will break into working groups or committees around each SMART goal to delineate details implementation objectives. Naturally, those members who are subject matter experts and work in specific fields can take the lead in implementing specific strategies. It is important for all participants to know what part of the action plan they are responsible for leading. This lays the groundwork of expectations between members and trust that each participant will carry out their portion of the plan. These responsibilities should be clearly spelled out in writing so there is no confusion or misunderstanding. Although one coalition member may be helping to coordinate the activities of other members, it is the responsibility of each member to be accountable and help achieve progress. For example, even coalition members who are not tasked with a specific strategy can still help to track milestones, maintain community momentum, and update key community stakeholders as progress is made. As work proceeds on implementing the plan, a process begins whereby actions are taken, effectiveness is assessed, and modifications to the plan are made. The constant evaluation of progress is an ongoing effort. Often, goals are added and changed, and sometimes changes are made in those responsible for implementing parts of the plan. It is important to have the expectation from the start that almost nothing goes exactly as planned. If focus and prioritization are the by-words for planning, the by-words for implementation are accountability and flexibility.


What is important is that the action plan take these needs into account and develop steps to secure any needed resources.&nbsp; Without needed funding community groups will be unable to meet their goals and objectives.
'''Evaluation'''


== Tracking of Progress and Outcomes ==
Three verbs which summarize the Evaluation phase are calibrate, celebrate, and communicate. The calibration involves evaluation of what worked well during implementation, what did not work, and what can be learned to launch a new SPF cycle of assessment, capacity-building, planning, and implementation. Celebration uses the documentation of even small wins for coalition members to share successes and to build positive momentum to achieve continued progress. The communication of evaluation results can be used to report outcomes back to funders and to advocate for the coalition mission with local and state decision-makers.


Within an effective action plan, communities should identify and outline a series of performance indicators that align with their goal(s) and track progress.&nbsp; Shared accountability ensures that progress is being made towards achieving desired outcomes.&nbsp; The data can be used to report back to key stakeholders in the community on the progress that is being made, but it also can be used to revise any details related to the action plans as needed if strategies aren’t going as intended, so that all involved can collectively improve the desired outcomes.
There are two types of evaluations -- process evaluations and outcome evaluations:
*Process evaluation ensures accountability and that the implementation was done with fidelity. This focus is primarily on outputs, such as number of classes offered or number of Naloxone kits distributed, and is often required for purposes of grant funding or communication with stakeholders. Did the coalition do what it said it was going to do? Were the activities within the action plan implemented? The identification of any action steps that were not implemented is likely to lead to an examination of staffing or resource issues, leadership, communication, and sustainability.
*Outcome evaluation measures effectiveness and focuses on impact. They employ change detection or pre-post measures which compare current conditions to baseline conditions. This is a process in which measurable progress towards the short-term or mid-term outcomes can be documented. Revision of long-term outcomes can be evaluated at this time as well. It should be noted that impact can also be documented through qualitative data. Often a compelling story can be told that is useful in promoting advocacy efforts. The conditions surrounding substance use are complex and documenting progress may be best served through the use of a narrative that is articulated by a variety of community members most affected by the action plan.


=== Data Use to Implement Performance Management ===
Solid action and evaluation plans outline a series of performance indicators which can be used to track progress towards SMART goals. Generally, the performance management process has four components:
*Identify appropriate performance indicators to determine markers of success.
*Conduct performance measurement, leveraging available data and collect new data to measure short-term and longer-term outcomes.
*Monitor and report performance management data, insights, challenges, and successes.
*Quality improvement uses evidence of limited results or setbacks as learning opportunities to be used to improve strategies and action plans.


Accountability and monitoring of progress is an ongoing process.&nbsp; As is the case with many aspects of community response, strategies and actions are constantly adjusted.&nbsp; Generally, the performance management process has four components:&nbsp;
The evaluation process guides the coalition in developing its strategies and tracks the effectiveness of each strategy over time. It will be up to each community to decide what data to collect and report, and what data should be made public. The identified lead should determine the frequency of data collection and coordinate collection efforts to regularly monitor data. The data report should educate and drive informed decision-making. For example, data used to track the number and locations of overdoses can provide the community with the knowledge of where overdoses are taking place and what hot spots exist. This allows a community to focus resources where they are needed by adding or expanding services like those related to prevention, harm reduction, and connection to services through peers or other means. Other parts of the data report may include available treatment and recovery housing beds, Naloxone distribution numbers, and the frequency of prescribed MAT in various settings. Continued communication and sharing of data is key. This will lead to greater collaboration between agencies which share data as well as other community stakeholders. Often new partnerships are forged when the data reveals what needs to be addressed.


<u>Identify Appropriate Performance Indicators</u>&nbsp;- Determine agreed upon markers of achieving success.
Analysts may choose a variety of methods for sharing their data, including Geographic Information Systems (GIS), line graphs, bar charts, tables, and pie charts. Charts and graphs should be developed with the audience in mind -- easy to read, aesthetically pleasing, well-labeled, and include the totals for columns and rows. Only the most important information should be illustrated in order to keep the report simple. It is critical to use care when displaying and illustrating data in order to maintain a balance between accurately displaying data and creating an effective visualization. Communities have a variety of options for data support. Investments in off-the-shelf software systems are available for purchase and can be used to monitor data from various state and local organizations and to track system performance indicators and outcomes over time. If there is limited funding available, communities can use spreadsheet or database software, such as Microsoft Excel or Access.


<u>Conduct Performance Measurement</u>&nbsp;- Leverage available data; collect new data to measure short-term and longer-term outcomes.
= Impactful Federal, State, and Local Policies =


<u>Monitor and Report Performance Measurement Results</u>&nbsp;- Share cross-sector performance management data, insights, challenges, and successes.
SAFE Solutions is an ever-growing platform.&nbsp; Currently limited&nbsp;information is readily available for this section.&nbsp; SAFE Project is dedicated to providing communities with the most relevant and innovative materials.&nbsp; We will continue to regularly monitor and make updates accordingly with community input and subject matter expert collaboration.&nbsp; Please check back soon.


<u>Quality Improvement</u> - Celebrate even small wins together, share what is working, and build on positive momentum to achieve continued progress.&nbsp; Use evidence of limited results or setbacks as learning opportunities that can be used to improve strategies and action plans.


&nbsp;
= Available Tools and Resources =


* '''SAMHSA''' provides a summary of best practices in planning, implementation, and evaluation in its "Guide to SAMHSA’s Strategic Prevention Framework" <ref>https://www.samhsa.gov/sites/default/files/20190620-samhsa-strategic-prevention-framework-guide.pdf </ref>


*'''SAFE Project.''' Coalitions can use the SAFE Solutions dashboard to help lead discussions on which strategies to implement within their community. <ref>https://www.yoursafesolutions.us/</ref> The Community Playbook includes a template for building an action plan and for setting S.M.A.R.T. goals. <ref>https://www.safeproject.us/safe-community-playbook-and-safe-solutions/</ref>


= Building a Culturally Competent Plan =
*'''The National Association of County and City Health Officials (NACCHO)''' has published a report with Joslyn Levy & Associates titled "Specifying Monitoring and Evaluation Measures for Local Overdose Prevention and Response Strategies: A Toolkit." <ref>https://mys.mapyourshow.com/mys_shared/naccho2024/handouts/NACCHO_SpecifyingMonitoring&EvaluationMeasures_Toolkit2024_FINAL.pdf</ref>


Addressing the drug misuse and substance use disorder epidemic is a complex problem requiring a complex and coordinated&nbsp;set of solutions.&nbsp; Another critical factor to examine and plan for involves how to best serve diverse populations within a given community.&nbsp; Due to differences in language, culture, and experiences communities addressing any public health issue must develop action plans that can achieve desired outcomes for all people within the community.&nbsp; [https://www.samhsa.gov/section-223/cultural-competency/resources SAMHSA] has developed a list of resources to help imporve cultural competence.
*'''The National Implementation Research Network''' has public health implementation as one of its four focus themes. <ref>https://nirn.fpg.unc.edu/</ref>


&nbsp;
*'''The UNC Center for the Business of Health''' has launched the "From Settlement to Solutions" website, which is a comprehensive resource for the use of evidence-based opioid settlement funds, based on community conversations. This North Carolina case study consolidates best practices, research, policy trackers, and tools, providing a centralized hub for quick and easy reference. <ref>https://cboh.kenaninstitute.unc.edu/opioid-project/</ref>


== Cultural Competence Defined ==
*'''Research Meta-Analysis.''' Although it is dated, Durlak and DuPre (2008) is worthy of review because it provides a review of over 500 research findings on the implementation process. <ref> Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3/4), 327–350. Retrieved from https://www.researchgate.net/publication/5529147_Implementation_Matters_A_Review_of_Research_on_the_Influence_of_Implementation_on_Program_Outcomes_and_the_Factors_Affecting_Implementation</ref>
 
Cultural competence is defined as the ability of providers and organizations to effectively deliver health care services that meet the social, cultural, and linguistic needs of patients.<ref name="https://hpi.georgetown.edu/cultural/" />
 
A culturally competent healthcare organization seeks to understand the culture of the population served, recognizes the impact of cultural differences, fosters internal learning opportunities to improve cultural knowledge among care teams, and modifies patient care to meet the patient’s unique needs.&nbsp;
 
=== Cultural Competence&nbsp;in Addressing Substance Abuse and Mental Health ===
 
There are many resources that discuss how to improve cultural competence in the areas of&nbsp;substance use and mental health.&nbsp; [https://store.samhsa.gov/sites/default/files/d7/priv/sma14-4849.pdf The Substance Abuse and Mental Health Services Administration] has examined this issue in great detail in improving treatment.
 
Improving Cultural Competence
 
There are many good resources on how healthcare interests can improve cultural competence.&nbsp; Many of these strategies apply to community groups looking to improve their response to substance misuse and SUD:
 
*Collect race, ethnicity and language preference (REAL) data.
*Identify and report disparities.
*Provide culturally and linguistically competent care.
*Develop culturally competent management programs.
*Increase diversity and minority participation.
*Involve the community.
*Make cultural competency an priority
 
Typically it will take a combination of several strategies to improve cultural competence.&nbsp; It is therefore important that there be as much input as possible when considering what needs to be done in a given community.&nbsp; An report with greater detail of specific strategies can be found [https://www.aha.org/system/files/hpoe/Reports-HPOE/becoming-culturally-competent-health-care-organization.PDF here].
 
&nbsp;
 
&nbsp;
 
<br/> <br/> <br/> <span style="background-color: #ffffff; color: #222222; font-family: arial,sans-serif; font-size: 12.8px">'''<span style="color: #4d4d4d">SUBJECT MATTER EXPERT</span>''': </span><span style="background-color: #ffffff; color: #ff0000; font-family: arial,sans-serif; font-size: 12.8px">[fill out table below]</span>
 
{| class="wiki_table"
|-
| '''Reviewer'''
| '''Date'''
| '''Comments'''
|-
| &nbsp;
| &nbsp;
| &nbsp;
|}
 
&nbsp;


= <span style="background-color: #ffffff">Sources</span> =
= Promising Practices =


----
SAFE Solutions is an ever-growing platform.&nbsp; Currently limited&nbsp;information is readily available for this section.&nbsp; SAFE Project is dedicated to providing communities with the most relevant and innovative materials.&nbsp; We will continue to regularly monitor and make updates accordingly with community input and subject matter expert collaboration.&nbsp; Please check back soon.


#[http://www.cadca.org/ [11]]
= Sources =
#[http://www.modernhealthcare.com/assets/pdf/CH115670524.PDF [12]]
#[http://www.modernhealthcare.com/article/20180524/SPONSORED/180529949 [13]]
#[http://www.modernhealthcare.com/article/20180524/SPONSORED/180529949 [14]]
</div> </div> </div> </div> </div> </div> </div></div></div></div>
[[Category:Community Resources]] [[Category:SAFE Communities]]

Latest revision as of 15:38, 21 October 2024

 

Introductory Paragraph

The last three steps in the SPF approach build upon the Assessment phase in which community-specific needs are identified and sufficient Capacity-Building has occurred to be able to implement solutions. The Planning, Implementation, and Evaluation phases are tightly interwoven. Since all three phases utilize the Assessment data in an integrated way, they are presented together in this single article. The Planning phase can be summarized as using the buy-in and wisdom of the coalition members to prioritize which goals can be realistically achieved and which actions should be implemented. Since the Evaluation phase will provide metrics on the effective ness of those actions and progress towards those goals, it is important for planning priorities to be established with evaluation processes and outcomes in mind. If the Planning phase fully engages the coalition membership, there is likely to be more buy-in and accountability during the Implementation phase, as well as a deeper celebration of successful outcomes in the Evaluation phase.

Key Information

Planning

Substance misuse is a complex problem which a community can address by numerous strategies. An action plan requires the coalition to make choices about which solutions to implement. The specific approaches different communities will choose to take varies widely. The by-word for the planning process is prioritization which helps to simplify both the complexities of the task at hand and to focus on achieving results. Realizing that the Planning phases is the mid-point of the five SPF phases provides an opportunity to use two navigational points -- the data-driven and outcomes orientation of SPF. The data-driven component is based upon the Assessment phase and ensures that Implementation choices are grounded in the current needs of the community and not upon previous efforts, which may feel subjectively easier, but be less objectively effective. The outcomes component ensures that the Planning phase identifies strategies can be measured in the Evaluation phase, that they are based upon best practices, and that they align to S.M.A.R.T. goals. This acronym stands for Specific, Measurable, Achievable, Relevant, and Time-Bound. A small number of optimal SMART goals will drive the Implementation phase and can be developed by the coalition by balancing three simple criteria -- impact and capacity and timing:

  • Impact. The Assessment phase will invariably identify numerous gaps and additional service needs. Since the coalition cannot provide solutions to all problems at once, it is useful to identify those outcomes which are immediately achievable. If certain coalition members are skeptical that any level of change is likely on a certain potential goal, then it may be better to shift focus to goals which will have more buy-in. Some of this may be influenced by what coalition members feel that the community-at-large will be most likely to support. Working on strategies which will have the highest impact helps the coalition to have successes which can build traction for more success.
  • Capacity. When formulating an action plans, it is important that expectations are realistic and that select actions which are prioritized can be achieved by the coalition. It is important for communities to consider planning for small and early wins first, so that tangible progress will keep participants energized and motivated. Part of creating an achievable action plan is identifying and securing any financial and other resources that are necessary. There are a variety of funding sources that support planning and programs. These include local, state, or federal government grants, funding through philanthropic organizations, and support from the business community or fundraising campaigns. The action plan should identify steps to secure financial resources to meet their goals and objectives. More funding is not always feasible, so coalitions may need to consider alternate, innovative avenues in their action plans.
  • Timing. Once the coalition agrees to an action plan, it is important to create timelines to complete each activity. As steps are taken to address both short- and longer-term goals, trust is built between the members working toward a common outcome. The timelines need to be reasonable and achievable. Having a range of timelines helps keep members engaged and have a sense of accomplishment. Some coalitions will have short-term goals that can be achieved in 30 or 60 days, mid-term goals that are several months out, and long-term goals that can be expected to take a year or more.

The following guidelines are useful in developing an action plan:

  • Ensure that a diversity of populations within a given community are served. Due to differences in language, culture, and experiences, communities addressing any public health issue must develop action plans that can achieve desired outcomes for all people within the community.
  • Include a variety of strategies to work across the continuum of care, with implementations in prevention, recovery, and access to treatment services.
  • If the coalition is large enough to have a sub-committee to perform the Assessment phase and to develop a suite of possible interventions, then they should engage the full coalition in the process of prioritizing the specific strategies to implement.
  • If possible include strategies which impact broad systemic and policy changes.
  • Strategies should increase awareness, build education, enhance skills, build capacity, improve access, or fill gaps.
  • Action plans are living documents and will need to be constantly reviewed and revised to address the new realities and lessons which are learned through the Evaluation phase. Decision makers need to be willing to experiment and constantly adjust the approaches they take. Even at the local level, aspects of the substance use epidemic change, sometimes quite rapidly. Leaders need to continually collect and analyze data in order to detect these changes and make adjustments.

Implementation

During the Implementation phase of SPF, a set of action items can be added to achieve the intended outcome of each SMART goal. Many community coalitions, especially those with a large number of members, will break into working groups or committees around each SMART goal to delineate details implementation objectives. Naturally, those members who are subject matter experts and work in specific fields can take the lead in implementing specific strategies. It is important for all participants to know what part of the action plan they are responsible for leading. This lays the groundwork of expectations between members and trust that each participant will carry out their portion of the plan. These responsibilities should be clearly spelled out in writing so there is no confusion or misunderstanding. Although one coalition member may be helping to coordinate the activities of other members, it is the responsibility of each member to be accountable and help achieve progress. For example, even coalition members who are not tasked with a specific strategy can still help to track milestones, maintain community momentum, and update key community stakeholders as progress is made. As work proceeds on implementing the plan, a process begins whereby actions are taken, effectiveness is assessed, and modifications to the plan are made. The constant evaluation of progress is an ongoing effort. Often, goals are added and changed, and sometimes changes are made in those responsible for implementing parts of the plan. It is important to have the expectation from the start that almost nothing goes exactly as planned. If focus and prioritization are the by-words for planning, the by-words for implementation are accountability and flexibility.

Evaluation

Three verbs which summarize the Evaluation phase are calibrate, celebrate, and communicate. The calibration involves evaluation of what worked well during implementation, what did not work, and what can be learned to launch a new SPF cycle of assessment, capacity-building, planning, and implementation. Celebration uses the documentation of even small wins for coalition members to share successes and to build positive momentum to achieve continued progress. The communication of evaluation results can be used to report outcomes back to funders and to advocate for the coalition mission with local and state decision-makers.

There are two types of evaluations -- process evaluations and outcome evaluations:

  • Process evaluation ensures accountability and that the implementation was done with fidelity. This focus is primarily on outputs, such as number of classes offered or number of Naloxone kits distributed, and is often required for purposes of grant funding or communication with stakeholders. Did the coalition do what it said it was going to do? Were the activities within the action plan implemented? The identification of any action steps that were not implemented is likely to lead to an examination of staffing or resource issues, leadership, communication, and sustainability.
  • Outcome evaluation measures effectiveness and focuses on impact. They employ change detection or pre-post measures which compare current conditions to baseline conditions. This is a process in which measurable progress towards the short-term or mid-term outcomes can be documented. Revision of long-term outcomes can be evaluated at this time as well. It should be noted that impact can also be documented through qualitative data. Often a compelling story can be told that is useful in promoting advocacy efforts. The conditions surrounding substance use are complex and documenting progress may be best served through the use of a narrative that is articulated by a variety of community members most affected by the action plan.

Solid action and evaluation plans outline a series of performance indicators which can be used to track progress towards SMART goals. Generally, the performance management process has four components:

  • Identify appropriate performance indicators to determine markers of success.
  • Conduct performance measurement, leveraging available data and collect new data to measure short-term and longer-term outcomes.
  • Monitor and report performance management data, insights, challenges, and successes.
  • Quality improvement uses evidence of limited results or setbacks as learning opportunities to be used to improve strategies and action plans.

The evaluation process guides the coalition in developing its strategies and tracks the effectiveness of each strategy over time. It will be up to each community to decide what data to collect and report, and what data should be made public. The identified lead should determine the frequency of data collection and coordinate collection efforts to regularly monitor data. The data report should educate and drive informed decision-making. For example, data used to track the number and locations of overdoses can provide the community with the knowledge of where overdoses are taking place and what hot spots exist. This allows a community to focus resources where they are needed by adding or expanding services like those related to prevention, harm reduction, and connection to services through peers or other means. Other parts of the data report may include available treatment and recovery housing beds, Naloxone distribution numbers, and the frequency of prescribed MAT in various settings. Continued communication and sharing of data is key. This will lead to greater collaboration between agencies which share data as well as other community stakeholders. Often new partnerships are forged when the data reveals what needs to be addressed.

Analysts may choose a variety of methods for sharing their data, including Geographic Information Systems (GIS), line graphs, bar charts, tables, and pie charts. Charts and graphs should be developed with the audience in mind -- easy to read, aesthetically pleasing, well-labeled, and include the totals for columns and rows. Only the most important information should be illustrated in order to keep the report simple. It is critical to use care when displaying and illustrating data in order to maintain a balance between accurately displaying data and creating an effective visualization. Communities have a variety of options for data support. Investments in off-the-shelf software systems are available for purchase and can be used to monitor data from various state and local organizations and to track system performance indicators and outcomes over time. If there is limited funding available, communities can use spreadsheet or database software, such as Microsoft Excel or Access.

Impactful Federal, State, and Local Policies

SAFE Solutions is an ever-growing platform.  Currently limited information is readily available for this section.  SAFE Project is dedicated to providing communities with the most relevant and innovative materials.  We will continue to regularly monitor and make updates accordingly with community input and subject matter expert collaboration.  Please check back soon.


Available Tools and Resources

  • SAMHSA provides a summary of best practices in planning, implementation, and evaluation in its "Guide to SAMHSA’s Strategic Prevention Framework" [1]
  • SAFE Project. Coalitions can use the SAFE Solutions dashboard to help lead discussions on which strategies to implement within their community. [2] The Community Playbook includes a template for building an action plan and for setting S.M.A.R.T. goals. [3]
  • The National Association of County and City Health Officials (NACCHO) has published a report with Joslyn Levy & Associates titled "Specifying Monitoring and Evaluation Measures for Local Overdose Prevention and Response Strategies: A Toolkit." [4]
  • The National Implementation Research Network has public health implementation as one of its four focus themes. [5]
  • The UNC Center for the Business of Health has launched the "From Settlement to Solutions" website, which is a comprehensive resource for the use of evidence-based opioid settlement funds, based on community conversations. This North Carolina case study consolidates best practices, research, policy trackers, and tools, providing a centralized hub for quick and easy reference. [6]
  • Research Meta-Analysis. Although it is dated, Durlak and DuPre (2008) is worthy of review because it provides a review of over 500 research findings on the implementation process. [7]

Promising Practices

SAFE Solutions is an ever-growing platform.  Currently limited information is readily available for this section.  SAFE Project is dedicated to providing communities with the most relevant and innovative materials.  We will continue to regularly monitor and make updates accordingly with community input and subject matter expert collaboration.  Please check back soon.

Sources

  1. ↑ https://www.samhsa.gov/sites/default/files/20190620-samhsa-strategic-prevention-framework-guide.pdf
  2. ↑ https://www.yoursafesolutions.us/
  3. ↑ https://www.safeproject.us/safe-community-playbook-and-safe-solutions/
  4. ↑ https://mys.mapyourshow.com/mys_shared/naccho2024/handouts/NACCHO_SpecifyingMonitoring&EvaluationMeasures_Toolkit2024_FINAL.pdf
  5. ↑ https://nirn.fpg.unc.edu/
  6. ↑ https://cboh.kenaninstitute.unc.edu/opioid-project/
  7. ↑ Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3/4), 327–350. Retrieved from https://www.researchgate.net/publication/5529147_Implementation_Matters_A_Review_of_Research_on_the_Influence_of_Implementation_on_Program_Outcomes_and_the_Factors_Affecting_Implementation
Retrieved from "https://yoursafesolutions.us/mediawiki/index.php?title=Effective_Action_Planning_and_Implementation&oldid=5821"