The Comprehensive Guide to Change Management Metrics for Adoption

by The Change Compass | Change Measurement

Change management is an intricate dance between vision, strategy, execution, and perhaps most importantly, adoption. The ultimate goal of any change initiative is not merely to implement new systems, processes, or regulations, but rather to embed these changes into the very fabric of the organization, ensuring widespread adoption and long-term sustainability.

However, achieving full adoption is no small feat. Many change initiatives falter along the way, failing to garner the buy-in and commitment necessary for success. Even when adoption is initially achieved, sustaining it over time presents its own set of challenges.

Understanding the Dynamics of Change Adoption:

Change adoption is not a one-size-fits-all endeavor. It’s influenced by a myriad of factors, including organizational culture, leadership support, employee engagement, and the nature of the change itself. Therefore, it’s essential to approach the measurement of adoption metrics with a nuanced understanding of these dynamics.

Before diving into specific metrics, let’s explore some fundamental principles of change adoption:

Context Matters: Every change initiative is unique, shaped by its context, stakeholders, and objectives. What works for one organization may not necessarily work for another. Therefore, it’s crucial to tailor adoption metrics to align with the specific goals and dynamics of each initiative.
Focus on Outcomes: Adoption metrics should go beyond mere activities or outputs and focus on outcomes. Instead of measuring how many employees attended training sessions, for example, focus on whether the training resulted in improved performance or behaviour change.
Continuous Monitoring: Change adoption is not a one-time event but an ongoing process. Continuous monitoring of adoption metrics allows organizations to identify trends, address challenges, and make course corrections as needed.

Now, let’s explore adoption metrics across different types of change initiatives:

Metrics for System Implementations:

System implementations, whether it’s a new CRM platform, ERP system, or productivity tool, often represent significant investments for organizations. To ensure a return on investment, it’s crucial to measure adoption effectively. Here are some key metrics to consider:

System Feature Usage Frequency: Measure how frequently employees utilize various features of the new system. This metric provides insights into whether employees are leveraging the system to its full potential and identifies areas for additional training or support.
Process Efficiency: Assess the efficiency gains achieved through the implementation of the new system. This metric quantifies improvements in workflow efficiency, resource utilization, and cycle times.
Customer Conversation Audit: If the change is aimed to improve the quality of customer interactions post-implementation, then the customer conversation should be audited. This metric focuses on whether the system enhances customer information accessibility, improves service representation, and ultimately leads to higher customer satisfaction.
Sales Volume: If the system aims to boost sales, track changes in sales volume post-implementation. This metric provides a tangible indicator of the system’s impact on revenue generation and business performance.
Information Completeness: Measure the completeness of customer information captured by the new system. This metric highlights the system’s effectiveness in capturing and storing relevant data, which is critical for decision-making and customer service.
Customer Satisfaction: Gauge customer satisfaction levels following the system implementation. This metric reflects the system’s ability to meet customer needs, deliver value, and enhance overall satisfaction.

Metrics for Compliance Initiatives:

Compliance initiatives, whether it’s adherence to regulatory standards, industry certifications, or internal policies, require meticulous attention to detail. Here are some key metrics to consider for measuring compliance adoption:

Process Compliance: Monitor adherence to regulatory processes and requirements. This metric ensures that the organization remains compliant with relevant regulations and mitigates the risk of non-compliance penalties.
Rated Compliance of Targeted Behaviours: Evaluate the compliance level of specific behaviours targeted by the regulatory change. This metric provides insights into whether employees are adopting the prescribed behaviours and following compliance protocols.
Frequency of Team Leader Coaching: Track the frequency of coaching sessions conducted by team leaders to reinforce compliance behaviours. This metric emphasizes the role of leadership in driving and sustaining compliance across the organization.
Customer Feedback: Solicit feedback from customers regarding their experience with the organization post-compliance implementation. This metric captures customer perceptions of the organization’s adherence to regulatory standards and its commitment to compliance.
Number of Incidents: Depending on the nature of compliance requirements, track the number of incidents related to non-compliance. This metric serves as an early warning system for identifying areas of weakness in compliance efforts and implementing corrective actions.

Metrics for Restructuring Initiatives:

Restructuring initiatives, whether driven by mergers, acquisitions, organizational realignment, or cost-cutting measures, often have far-reaching implications for employees, departments, and the overall organizational structure. Measuring adoption in restructuring initiatives requires a nuanced understanding of the changes’ impact on employee morale, productivity, and alignment with organizational goals. Here are some key metrics to consider:

Employee Engagement and Morale: Measure changes in employee engagement and morale before, during, and after the restructuring initiative. Surveys, focus groups, and one-on-one interviews can provide valuable insights into employees’ perceptions, concerns, and levels of commitment to the new organizational structure.
Organizational Alignment: Assess the degree to which the restructuring initiative aligns with the organization’s strategic objectives and long-term vision. Key performance indicators (KPIs), such as revenue growth, market share, and customer satisfaction, can help gauge the effectiveness of the restructuring in driving organizational alignment and performance.
Communication Effectiveness: Evaluate the effectiveness of communication channels and messaging during the restructuring process. Metrics such as employee feedback on communication clarity, frequency of updates, and perceived transparency can shed light on the effectiveness of communication strategies in managing change and alleviating uncertainty.
Employee Productivity and Performance: Monitor changes in employee productivity and performance following the restructuring initiative. Key metrics may include employee turnover rates, absenteeism, and performance evaluations. By tracking these metrics over time, organizations can assess the impact of restructuring on employee motivation, workload, and job satisfaction.
Leadership Effectiveness: Assess the effectiveness of leadership in navigating the restructuring process and driving adoption of the new organizational structure. Metrics such as employee ratings of leadership communication, support, and decision-making can provide valuable feedback on leadership effectiveness and its impact on employee morale and commitment.
Team Dynamics and Collaboration: Measure changes in team dynamics, collaboration, and cross-functional cooperation post-restructuring. Surveys, team assessments, and project outcomes can help identify strengths and weaknesses in team dynamics and collaboration, enabling organizations to address barriers to adoption and foster a culture of teamwork and collaboration.

Implementing and Measuring Adoption Metrics:

Once you’ve identified the relevant adoption metrics for your change initiative, the next step is to implement and measure them effectively. Here are some practical strategies to consider:

Surveys: Utilize surveys to gather feedback from employees, customers, and other stakeholders. Design surveys to capture both quantitative data, such as ratings and frequencies, and qualitative insights into the perceived effectiveness of the change initiative.
Observations: Encourage stakeholders, subject matter experts (SMEs), change champions, and leaders to observe and provide feedback on the implementation process. Their firsthand observations can uncover valuable insights into adoption barriers and successes.
System Tracking Data: Leverage data captured by the system itself to track usage patterns, process compliance, and other relevant metrics. Analyze this data to identify trends and areas for improvement in adoption efforts.
Employee or Stakeholder Feedback Sessions: Conduct regular meetings, interviews, or workshops to solicit feedback from employees and stakeholders. Create a safe and open environment for sharing concerns, challenges, and suggestions related to the change initiative.
Continuous Improvement: Use adoption metrics as a basis for continuous improvement. Regularly review and analyze adoption data to identify areas of success and opportunities for enhancement. Make adjustments to strategies, communication plans, and support mechanisms as needed to drive greater adoption.

Measuring Behaviours in System Implementations:

A significant portion of change involved system or digital change. In system implementations, the successful adoption of new technologies and processes often hinges on changes in employee behaviours. While it’s essential to track macro-level outcomes such as system usage frequency and process efficiency, measuring micro-behaviours provides a stronger link to the direct, underlying drivers of adoption. Here’s how to measure targeted and specific micro-behaviours in the context of a system implementation:

User Interface Navigation: Assess employees’ proficiency in navigating the new system’s user interface. Track metrics such as the time taken to complete common tasks, the number of clicks required to access key features, and the frequency of help requests. If these are not available, observational studies and user feedback can also provide valuable insights into usability issues and training needs.
Data Entry Accuracy: Measure the accuracy of data entry performed by employees using the new system. Compare the quality of data input before and after the implementation, looking for improvements in data accuracy, completeness, and consistency. Conduct periodic audits and spot checks to identify errors and areas for improvement.
Workflow Integration: Evaluate the extent to which employees integrate the new system into their existing workflows. Track metrics such as the proportion of tasks completed using the new system versus legacy systems, the frequency of workarounds or manual interventions, and the level of integration with other tools or processes. Interviews and focus groups can uncover barriers to workflow integration and inform targeted interventions.
Collaboration and Knowledge Sharing: Measure employees’ engagement in collaborative activities and knowledge sharing facilitated by the new system. Look for indicators such as the frequency of document sharing, participation in online discussions or forums, and contributions to shared repositories or knowledge bases. Social network analysis and peer assessments can highlight patterns of collaboration and identify key influencers or knowledge brokers within the organization.
Adoption of Best Practices: Assess employees’ adoption of best practices and standardized workflows supported by the new system. Monitor adherence to established guidelines, protocols, and procedures, looking for deviations or non-compliance. Use performance metrics such as error rates, rework cycles, and customer satisfaction scores to evaluate the effectiveness of best practices in driving desired outcomes.
Change Agent Engagement: Measure the engagement and effectiveness of change agents, champions, or ambassadors tasked with promoting adoption of the new system. Track metrics such as the frequency of communication and training sessions led by change agents, the level of participation in peer support networks or mentoring programs, and the impact of their advocacy efforts on adoption rates. Surveys and feedback mechanisms can assess the perceived credibility, accessibility, and responsiveness of change agents.

Implementing and Measuring Micro-Behaviours:

Define Clear and Measurable Objectives: Identify specific behaviours that are critical to the success of the system implementation and define clear, measurable objectives for each behaviour. Ensure alignment with broader adoption goals and desired outcomes.
Select Relevant Metrics: Choose metrics that are closely aligned with the targeted micro-behaviours and are actionable, observable, and trackable over time. Consider a combination of quantitative data (e.g., completion rates, error rates) and qualitative insights (e.g., user feedback, observational data) to provide a comprehensive understanding of behaviour change.
Utilize Multiple Data Sources: Gather data from multiple sources, including system logs, user activity tracking, surveys, interviews, and observational studies. Triangulating data from different sources enhances the reliability and validity of measurement and provides a more holistic view of behaviour change.
Monitor Progress Continuously: Establish a system for continuous monitoring of micro-behaviours throughout the implementation process. Regularly review and analyze data to identify trends, patterns, and areas for improvement. Use real-time feedback mechanisms to address issues and reinforce positive behaviours promptly.
Provide Timely Feedback and Support: Provide employees with timely feedback on their performance and progress toward behaviour change goals. Offer targeted support, training, and resources to address skill gaps, overcome barriers, and reinforce desired behaviours. Celebrate successes and recognize individuals or teams that demonstrate exemplary behaviour change.
Iterate and Adapt: Continuously iterate and adapt your measurement approach based on ongoing feedback and insights. Adjust metrics, data collection methods, and interventions as needed to respond to changing circumstances, emerging challenges, and evolving user needs. Be flexible and open to experimentation to optimize the effectiveness of your behaviour change efforts.

How Many Metrics Should I Use?

When it comes to measuring behaviour change in change initiatives, the age-old adage “less is more” holds true. While it may be tempting to track a multitude of metrics in the hopes of capturing every aspect of adoption, focusing on the critical few behaviours that will have the most direct impact on the outcome of the change is essential. You are also not going to have the bandwidth and resources to measure ‘everything’. Here’s how to determine the right number of metrics to use:

Focus on Key Objectives: Start by identifying the key objectives of the change initiative. What are the primary outcomes you hope to achieve? Whether it’s increased system usage, improved process efficiency, enhanced customer satisfaction, or compliance with regulatory standards, prioritize the behaviours that directly contribute to these objectives.
Prioritize High-Impact Behaviors: Narrow down your list of behaviours to those that have the most significant impact on achieving your key objectives. What are the critical few behaviours that, if changed, would lead to the greatest improvement in outcomes? Focus on behaviours that are both important and feasible to change within the scope of the initiative.
Consider Complexity and Manageability: Be mindful of the complexity and manageability of the behaviours you choose to measure. While it’s important to capture a comprehensive view of behaviour change, tracking too many metrics can become overwhelming and dilute focus. Aim for a manageable number of metrics that are meaningful, actionable, and directly linked to the desired outcomes.
Quantitative vs Qualitative Metrics: Whilst quantitative metrics are usually preferred by executives and easier to report on, sometimes you may need to incorporate qualitative metrics to gain a holistic understanding of behaviour change. Quantitative metrics such as completion rates, error rates, and productivity measures provide objective data on behaviour performance, while qualitative insights from surveys, interviews, and observations offer deeper context and understanding.
Consider Interdependencies and Trade-Offs: Recognize that behaviours are often interconnected, and changes in one behaviour may impact others. Consider the interdependencies and potential trade-offs between different behaviours when selecting your metrics. Focus on behaviours that have a ripple effect and can drive change across multiple dimensions of the initiative.

By focusing on the critical few behaviours that have the most direct impact on the outcome of the change, you can streamline measurement efforts, maintain clarity of purpose, and maximize the effectiveness of your change initiative. Remember, the goal is not to measure everything, but to measure what matters most and use that information to drive meaningful behaviour change and achieve successful adoption of the change.

Change adoption dashboard

Now that you have determined exactly what you want to measure to drive adoption, you may want to create a dashboard. Check out our article on ‘Designing a Change Adoption Dashboard’.

To read more about measuring change check out our articles here.

Change adoption is the ultimate goal of any change initiative, and effective measurement of adoption metrics is key to achieving success. By understanding the dynamics of change adoption, selecting the right metrics, and implementing them effectively, change practitioners and leaders can navigate the complexities of change and drive meaningful outcomes for their organizations. Remember, adoption is not a destination but a journey, and with the right metrics and strategies in place, sustainable change is within reach.

To find out more about leveraging a digital platform to create a change adoption dashboard click the below to chat to us.

How to measure change saturation

by The Change Compass | Change Measurement

Digitisation, Covid, competition and changing industry conditions have amongst other things brought on an accelerated change agenda for a lot of organisations. What were previously thought to be 1 to 5 year horizons of change suddenly became an immediate change. Not only is working from home a norm for a lot of organisations but the struggle for enterprises to survive and stay relevant in the new norm means more changes. The normal equilibrium for a lot of these organisations is one that consumes a smaller number of changes at any one time. Suddenly, with the increased number of changes this leads to change saturation.

Think of change saturation as a cup that fills up. The size of the cup is the change capacity. With limited capacity, there is only so much volume that is inherent. When the cup overflows the changes don’t stick and simply fall by the waist side.

What impacts an organisation’s change capacity?

1.Change leadership

Leaders can have significant influence on the organisation. Also, change leadership is a significant part of how change is managed and delivered. Effective change leadership can build on the capability of teams to be more agile and capable of absorbing more changes. Effective change leadership can also help to maximise how optimal the change is socialised and implemented, and therefore how it lands.

2. Change capability

The organisation’s change capability is one of the most important factors in determining their change capacity. Think of agile startup organisations that are constantly pivoting, introducing new operating models, products and services. This is part of their cultural norm. Other organisations that maybe less agile can also develop some of these capabilities through experience and development.

3. Nature of change

Not all types of changes are the same. Typically, a lot of the changes driven by senior leaders are about improving the bottom line or top line, improving customer experience or improving efficiency. Some are more complex changes requiring significant change journeys. Others may even be inherently ‘negatively perceived’ such as organisational restructuring and layoffs. However, there are also changes that are inherently seen as benefiting the work of employees (such as process improvement leading to less red tape).

4. Number of changes

The number of changes also impact the change capacity. Obviously more changes mean more capacity consumed, within an extent.

5. Impact of each change

The impact level of each change is also critical. Some initiatives have significant impact that requires a long period of time to embed the changes, e.g. culture change and complex system and process changes. On the other hand, simple process changes may not require much capacity and simple communication is all that is needed.

6. Overall change landscape

The overall change landscape of the organisation also affects perception and therefore in some ways the capacity for change. If competitors within the industry are all undergoing significant transformations then it sets the tone for what’s to come. In the same way, if all our friends are used to virtual ways of working then we become more open to it.

What’s the benefits of measuring change saturation?

Measuring change saturation can be significantly beneficial for the organisation. Understanding the tipping point means that PMO and change teams can work to avoid this from a planning perspective. Finding out during or after the releases that there is too much change saturation is an expensive exercise that diminishes the planned initiative benefits. It also leads to loss of productivity and operational disruptions. Moreover, employees lose faith in the ability of the organisation to manage change.

With greater clarity of the change saturation points organisations can work to monitor, track and manage the risk of over saturation. Measures can then be put in place to ensure minimal business disruption and protection of initiative benefits. This should be a key focus for risk in change.

How to measure change saturation?

Firstly, there is not one change saturation point for the whole organisation. Each department or even team may have different change saturation points. This is because they have different leaders, different cultural norms and different change capabilities.

So how do we measure the change saturation at a department or division level? Look historically at how changes have been received, starting with the past few months.

1. Monitor operational indicators

Depending on what the department is in charge of, understanding the change saturation point means closely monitoring the operational indicators. During change saturation operational indicators are usually also negatively impacted, depending on the nature of the changes.

For a call centre this could be average handling time, customer satisfaction rate, absenteeism, etc. For a back office department it could be efficiency or effectiveness measures, case completion rate, case quality rating, etc. You don’t need to be the expert in all the various operational measures of each department as you can tap on the operations representatives of these departments.

2. Get feedback from leaders

Interview or conduct surveys with departmental leaders to understand their perception of how changes have been implemented and any potential disruptions on the business. Understand how their teams have experienced change. Ask them whether it has been challenging to balance operational needs with change-induced activities. For example, were there challenges in employees attending initiative training sessions, and completing their role delivery obligations?

3. Be aware of potential biases

Be careful of opinions and feedback from leaders and employees. There may be a tendency to over-state and complain that there is constantly too much change. This happens because some over-state the risk of change saturation hoping that this may lead to less change and therefore easier to manage the operations of a business. Take care to avoid this bias.

4. Identify points of change saturation

If the department has undergone periods that has resulted in negative impact on operational indicators and leaders have also provided feedback of similar change disruptions then measure this level of change. Record this specifically.

This requires a portfolio-level view of all the changes that have occurred and the various impacts of each initiative. With this measurement you are able to then identify this level as perhaps just exceeding the change saturation point for that department. With this identified you can then plot this change saturation line. You should also closely monitor this level and adjust as needed.

Sample from The Change Compass (Red line is change saturation)

Using The Change Compass change impact can be expressed in terms of hours of impact per week. The change saturation line can the plotted against the change impact levels. From this, you’re able to easily visualise to what extent there could be risk in exceeding the change saturation line.

It is important to note that measuring change impacts and therefore change saturation should ideally be at a weekly level. Measuring change impact at a monthly level may not be sufficiently detailed enough since there could be changes in impact levels within each month. For example, for Finance the quarter-end consolidation cycle could start mid-month and therefore the change impact indication may show up as less than it actually should be simply because the data is rolled-up by month.

Deriving a monthly dashboard in which to inform not just the change volume, but types of changes, risks, and impacted areas will do wonders to provide clear visibility for the business to get ready for and to track changes.

Example of reporting from Change Automator

Other disciplines such as HR, Marketing or Operations rely on data to make critical business decisions. The Change function should also follow suit. Being armed with the right change impact data means that you can help the business to precisely pin-point change saturation points. This can provide tremendous value to the business in terms of business, initiative and risk protection.

If you’re keen to chat more about how you are managing change saturation and to find out more about our solutions feel free to contact us here to organise a chat.

Next Entries »