Digitisation, competition and changing industry conditions have amongst other things brought on an accelerated change agenda for a lot of organisations. What were previously thought to be 1 to 5 year horizons of change suddenly became an immediate change. Not only is working from home a norm for a lot of organisations but the struggle for enterprises to survive and stay relevant in the new norm means more changes. The normal equilibrium for a lot of these organisations is one that consumes a smaller number of changes at any one time. Suddenly, with the increased number of changes this leads to change saturation.
In change management, think of change saturation as a cup that fills up. The size of the cup is the change capacity. With limited capacity, there is only so much volume that is inherent. As the amount of change or the pace of change increases and the cup overflows the changes don’t stick and simply fall by the waist side and may result in change fatigue. This is when the negative impact of changes can occur.
What impacts an organisation’s change capacity?
1.Change leadership
Leaders can have significant influence on the organisation. Also, change leadership is a significant part of how change is managed and delivered. Effective change leadership can build on the capability of teams to be more agile and capable of absorbing more changes. Effective change leadership can also help to maximise how optimal the change is socialised and implemented, and therefore how it lands.
2. Change capability
The organisation’s change capability is one of the most important factors in determining their change capacity. Think of agile startup organisations that are constantly pivoting, introducing new operating models, products and services. This is part of their cultural norm. Other organisations that maybe less agile can also develop some of these capabilities through experience and development.
3. Nature of change
Not all types of changes are the same. Typically, a lot of the changes driven by senior leaders are about improving the bottom line or top line, improving customer experience or improving efficiency. Some are more complex changes requiring significant change journeys. Others may even be inherently ‘negatively perceived’ such as organisational restructuring and layoffs. However, there are also changes that are inherently seen as benefiting the work of employees (such as process improvement leading to less red tape).
4. Number of changes
The number of changes also impact the change capacity. Obviously more changes mean more capacity consumed, within an extent.
5. Impact of each change
The impact level of each change is also critical. Some initiatives have significant impact that requires a long period of time to embed the changes, e.g. culture change and complex system and process changes. On the other hand, simple process changes may not require much capacity and simple communication is all that is needed.
6. Overall change landscape
The overall change landscape of the organisation also affects perception and therefore in some ways the capacity for change. If competitors within the industry are all undergoing significant transformations then it sets the tone for what’s to come. In the same way, if all our friends are used to virtual ways of working then we become more open to it.
What’s the benefits of measuring change saturation?
Measuring change saturation can be significantly beneficial for the organisation. Understanding the tipping point means that PMO and change teams can work to avoid this from a planning perspective. Finding out during or after the releases that there is too much change saturation is an expensive exercise that diminishes the planned initiative benefits. It also leads to loss of productivity and operational disruptions. Moreover, employees lose faith in the ability of the organisation to manage change.
With greater clarity of the change saturation points organisations can work to monitor, track and manage the risk of over saturation. Measures can then be put in place to ensure minimal business disruption and protection of initiative benefits. This should be a key focus for risk in change.
How to measure change saturation?
Firstly, there is not one change saturation point for the whole organisation. Each department or even team may have different change saturation points. This is because they have different leaders, different cultural norms and different change capabilities.
So how do we measure the change saturation at a department or division level? Look historically at how changes have been received, starting with the past few months.
1. Monitor operational indicators
Depending on what the department is in charge of, understanding the change saturation point means closely monitoring the operational indicators. During change saturation operational indicators are usually also negatively impacted, depending on the nature of the changes.
For a call centre this could be average handling time, customer satisfaction rate, absenteeism, etc. For a back office department it could be efficiency or effectiveness measures, case completion rate, case quality rating, etc. You don’t need to be the expert in all the various operational measures of each department as you can tap on the operations representatives of these departments.
2. Get feedback from leaders
Interview or conduct surveys with departmental leaders to understand their perception of how changes have been implemented and any potential disruptions on the business. Understand how their teams have experienced change. Ask them whether it has been challenging to balance operational needs with change-induced activities. For example, were there challenges in employees attending initiative training sessions, and completing their role delivery obligations?
3. Be aware of potential biases
Be careful of opinions and feedback from leaders and employees. There may be a tendency to over-state and complain that there is constantly too much change. This happens because some over-state the risk of change saturation hoping that this may lead to less change and therefore easier to manage the operations of a business. Take care to avoid this bias.
4. Identify points of change saturation
If the department has undergone periods with multiple change initiatives that has resulted in negative impact on operational indicators and leaders have also provided feedback of similar change disruptions then measure this level of change. Record this specifically.
This requires a portfolio-level view of all the changes that have occurred and the various impacts of each initiative. With this change portfolio measurement you are able to then identify this level as perhaps just exceeding the change saturation point for that department. With this identified you can then plot this change saturation line. You should also closely monitor this level and adjust as needed.
Using The Change Compass change impact can be expressed in terms of hours of impact per week. The change saturation line can the plotted against the change impact levels. From this, you’re able to easily visualise to what extent there could be risk in exceeding the change saturation line.
It is important to note that measuring change impacts and therefore change saturation should ideally be at a weekly level. Measuring change impact at a monthly level may not be sufficiently detailed enough since there could be changes in impact levels within each month. For example, for Finance the quarter-end consolidation cycle could start mid-month and therefore the change impact indication may show up as less than it actually should be simply because the data is rolled-up by month.
Deriving a monthly dashboard in which to inform not just the change volume, but types of changes, risks, and impacted areas will do wonders to provide clear visibility for the business to get ready for and to track changes.
Other disciplines such as HR, Marketing or Operations rely on data to make critical business decisions. The Change function and change leaders should also follow best practices. Being armed with the right change impact data means that you can help the business to precisely pin-point change saturation points. This can provide tremendous value to the business in terms of business, initiative and risk protection.
If you’re keen to chat more about how you are managing change saturation and to find out more about our solutions feel free to contact us here to organise a chat.
Why Nailing the Right Change Management Metrics is Critical and Can Make or Break Your Reputation
As organizations strive to adapt and thrive in dynamic environments, how the change management process is tracked has become a strategic imperative. However, the success of any change initiative hinges not only on effective planning and execution but also on the ability to measure and communicate its impact accurately. After all, without the right measures how do we know that we are moving in the right direction? In this article, we explore critical change management reports that executives value in shaping organizational understanding and decision-making. We delve into the metrics that may compromise your credibility and, more importantly, highlight the metrics that executives truly value, providing a roadmap to creating reports that resonate with leadership.
Reading your executives and where they are
Prior to designing the right change management reports and metrics it is absolutely essential that you understand where they are coming from. Understanding their key concerns and perspectives will help you design the right content to engage them. Key questions you may want to delve into include:
What issues are top of mind for executives when it comes to managing change?
What has worked or not worked well in the past for change (within what timeline) that should be taken into account?
How experienced are these executives in driving complex change?
Putting your strategic hat on, what are the key business performance challenges that executives are facing into? What are the people and change connections to these?
What are the top key organisational risks that executives are focused on? What are the people and change connections to these?
Vanity Metrics – Metrics That Don’t Connect to Business Outcomes
One of the pitfalls in change management reporting is the reliance on vanity metrics—superficial measures that may look impressive but lack a direct connection to tangible business outcomes. Metrics such as the number of training hours delivered, numbers of stakeholder groups who received communications or the volume of communication materials distributed might seem impressive and easy to measure, but they provide little insight into the real impact of the change on the organization.
Executives are not interested in surface-level data; they want to understand how the change contributes to the achievement of strategic objectives and positively influences key performance indicators. To enhance credibility, change management reports must move beyond vanity metrics and focus on indicators that align with broader business goals.
Activity Metrics – Counting Without Context
Measuring the sheer volume of activities related to a change initiative can be misleading, or worse, meaningless, if not accompanied by context and relevance. Activity metrics, such as the number of workshops conducted, numbers of impact assessment activities conducted, number of deliverables worked on, or emails sent, might create an illusion of progress. However, these metrics fail to provide insights into the quality of engagement, the depth of understanding among employees, or the actual impact on work behaviours. Operational managers may find these interesting, but less likely for executives.
Instead of focusing solely on activities, change management reports should emphasize the effectiveness of these activities in driving desired outcomes. Metrics should, instead, highlight the quality of engagement, the level of understanding, and the behavioural shifts observed within the organization.
Cost-Focused Metrics – Counting Dollars Without Value
While cost-related metrics are important for financial stewardship, solely focusing on cost without considering the value generated by the change can undermine the perceived success of the initiative. Metrics such as the budget spent or the cost per participant may provide financial insights but do not necessarily convey the broader impact on organizational performance.
Change management reports should focus more on value metrics than cost metrics. Focusing purely on cost is restricting the value of managing change as another cost to the business. However, focusing on the value created in maximising business performance and achieving greater adoption can significant extend the understanding of change management value. Executives are interested in understanding what business value is created through managing change. Value includes how the targeted benefits are better realised and how the business performance is protected or maximised during the implementation of change.
Intra-Practice Metrics – Metrics That Only Change Management Cares About
It’s a common misstep to develop metrics that only resonate within the change management function and key project milestones but fail to capture the attention of other business units or executives. Metrics that focus exclusively on communication buzz generated, training satisfaction rates, or employee satisfaction with change processes might be valuable for internal assessments but lack the relevance needed to engage executives.
Even the focus on change maturity, that is often the single most critical focus for change management functions, may or may not appeal to a lot of executives. Unless you have already taken the executives on the journey of why focusing on change maturity is critical and you have them fully onboard with this, treat carefully in reporting on change maturity metrics.
At executive level, change management reports should transcend departmental boundaries and speak to the broader organizational impact. This means that your focus should be on reporting at a portfolio level and key strategic initiatives as relevant. Focus on generating insights of what the totality of changes mean to the organisation, and what employee experiences are across multiple initiatives. Metrics should also align with strategic goals and showcase how the change initiatives contributes to overarching business objectives.
The Right Metrics
I. Change Readiness Metrics – Assessing the Pulse of the Organization
Change readiness metrics serve as a barometer for understanding how prepared an organization is for a change initiative. To provide meaningful insights, these metrics should delve into the engagement journey, capturing key elements such as awareness, involvement, and participation.
Awareness: Measure the level of understanding and awareness of the upcoming change across different employee segments.
Involvement: Assess the degree to which employees are actively engaged in the change process, seeking their input and involvement.
Participation: Evaluate the extent to which employees are actively participating in change-related activities and initiatives.
Awareness: Measure the level of understanding and awareness of the upcoming change across different employee segments.
Involvement: Assess the degree to which employees are actively engaged in the change process, seeking their input and involvement.
Participation: Evaluate the extent to which employees are actively participating in change-related activities and initiatives.
Data Collection Methodology
Utilize a mix of quantitative and qualitative methods to gather data, including surveys, focus groups, and feedback mechanisms.
Ensure a representative sample across different organizational levels and functions to capture a comprehensive view of readiness.
Utilize a mix of quantitative and qualitative methods to gather data, including surveys, focus groups, and feedback mechanisms.
Ensure a representative sample across different organizational levels and functions to capture a comprehensive view of readiness.
Change Readiness Topic Areas
1. Awareness Assessment:
This section evaluates the extent to which employees are aware of the impending changes across initiatives. It includes an analysis of communication effectiveness, the clarity of messaging, and the overall visibility of the change initiatives. Metrics may encompass the percentage of employees who understand the change purpose and the reach of communication channels.
2. Involvement Evaluation:
Involvement is a key factor in gauging how actively employees are participating in the change process. This explores the degree to which employees feel engaged and have opportunities to contribute to the planning and decision-making aspects of the change. Employees may not have the opportunities to contribute to all types of change initiatives but for those that are relevant this can be quite insightful. Metrics include participation rates in change-related workshops, the number of submitted suggestions, and levels of engagement in feedback sessions.
3. Perceived Impact:
This area delves into employees’ perceptions of how the changes will affect them personally and professionally. It includes an analysis of perceived benefits, risks, and the overall impact on day-to-day responsibilities. Metrics may encompass the percentage of employees who feel well-informed about the impact of the change and qualitative insights from open-ended survey questions.
4. Change Champions performance:
Identifying and nurturing change champions can be crucial for successful change implementation, especially across the change portfolio. The presence of key business change champions who actively support and advocate for the changes within their teams and business units can shed light on how the change is performing. Metrics include the presence of key change champions across business areas, their engagement levels, and the effectiveness of their engagement strategies within their respective departments.
5. Learning and Development Readiness:
Learning and development play a vital role in equipping employees with the skills necessary for the upcoming changes. This section evaluates the organization’s readiness to deliver learning programs effectively, including the availability of resources, the alignment of learning content with change objectives, and the accessibility of learning materials. This can be outlined not just at initiative levels, but from business unit perspectives. Different business units may have different processes and channels from which to deploy learning and development across initiatives. The readiness and maturity of these can make or break the adoption of changes.
6. Resource Allocation and Availability:
Change initiatives often require additional resources, and this section examines the organization’s capacity to allocate and provide the necessary resources for a smooth transition. Metrics include the allocation and availability of SME resources, business representatives, the availability of technology and tools, and the overall preparedness of support functions for the myriad of change initiatives. Is there adequate allocation of these resources? For example, for digital transformation is there still reliance on manual work processes that should be upgrade to drive efficiency and effectiveness?
7. Leadership Alignment:
Leadership alignment is a critical factor influencing change readiness. This section evaluates the extent to which various leaders are aligned with the change vision and actively communicate their support. Metrics encompass leadership messaging consistency, visibility, and the perceived commitment of leaders to the success of the change.
8. Employee Feedback Mechanisms:
Establishing effective feedback mechanisms is essential for continuous improvement during change initiatives. This section assesses the availability, content and effectiveness of channels through which employees can provide feedback, ask questions, and express concerns. Metrics include response rates to feedback requests, the variety of feedback channels used, and themes of responses from targeted employee groups.
Change Readiness Data Collection Methods
Collecting data on change readiness is a crucial step in understanding an organization’s preparedness for a change initiative. Various approaches can be employed to gather relevant information. Here’s a list of key approaches:
Surveys and Questionnaires
Focus Groups
Interviews
Observation
Benchmarking
Document Analysis
Readiness Workshops
Network Analysis
Online Platforms and Social Listening
Pulse Surveys
Interactive Assessments
II. Change Journey Analytics – Navigating the Transformation Landscape
Change journey analytics provide a view of what key employee change experience highlights are, including insights on any behavioural changes, attitudinal changes, the volume of changes and how changes are being driven against key business performance challenges.
Change Volume RisksChange volume risk measures highlight key change impact volumes across the business over time, with key call outs on any risks on heightened change periods. The volume and nature of changes can be mapped against strategies to indicate to what extent the level and pace of impacts are aligned with strategic plans
Change Activity DesignThe totality of change management activities across initiatives from the lens of impacted employee groups should be analysed with potential risks highlighted including the alignment of learning content, communication message consistency and alignment, and to what extent there maybe excessive or below expected types of change activities in facilitating the change journeys
Single View of Change of BAU and Strategic InitiativesProvide a consolidated view of ongoing business-as-usual (BAU) changes alongside strategic initiatives. This ensures that executives have a comprehensive understanding of the organizational change landscape. From the perspective of the impacted change stakeholders or employee groups, they may not care about the source of the change and whether it is strategic or not. BAU initiatives may also be even more impactful than strategic initiatives.
Business PerformanceLink change activities to business performance metrics. Demonstrate how the change initiative contributes to key performance indicators and strategic goals. Also shed light how the nature and volume of changes may or may not impact the overall business performance. Executives are focused on keeping the business running successfully during change implementation as much as possible, with minimum disruption
Change volume risk measures highlight key change impact volumes across the business over time, with key call outs on any risks on heightened change periods. The volume and nature of changes can be mapped against strategies to indicate to what extent the level and pace of impacts are aligned with strategic plans
The totality of change management activities across initiatives from the lens of impacted employee groups should be analysed with potential risks highlighted including the alignment of learning content, communication message consistency and alignment, and to what extent there maybe excessive or below expected types of change activities in facilitating the change journeys
Provide a consolidated view of ongoing business-as-usual (BAU) changes alongside strategic initiatives. This ensures that executives have a comprehensive understanding of the organizational change landscape. From the perspective of the impacted change stakeholders or employee groups, they may not care about the source of the change and whether it is strategic or not. BAU initiatives may also be even more impactful than strategic initiatives.
Link change activities to business performance metrics. Demonstrate how the change initiative contributes to key performance indicators and strategic goals. Also shed light how the nature and volume of changes may or may not impact the overall business performance. Executives are focused on keeping the business running successfully during change implementation as much as possible, with minimum disruption
Nurturing Lasting Transformation: The Role of Adoption Analytics in Sustainable Change
When we discuss adoption analytics, we transcend the traditional boundaries of project management. While implementation marks the beginning of change, adoption analytics guide us through the more profound stages, measuring the extent to which the organization has embraced and embedded the change. It’s about ensuring that the seeds of change and transformation take root, flourish, and yield sustainable benefits.
1. Business Performance Metrics: Gauging Impact on Organizational Vital Signs
To truly understand the success of change initiatives, one must look beyond the surface and delve into its impact on key business performance metrics. This involves a holistic examination of factors such as productivity, efficiency, and customer satisfaction (depending on what the changes are).
Productivity: Assessing the changes’ effects on productivity involves measuring the organization’s output and efficiency post-implementation. Has there been an increase in task completion rates, a reduction in errors, or an enhancement in overall workflow efficiency?
Efficiency: Changes often aim to streamline processes and enhance efficiency. Analyzing the efficiency metrics helps determine whether the new procedures or tools have resulted in a smoother and more effective workflow.
Customer Satisfaction: In many cases, change initiatives are driven by a desire to improve customer experience. Adoption analytics in this context involve gauging customer satisfaction levels, whether through surveys, feedback mechanisms, or other relevant indicators.
By examining these metrics, organizations can gauge the real impact of the change on their vital signs, ensuring that the intended improvements manifest in tangible and measurable ways.
2. Benefit Realization: From Anticipation to Tangible Outcomes
Anticipated benefits form the backbone of any change initiative, but true success lies in the tangible realization of these expected outcomes. Benefit realization assessment through adoption analytics involves tracking key performance indicators (KPIs) directly influenced by the change.
Tracking KPIs: Identify and monitor KPIs that are closely tied to the specific objectives of the change. These could include financial metrics, customer retention rates, employee engagement scores, or any other relevant indicators.
Tangible Outcomes: Work hand-in-hand with initiative benefit owners to ensure clear ownership and tracking of benefits. Establish a system that allows for the ongoing assessment of whether the anticipated benefits are being realized in practice.
Continuous Improvement: Benefit realization is an ongoing process. Regularly review and adjust strategies based on the data collected. This iterative approach ensures that the organization remains agile, adapting to changing circumstances and continuously optimizing the impact of the change.
Collaboration with Initiative Benefit Owners: A Crucial Element
A vital aspect of successful adoption analytics is collaboration with initiative benefit owners. These are individuals or teams responsible for overseeing the realization of anticipated benefits. Establishing clear ownership ensures accountability and facilitates a more targeted and effective approach to tracking and optimizing outcomes.
Clear Communication: Foster open lines of communication between change management teams and initiative benefit owners. Clearly communicate the expected benefits and collaborate on defining relevant metrics and tracking mechanisms.
Regular Check-Ins: Establish a framework for regular check-ins to assess progress, identify challenges, and strategize for ongoing success. These check-ins provide an opportunity to recalibrate efforts based on real-time insights.
Data-Driven Decision Making: Encourage initiative benefit owners to make data-driven decisions. Regularly review adoption analytics data together, and use these insights to inform strategic adjustments, ensuring that the organization is on a trajectory towards sustained success.
Adoption analytics are the linchpin in the journey from change initiation to sustainable integration. By meticulously measuring the impact on business performance and diligently tracking benefit realization, organizations can ensure that their transformative efforts result in lasting and meaningful change. Collaboration with initiative benefit owners enhances this process, fostering a culture of continuous improvement and adaptability that is crucial for navigating the ever-evolving landscape of organizational transformation.
Change practitioners may not be involved in all aspects of benefit realization and tracking. It could be that the focus is on ‘people’ and behaviour elements of changes that contribute to benefit realization. Incorporating these metrics into change management reports offers a comprehensive view of the change journey, from initial readiness to long-term adoption and benefits realization.
Crafting Compelling Change Management Reports
In the fast-paced world of change management, the ability to convey the impact of initiatives through well-crafted reports is a skill that cannot be underestimated. Executives require more than superficial metrics; they demand a nuanced understanding of how change aligns with strategic goals and influences organizational performance.
By steering clear of vanity metrics, activity-focused measurements, and overly cost-centric reporting, change management professionals can elevate their credibility and influence within the organization. Instead, a focus on change readiness, journey analytics, and adoption metrics provides a holistic perspective that resonates with executives, ensuring that the true value of change initiatives is accurately portrayed.
To gear up for the digital/AI-enabled world that we are already in, change practitioners should also be ready to adopt a range of digital tools to better present and converse about change management reports in a way that is interactive, and easy to generate data insights. Executives may ask a series of questions to probe deeper into the data, or want access themselves to be able to look into certain data points. The ability to answer these questions straight away using digital solutions will be the key to creating confidence, impact and trust with executives.
As organizations continue to navigate the complexities of change, the importance of insightful reporting cannot be overstated. It is not just about delivering change; it is about articulating its impact in a language that executives understand and appreciate. In doing so, change management professionals become not just implementers of change but strategic partners in driving organizational success. This is ultimately the goal for change teams and change practices.
Scaled Agile Framework (SAFe) has emerged as a leading methodology to address the organisational change demands of fostering flexibility, collaboration, and continuous improvement. A cornerstone of SAFe is the principle of ‘Measure and Grow,’ which emphasizes using data and fact-based decisions to enhance change outcomes over time, including predictability. Despite its centrality, SAFe does not explicitly detail the change management components essential for its success, including its deep understanding of SAFe’s measurement model that enables the design of a tailored metrics strategy for ensuring strategic alignment. Here we outline how change management practitioners can effectively apply the ‘Measure and Grow’ principle within an Agile Release Train (ART) to lead change and improve outcomes to support the Scaled Agile environment.
What does it mean to “measure and grow” in a business context?
In a business context, “measure and grow” refers to the process of evaluating performance metrics to identify how our work drives business value and areas for improvement, aligning with strategic business goals. By analyzing data, companies can implement strategies that foster growth, enhance productivity, and improve overall outcomes. This approach ensures continuous development aligned with organizational goals.
The “Measure and Grow” Principle in Scaled Agile
What does it mean to “measure and grow” in a business context?
“Measure and grow” in a business context refers to the process of assessing performance metrics and outcomes to identify areas for improvement. By analyzing data, businesses can implement strategies that foster growth, enhance customer satisfaction, and optimize resource allocation, ultimately driving sustainable success and competitive advantage.
“Measure and Grow” is integral to SAFe, focusing on systematic measurement and continuous improvement for overall business agility within the value stream. By leveraging data and analytics, organizations can quickly respond to market changes, make informed decisions that meet the needs of our customers, identify areas needing attention, uncover improvement opportunities, and iteratively enhance meaningful change in performance. For change management professionals, this principle translates into a structured approach to evaluate the effectiveness of change initiatives, pinpoint areas for improvement, and implement necessary adjustments.
In a Scaled Agile environment, “Measure and Grow” is a core tenant or principle that applies in all types of agile environments. By continuously assessing and refining change efforts, organizations can align their initiatives with strategic objectives, mitigate risks, and ensure sustained success.
In practice, a lot of organisations have not pinpointed exactly how change management measures can make or break the outcome of the change, and in a SAFe environment, across the program, portfolio as well as enterprise.
The ‘Measure and Grow’ principle as a core part of SAFe (From Scaled Agile Framework)
To operationalize the “Measure and Grow” principle in change management, it is crucial to establish a set of metrics and assessment frameworks. Here are some broad categories of different types of change measurements that are relevant. Note that since we are talking about SAFe, it is not just at the initiative level that we are talking about metrics. More importantly, it is about establishing a system to promote change improvement across the organisation.
Change Management KPIs and OKRs
Key Performance Indicators (KPIs) and Objectives and Key Results (OKRs) are essential tools for tracking the success of change management initiatives. KPIs provide quantitative measures of performance, while OKRs align change efforts with broader organizational goals. A change management stream or function should focus on establishing KPIs or OKRs to achieve laser focus on achieving change outcomes.
Examples of Initiative-Level Change Management KPIs that may roll out to form portfolio views
Employee Engagement Levels: This KPI assesses how change impacts employee morale and engagement, providing insight into the overall acceptance and support of the change initiative.
Learning Achievement Rates: This can include tracking the percentage of employees who have completed necessary training programs, as well as achieving the target level of competence to ensure that the workforce is adequately prepared for the change.
Feedback Scores: Collecting feedback from stakeholders through surveys or feedback forms helps gauge perception and identify areas needing improvement. It is important to note that depending on the change context, stakeholders may not be happy with the content of the change. However, understanding and tracking this perception is still important.
Change Adoption Rate: This KPI measures the percentage of stakeholders who have adopted the change. High adoption rates are the ultimate goal for initiatives.
Issue Resolution Time: Measuring the time taken to resolve user-related issues related to the change highlights the efficiency of support mechanisms and the responsiveness of the change management team. This is especially important during an agile environment where there may be constant changes.
Change Readiness and Stakeholder Engagement Metrics
Evaluating change readiness and stakeholder engagement is crucial to the success of any change initiative. These metrics help assess the organization’s preparedness for change and the level of involvement and support from key stakeholders. Readiness and engagement rates can also roll up at a portfolio level to provide oversight.
Change Readiness Metrics
Readiness Assessments: Conduct surveys or interviews to gauge the organization’s preparedness for the impending change. This can include evaluating awareness, understanding, and acceptance of the change.
Resource Availability: Measure the availability of necessary resources, such as budget, personnel, and tools, to support the change initiative.
Communication Effectiveness: Assess the clarity, frequency, and effectiveness of communication regarding the change to ensure stakeholders are well-informed and engaged.
Stakeholder Engagement Metrics
Engagement Scores: Use surveys or feedback forms to measure the engagement levels of stakeholders, indicating their commitment and support for the change.
Participation Rates: Track stakeholder participation in change-related activities, such as workshops, meetings, and training sessions, to gauge their involvement.
Influence and Support: Assess the influence and support of key stakeholders in driving the change, ensuring that influential figures are actively endorsing the initiative.
By monitoring these metrics, change management professionals can identify potential barriers to change and take proactive steps to enhance readiness and engagement.
Stakeholder Competency Assessment
Successful change initiatives rely on the competence and readiness of key stakeholders. Assessing stakeholder competency involves evaluating the capability of sponsors and change champions to support and drive the change.
Sponsor Readiness/Capability Assessment
Sponsor Engagement: Measure the level of engagement and commitment from sponsors, ensuring they are actively involved and supportive of the change.
Decision-Making Effectiveness: Assess the ability of sponsors to make timely and effective decisions that facilitate the change process.
Resource Allocation: Evaluate the sponsor’s ability to allocate necessary resources, such as budget and personnel, to support the change initiative.
Change Champion Capability Assessment
Training and Knowledge: Measure the knowledge and training levels of change champions to ensure they are well-equipped to support the change.
Communication Skills: Assess the ability of change champions to effectively communicate the change message and address stakeholder concerns.
Influence and Leadership: Evaluate the influence and leadership capabilities of change champions, ensuring they can effectively drive and sustain the change.
By conducting these assessments, change management professionals can ensure that key stakeholders are prepared and capable of supporting the change initiative.
Change Adoption Metrics
Change adoption metrics provide insight into how well the change has been accepted and integrated into the organization. These metrics help assess the effectiveness of the change initiative and identify areas for improvement. At a portfolio level, there may be different levels of change adoption set for different initiatives depending on priority and complexity.
Key Change Adoption Metrics
Adoption Rate: Measure the percentage of stakeholders who have adopted the change, indicating the overall acceptance and integration of the new processes or systems.
Usage Metrics: Track the usage of new tools, processes, or systems introduced by the change to ensure they are being utilized as intended.
Performance Metrics: Assess the impact of the change on key performance indicators, such as productivity, efficiency, and quality, to determine the overall success of the change initiative.
By monitoring these metrics, change management professionals can gauge the success of the change initiative and identify opportunities for further improvement. To read more about change adoption metrics check out The Comprehensive Guide to Change Management Metrics for Adoption.
Change Impact and Capacity Metrics
Understanding the impact of change and the organization’s capacity to manage it is crucial for successful change management. Change impact metrics assess the effects of the change on the organization, while capacity metrics evaluate the organization’s ability to manage and sustain the change.
Change Impact Metrics
Aggregate impacts: Aggregate impacts across initiatives to form a view of how various teams and roles are impacted by various changes.
Risk Assessments: Identify potential risks associated with the change and evaluate their impact, ensuring that mitigation strategies are in place. A particular focus should be placed on business performance during change, across initiatives.
Capacity Metrics
Resource Capacity: Assess the availability of resources, such as personnel, budget, and tools, to support the change initiative and optimize flow time, enhance flow velocity, and improve flow efficiency while monitoring Flow Load.
Change Fatigue: Measure the risk for potential fatigue within the organization and its impact on stakeholders, ensuring that change initiatives are paced and driven appropriately.
Support Structures: Evaluate the effectiveness of support structures, such as training programs, information hubs, and help desks, in facilitating the change. Support structures may also include change champion networks.
By assessing change impact and capacity, change management practitioners can ensure that the organization is well-equipped to manage and sustain the change initiative.
Change Maturity Assessment
Change maturity assessments provide a comprehensive evaluation of the organization’s capability to manage change effectively. These assessments help identify strengths and weaknesses in the organization’s change management practices and provide a roadmap for improvement.
The Change Management Institute (CMI) Change Maturity Model is a comprehensive framework that takes a holistic approach to enhancing an organization’s change management maturity. It’s divided into three core functional domains, each playing a vital role in the overall journey toward maturity:
Project Change Management
Business Change Readiness
Strategic Change Leadership.
These domains serve as the foundation for achieving higher levels of maturity within the organization.
Within each of these domains, the CMI model outlines a structured path, consisting of five distinct maturity levels. These levels represent a continuum, starting at Level 1, which serves as the foundational stage, and progressing all the way to Level 5, the zenith of maturity and effectiveness. This multi-tiered approach offers organizations a clear roadmap for growth and development, ensuring that they have the tools and insights necessary to navigate the complexities of change management.
By conducting regular change maturity assessments, change management professionals can identify areas for improvement and develop targeted strategies to enhance the organization’s change management capability.
The “Measure and Grow” principle is a powerful tool for improving change outcomes in a Scaled Agile environment. By leveraging data and fact-based decision-making, change management professionals can ensure that change initiatives are effective, aligned with strategic objectives, and continuously improving. Establishing robust metrics and assessment frameworks, such as KPIs, OKRs, change readiness and stakeholder engagement metrics, stakeholder competency assessments, change adoption metrics, change impact and capacity metrics, and change maturity assessments, is essential to applying the “Measure and Grow” principle effectively.
Incorporating these metrics and assessments into change management practices enables organizations to identify areas for improvement, make informed decisions, and drive continuous improvement. By doing so, change management professionals can enhance the effectiveness of change initiatives, ensure successful adoption, and ultimately achieve better business outcomes.
Change management, much like peeling an onion, involves uncovering multiple layers before reaching the core. Each layer peeled back in the journey of planning and implementing change reveals new insights about the organization and the stakeholders impacted by the change. This process is essential to understanding the full scope of the change, adapting strategies accordingly, and ensuring successful implementation. By examining the various facets of an organization, such as leadership capability, operational practices, and cultural traits, we can better navigate the complexities of change management. Let’s explore the analogy of peeling an onion in change management and some practical insights for transforming change outcomes.
What is the peeling the onion protocol and how does it work?
The Peeling the Onion Protocol is a change management strategy that involves gradually uncovering layers of resistance within an organization. By systematically addressing concerns and facilitating open dialogue, this protocol fosters understanding and acceptance of change, ultimately leading to smoother transitions and enhanced collaboration among team members.
Peeling the layers – each layer reveals a different facet of the organisation and how they may or may not be conducive to supporting the change. Here are some ‘layers’ you may want to examine.
Leadership and Managerial Capability in Managing Change
Effective change management begins with strong leadership. Leaders and managers play a crucial role in guiding the organization through the transition. Peeling back this layer reveals whether leaders are equipped with the necessary skills, knowledge, and attitudes to drive change. It also highlights their ability to inspire and mobilize their teams, communicate the vision effectively, and manage resistance. Assessing leadership capability is fundamental, as inadequate leadership can hinder the entire change process.
Operational and Business Practices
The next layer involves examining the organization’s operational and business practices. This includes evaluating current workflows, processes, and systems to identify areas that may need adjustment or improvement. Understanding how daily operations align with the proposed changes helps in anticipating potential disruptions and devising strategies to minimize them. Are existing practices consistent with the end state of the change? Are existing practices consistent? (or NA?) Why or why not? This layer also involves identifying key performance indicators (KPIs) that can measure the success of the change initiatives (https://thechangecompass.com/how-to-manage-a-multitude-of-change-initiatives-including-enterprise-wide/).
Change Governance Practices and Structure
Change governance refers to the frameworks and structures in place to manage and oversee change initiatives. Having the right governance structure ensures that the right oversight and decision making is setup to steer the change to success. Peeling back this layer involves assessing the effectiveness of existing governance mechanisms, such as steering committees, decision-making protocols, and accountability structures. Strong change governance ensures that change initiatives are well-coordinated, resources are allocated appropriately, and progress is monitored consistently. Weak governance, on the other hand, can lead to confusion, misalignment, and failure to achieve desired outcomes.
Key questions to ask here include such as:
Is there sufficient governance bodies in place at different levels of the organisation to support change?
Are there too many governance bodies?
Are decision-making processes clear and effective?
Are the right stakeholders involved in the relevant decision-making areas?
Engagement Channels
Effective engagement is critical in change management. This is more than just communication. This layer focuses on the channels and methods used to engage with stakeholders throughout the change process. Evaluating engagement channels helps in understanding how information is disseminated, feedback is collected, and concerns are addressed. It also highlights the effectiveness of internal communications and the role of external communications in managing stakeholder expectations and perceptions. What channels are most effective for what audience groups? Are there any gaps for engaging with all groups of stakeholders? (beyond just blasting emails or messages).
Change Champion Network
Change champions are resignated individuals within the organization who advocate for and support the change initiatives. Peeling back this layer involves identifying and empowering these champions. It also includes assessing their influence, credibility, and ability to motivate others. A strong network of change champions can facilitate smoother transitions by promoting buy-in, addressing resistance, and reinforcing positive behaviors. With the right nurturing and experience, an organisation-wide changechampion network can act to support a myriad of change initiatives.
System and Process Maturity
The maturity of systems and processes within an organization significantly impacts the success of change initiatives. This layer involves evaluating the current state of technological systems, process automation, and data management practices. Mature systems and processes provide a solid foundation for implementing changes efficiently and effectively. Conversely, immature systems may require significant upgrades or overhauls to support the desired changes.
Change Management Maturity
Change management maturity refers to the organization’s overall capability to manage change. Peeling back this layer involves assessing the maturity of change management practices, methodologies, and tools. Organizations with mature change management capabilities have established frameworks, experienced practitioners, and a culture that embraces change. In contrast, organizations with low maturity may struggle with inconsistencies, resistance, and a lack of structured approaches.
This layer examines the availability of resources and capacity to support change initiatives. It includes assessing the organization’s financial resources, human capital, and physical infrastructure. Adequate resources and capacity are essential for executing change plans, overcoming obstacles, and sustaining momentum. Insufficient resources can lead to delays, reduced quality, and increased stress on employees. This does not just include the resources required within the project itself, it points more to the impacted stakeholders and if they have the resources and capacity required to undergo the change.
Culture and Behavioral Traits
Organizational culture and behavioral traits play a significant role in how change is perceived and adopted. Peeling back this layer involves understanding the underlying values, beliefs, and behaviors that influence how employees respond to change. It also includes identifying cultural strengths that can be leveraged and cultural barriers that need to be addressed. A supportive culture fosters resilience, adaptability, and a positive attitude towards change.
Specifically:
Do existing behaviours and practices support the change end state?
Are there potentially inconsistent behaviours comparing the end state and the current state?
Beyond the specific behaviours required in the change initiative itself, how are these in alignment with broader cultural practices?
Key Takeaways from the Onion Analogy in Change Management
1. Each Layer Needs to Be Peeled Before Another Layer Can Be Peeled
The process of discovering and understanding the complexities of change cannot be rushed. Each layer provides valuable insights and learning opportunities that prepare the organization for the next layer of discovery. Skipping layers or rushing through the process can lead to incomplete assessments, overlooked challenges, and ineffective solutions. Patience and persistence are crucial for a thorough and successful change management journey.
Assessing and understanding each layer can take time. Data, both quantitative and qualitative, may be required to truly understand what each layer means and how it implicates the change.
2. How the Onion Appears May Not Be What It Is at Its Core
Initial perceptions of the organization may not reflect its true state. It takes time and effort to uncover the deeper issues, strengths, and opportunities. This requires a willingness to look beyond surface-level indicators and delve into the core aspects of the organization. Attention to detail and a commitment to uncovering the truth are essential for developing accurate and effective change strategies.
For example:
Are publically communicated and reinforced messages acted on?
Do leaders practice what they preach?
Do stakeholders commit to decisions already made? Or do they ignore it?
Is there clear alignment between different layers of the organisation? How is this done?
3. You May Discover Rotten Parts That Need to Be Replaced
During the process of peeling back layers, you may encounter parts of the organization that are severely inadequate or dysfunctional. These “rotten” parts may need to be replaced or significantly improved before the change can proceed. This could involve overhauling critical capabilities, restructuring teams, or implementing new systems. Recognizing and addressing these issues promptly is essential for ensuring the overall health and success of the organization.
You may find, for example:
Stakeholders that are adamant to block the change for various reasons
Teams that simply do not have the right skills or attitude to transition to the required state
Processes that are simply outdated or convoluted, so much that end state targets cannot be achieved
Systems that are outdated and do not provide the right insights to support the end state
4. Different Types of Onions and Organizations
Just as there are different types of onions, organizations vary in size, complexity, and nature. Assessing the complexity of the change at the outset helps in determining the time, effort, and resources required to peel back the layers. A comprehensive understanding of the organization’s unique characteristics allows for tailored change management strategies that address specific needs and challenges.
Practical Steps for Applying the Onion Analogy in Change Management
Step 1: Initial Assessment and Planning
Begin by conducting a thorough initial assessment of the organization. This involves gathering data, engaging with key stakeholders, and understanding the current state of affairs. Develop a comprehensive change management plan that outlines the objectives, scope, and timelines for each layer of the onion. This plan should also identify key metrics for measuring success and mechanisms for tracking progress.
Step 2: Assess Leadership and Managerial Capability
Evaluate the capability of leaders and managers to drive change. This includes assessing their skills, experience, and attitudes towards change. Provide training and support where needed to enhance their ability to lead effectively. Strong leadership is foundational to the success of any change initiative.
Step 3: Examine Operational and Business Practices
Analyze current workflows, processes, and systems to identify areas that may require adjustment. Engage with employees at all levels to gather insights and understand potential bottlenecks. Develop strategies to streamline operations and ensure alignment with the change objectives.
Step 4: Review Change Governance Practices
Assess the existing governance structures and practices in place to manage change initiatives. Ensure that there are clear decision-making protocols, accountability mechanisms, and regular progress reviews. Strengthen governance frameworks as needed to support effective change management.
Step 5: Evaluate Engagement Channels
Review the channels and methods used to communicate with stakeholders. Ensure that there are effective mechanisms for disseminating information, collecting feedback, and addressing concerns. Enhance engagement strategies to foster transparency, trust, and collaboration.
Step 6: Identify and Empower Change Champions
Identify individuals within the organization who can serve as change champions. Empower them with the necessary tools, resources, and support to advocate for the change initiatives. Leverage their influence and credibility to promote buy-in and address resistance.
Step 7: Assess System and Process Maturity
Evaluate the maturity of technological systems and processes. Identify areas that require upgrades or improvements to support the change. Invest in the necessary infrastructure and tools to ensure seamless implementation.
Step 8: Assess Change Management Maturity
Conduct a maturity assessment of the organization’s change management capabilities. Identify gaps and areas for improvement. Develop and implement strategies to enhance change management practices, methodologies, and tools.
Step 9: Review Resources and Capacity
Evaluate the availability of resources and capacity to support the change initiatives. Ensure that there are adequate financial, human, and physical resources to execute the change plans. Address any resource constraints proactively to prevent delays and disruptions.
Step 10: Understand Culture and Behavioral Traits
Conduct a cultural assessment to understand the underlying values, beliefs, and behaviors that influence how employees respond to change. Identify cultural strengths that can be leveraged and barriers that need to be addressed. Develop strategies to foster a supportive culture that embraces change.
The analogy of peeling an onion provides a powerful framework for understanding and managing change within an organization. Each layer peeled back reveals new insights and learning opportunities that are essential for successful change management. By carefully examining the various facets of the organization, such as leadership capability, operational practices, and cultural traits, organizations can navigate the complexities of change more effectively.
Patience, persistence, and attention to detail are key to uncovering the true state of the organization and developing tailored strategies that address specific needs and challenges. Ultimately, the journey of peeling the onion in change management leads to a deeper understanding, better preparation, and more successful change outcomes.
Successful change management relies on having the right metrics to measure progress, gauge impact, and communicate with stakeholders. Moreover, the right metrics can drive continuous improvement and help directly achieve change outcomes. However, not all metrics are beneficial, and some can mislead or fail to meet stakeholder needs, especially when managing change projects. Let’s check out the top change management metrics to avoid and go through examples to take note.
Understanding the Disconnect: Change Managers vs. Business Stakeholders
A significant reason certain change management metrics fall short is the differing perspectives between change managers and business stakeholders. Change managers and change practitioners are trained to view metrics through the lens of change management frameworks and methodologies, focusing on detailed assessments and structured approaches as a part of the change management strategy. These include applying ratings and judgments on aspects such as impact levels indicating levels and areas of impact.
In contrast, business stakeholders prioritize business operations, strategic outcomes, and practical implications. The busy business stakeholder is often looking for practical implications from metrics that can be used to directly drive decision making, meaning “what do I do with this data to improve the ultimate business outcome”.
Of course, different stakeholders have different data needs, and you need to show the right metric to the right type of stakeholder. For example, operations-focused stakeholders expect fairly detailed metrics and internal historical data to understand what that means in terms of organisation, coordination, capacity, and performance perspectives. Senior managers may prefer higher-level data with a focus on strategic impacts, overall progress, and adoption indicators of change success rate.
This disconnect can lead to the use of metrics that do not resonate with or are misunderstood by stakeholders that disrupt change success.
Change managers may leverage metrics that are derived from the various change management documents such impact assessments, training plan or communications plan. Metrics are also often chosen for ease of use and ideally are not overly complicated to execute.
For example, impact assessments typically involve rating stakeholder groups and initiatives on a traffic light system (red, amber, green) based on their impact. While this approach is systematic, it can be problematic for several reasons:
Lack of Sufficient Stakeholder Context: Business stakeholders might not understand the practical implications of these ratings. For instance, an “impact rating per initiative” may not clearly convey what the rating means for day-to-day operations or strategic goals. For example, if an initiative has a red impact rating, stakeholders might not grasp the specific operational changes or strategic adjustments needed, in essence, “what do I do with this?”. So, incorrect usage of data could result in lack of stakeholder engagement.
Misinterpretation of Traffic Light Ratings: The red, amber, green system can be misleading. Stakeholders might interpret red as an indicator of alarm or imminent risk, while green may be seen as a sign that no action is needed. This is because stakeholders are trained to interpret traffic light ratings this way (from the various project/business updates they’ve attended). In reality, red might simply mean high impact, requiring focused attention, and green might indicate a low impact but still require monitoring. For instance, a red rating might indicate significant process changes that need careful management, not necessarily a negative outcome.
Hard to defend ratings if prompted: Business stakeholders may also want to drill into how the ratings are determined, and based on what basis. They may expect a logical data-backed reasoning of how each colour scheme is determined. If a rating is based on an overall ‘personal judgment’ this may be hard to defend infront of a group of stakeholders.
Examples of Potentially Misleading Metrics
Certain metrics, although straightforward, can be easily misinterpreted and fail to provide a realistic picture of change impacts as a part of effective change management. Often these are selected because they are easy to report on. However, easy, make not give you the outcome you are looking for.
Number of Go-Lives: Tracking the number of Go-Lives over time might seem like an effective way to represent change volume. However, the most significant impacts on people given time often occur before or after the Go-Live date. For example, the preparation and training phase before Go-Live and the adoption phase afterward are critical periods that this metric overlooks. A Go-Live date might indicate a milestone but not the challenges, progress or impacts faced during the implementation phase.
Number of Activities Implemented: Similar to Go-Lives, this metric focuses on quantity rather than quality. Simply counting the number of activities does not account for their effectiveness or the actual change they drive within the organisation. For example, reporting that 50 training sessions were conducted does not reveal whether employees found them helpful or if they led to improved performance.
Number of impacts or stakeholders impacted: Again, using a numerical way to indicate progress can be very misleading, or unmeaningful. This is because it may be ‘interesting’ but with no real action for your stakeholder to take in order to somehow lead to a better overall change outcome. If metrics do not result in some kind of action, then over time it will not shape your change(s) toward the targeted outcomes. Or worse, your stakeholders may lose interest and lose confidence in the strategic impact of these metrics.
Another common way to report change metrics is to use the number of impacts or number of stakeholders impacted by the organizational change. This can be in terms of the following:
Number of divisions impacted
Number of stakeholder groups impacted
Number of employees impacted
Number of initiatives per division/stakeholder
Metrics That May Be Too Operational
Metrics that are overly operational can fail to capture meaningful progress or adoption. Perhaps if the metric are for reporting within the Change Management team that may be OK. However, when you are showing metrics to stakeholders, a different set of expectations should be cast.
If you are presenting metrics to senior managers, you need to ensure that they hit the mark for that audience group. If the group is more interested in strategic impact, and higher level progress outcomes, you need to tailor accordingly.
Examples of metrics that may be too operational include:
Number of Communications Sent: This metric measures activity but not effectiveness. Sending numerous emails or messages does not guarantee that the message is received, understood, or acted upon by stakeholders. For instance, stakeholders might receive 100 emails, but if the content is unclear, the communication effort is wasted. Or worse, the emails may not even have been read.
Number of Training Sessions Attended: This one is a classic. While training is crucial, the number of sessions attended does not necessarily reflect the attendees’ understanding, engagement, or the practical application of the training. For example, employees might attend training but not apply the new skills if the training is not relevant to their roles for various reasons.
Number of workshops/meetings: Another way of articulating the change management progress in terms of activities is the number of workshops or meetings conducted with stakeholders including focus groups to indicate employee engagement. Again, this may be good to track within the change management team. However, presenting this metric to stakeholders may not be appropriate as it may not meet their needs nor indicate change management success.
Number of changes: This may be a common way to report on changes planned, but it doesn’t really inform the extent of the change. One change can be significantly impactful whilst another does not have major stakeholder impacts and are more system impacts. Listing number of changes may be deceiving or misleading. This kind of data may not get you the level of acceptance targeted.
The way metrics are presented is just as important as the metrics themselves. Poor visualization can lead to misinterpretation, confusion, and misguided decisions. Here are some common pitfalls to avoid:
Ineffective Use of Pie Charts
Pie charts can be misleading when used to show data points that are not significantly different. For example, using a pie chart to represent the percentage of divisions impacted by a change might not effectively communicate the nuances of the impact if the differences between the divisions are minimal. A pie chart showing 45%, 30%, and 25% might not convey the critical differences in impact levels among divisions.
Misleading Traffic Light Ratings
Using red, amber, and green to indicate high, medium, and low impacts can send the wrong message. Stakeholders might associate these colours with good and bad outcomes rather than understanding the actual levels of impact. Stakeholder may be used to interpreting these in the context of their usual project or business updates where red indicated alarm and ‘bad’. This can lead to unnecessary alarm or complacency. For instance, a green rating might suggest no need for action, while in reality, it might require ongoing monitoring.
Overuse of Colours
Using too many colours in charts and graphs can overwhelm stakeholders, making it difficult to discern the key message. Using colours in data visualisation can be two-edged sword. Colour can effectively point your stakeholders are the area where you want them to focus on. But, too many colours can lose your audience. A cluttered visual can obscure the critical data points and lead to misinterpretation. For example, a graph with ten different colours can confuse stakeholders about which data points are most important.
Data visualisation tools are also important. A lot of people use Power BI which works for a foundational level of charts. For tailored charts, specifically designed to to influence stakeholders to clearly see certain angles of risks and opportunities leverage tools such as Change Compass.
Practical Takeaways for Senior Change Managers
To ensure that change management metrics are effective and take into account best practices practices, consider the following practical takeaways:
Align Metrics with Key Stakeholder Perspectives
Understand Stakeholder Priorities: Engage with stakeholders to understand their business goals, priorities and concerns. Tailor your metrics to address these aspects directly. For example, if stakeholders are concerned about operational efficiency, focus on metrics that reflect improvements in this area.
Use Business Language: Frame your metrics in a way that resonates with business stakeholders. Avoid change management jargon and reference, and ensure that the implications of the metrics are clear and actionable. For example, instead of using technical terms, explain how the metrics impact business outcomes. Think in terms of business activities, milestones, busy periods, and capacity challenges.
Focus on Meaningful Metrics
Measure Outcomes, Not Just Activities: Change leaders should prioritize metrics that reflect the outcomes and impacts of change indicate level of knowledge, rather than just the activities performed as a part of change management KPIs. For example, instead of counting the total number of employees attending change management training sessions, measure the improvement in employee performance or knowledge retention post-training.
Example: Instead of reporting that 100 employees attended training sessions, report that 85% of attendees showed improved performance in their roles after training, or that certain level of competencies were gained. Note that quantifiable metrics have more impact on the audience.
Track Engagement and Adoption: Monitor metrics that indicate the level of engagement and adoption among stakeholders or their perception of the change. This could include surveys, feedback forms, or direct measures of behaviour change and the overall success rate of the change.
Example: Use post-training surveys to measure employee confidence in applying new skills or managerial rating of application of learnt skills rather than employee satisfaction of the training sessions using satisfaction scores. Track the percentage of employees who actively use new tools or processes introduced during the change.
Example: Instead of reporting that 100 employees attended training sessions, report that 85% of attendees showed improved performance in their roles after training, or that certain level of competencies were gained.
Example: Use post-training surveys to measure employee confidence in applying new skills or managerial rating of application of learnt skills. Track the percentage of employees who actively use new tools or processes introduced during the change.
Improve Metric Visualization
Simplify Visuals: Use clear, simple visuals that highlight the key messages. Avoid clutter and ensure that the most important data points stand out.
Example: Use bar charts or line graphs to show trends over time rather than pie charts that can be harder to interpret.
Contextualize Data: Provide context for the data to help stakeholders understand the significance. For example, instead of just showing the number of Go-Lives, explain what each Go-Live entails and its expected impact on operations. Or better, focus on showing the varying levels of impact on different stakeholders across time within the initiative.
Example: Accompany a Go-Live count with a visual showing the varying impact level of various implementation activities of the changes.
Example: Use bar charts or line graphs to show trends over time rather than pie charts that can be harder to interpret.
Example: Accompany a Go-Live count with a visual showing the varying impact level of various implementation activities of the changes.
Narrative Approach: Combine metrics with a narrative that explains the story behind the numbers as a part of the change management process. This can help stakeholders understand the broader context and implications.
Example: Instead of presenting raw data, provide a summary that explains key trends, successes, and areas needing attention.
Educate your stakeholders: Depending on stakeholder needs you may need to take them on a phased approach to gradually educate them on change management metrics and how you ultimately want them to drive the outcomes.
Example: You may start the education process to focus on more simplistic and easy-to-understand measures, and as your stakeholders are more change-mature, move to drill into more detailed metrics that explain the ‘why’ and ‘how’ to drive outcome success.
Continuously improvement: Provide regular updates on key metrics and adjust them based on feedback from stakeholders. Continuous communication ensures that everyone remains aligned and informed.
Example: Hold monthly review meetings with stakeholders to discuss the latest metrics, address concerns, and adjust strategies as needed.
Example: Instead of presenting raw data, provide a summary that explains key trends, successes, and areas needing attention.
Example: You may start the education process to focus on more simplistic and easy-to-understand measures, and as your stakeholders are more change-mature, move to drill into more detailed metrics that explain the ‘why’ and ‘how’ to drive outcome success.
Example: Hold monthly review meetings with stakeholders to discuss the latest metrics, address concerns, and adjust strategies as needed.
Examples of Effective Metrics
Employee Adoption and Engagement
Percentage of Employees Adopting New Process/System: This metric measures the rate at which employees are using new processes or systems introduced during the change. High adoption rates indicate successful integration.
Implementation: Use software usage analytics or surveys to track tool adoption rates.
Visualization: A graph showing adoption rates over time.
Employee Feedback Scores: Collect feedback on change initiatives through surveys or stakeholder ratings to measure sentiment/feedback and identify areas for improvement.
Implementation: Conduct regular surveys asking employees about their experience with the change process. Do note that depending on the change you may expect negative feedback due to the nature of the change itself (vs the way it was implemented).
Visualization: Bar/Line charts comparing feedback scores across different departments or time periods. Bar/Line charts are the standard go-to for data visualisation. They are easy to understand and interpret.
Implementation: Use software usage analytics or surveys to track tool adoption rates.
Visualization: A graph showing adoption rates over time.
Implementation: Conduct regular surveys asking employees about their experience with the change implementation process. Do note that depending on the change you may expect negative feedback due to the nature of the change itself (vs the way it was implemented).
Visualization: Bar/Line charts comparing feedback scores across different departments or time periods. Bar/Line charts are the standard go-to for data visualisation. They are easy to understand and interpret.
Impact on Business Outcomes
Improvement in Key Performance Indicators (KPIs): Track changes in KPIs that are directly impacted by the change initiatives, such as productivity, customer satisfaction, customer experience, improvement in process inconsistencies or financial performance.
Implementation: Identify relevant KPIs and measure their performance before and after change initiatives.
Visualization: Use line/bar graphs to show trends in KPI performance over time.
Operational Efficiency Metrics: Measure improvements in operational processes, such as reduced cycle times, error rates, or cost savings.
Implementation: Track specific operational metrics relevant to the change initiatives.
Visualization: Bar charts or heatmaps showing improvements in efficiency metrics across different operational areas.
Implementation: Identify relevant KPIs and measure their performance before and after change initiatives.
Visualization: Use line/bar graphs to show trends in KPI performance over time.
Implementation: Track specific operational metrics relevant to the change initiatives.
Visualization: Bar charts or heatmaps showing improvements in efficiency metrics across different operational areas.
Change management effectiveness requires metrics that not only measure progress but also resonate with business stakeholders and accurately reflect the impact of change initiatives. They should provide valuable insights. Avoiding common pitfalls such as relying on easily misinterpreted or overly operational metrics is crucial. By aligning metrics with stakeholder perspectives, focusing on meaningful outcomes, improving visualization, and communicating effectively, senior change and transformation professionals can ensure that their metrics truly support the success of their change initiatives.
The top change management metrics to avoid are those that fail to provide clear, actionable insights to business stakeholders. By understanding and addressing the disconnect between change managers and business stakeholders, and by prioritizing metrics that truly reflect the impact and progress of change, you can drive more effective and successful change management efforts by influencing your stakeholders in your organisation.
As a next step, Chat with us if you would like to discuss more about leveraging AI and technology to generate high-impact change management metrics and data for your stakeholders, both at project and portfolio levels, using data visualisation tools.
