Measure and Grow Change Management Outcomes Within Scaled Agile

Measure and Grow Change Management Outcomes Within Scaled Agile

Scaled Agile Framework (SAFe) has emerged as a leading methodology to address organisational change demands of fostering flexibility, collaboration, and continuous improvement. A cornerstone of SAFe is the principle of “Measure and Grow,” which emphasizes using data and fact-based decisions to enhance change outcomes over time. Despite its centrality, SAFe does not explicitly detail the change management components essential for its success. Here we outline how change management practitioners can effectively apply the “Measure and Grow” principle to lead change and improve outcomes to support the Scaled Agile environment.

The “Measure and Grow” Principle in Scaled Agile

“Measure and Grow” is integral to SAFe, focusing on systematic measurement and continuous improvement. By leveraging data and analytics, organizations can make informed decisions, identify areas needing attention, and iteratively enhance performance. For change management professionals, this principle translates into a structured approach to evaluate the effectiveness of change initiatives, pinpoint areas for improvement, and implement necessary adjustments.

In a Scaled Agile environment, “Measure and Grow” is a core tenant or principle that applies in all types of agile environments. By continuously assessing and refining change efforts, organizations can align their initiatives with strategic objectives, mitigate risks, and ensure sustained success.

In practice, a lot of organisations have not pinpointed exactly how change management measures can make or break the outcome of the change, and in a SAFe environment, across the program, portfolio as well as enterprise.

The ‘Measure and Grow’ principle as a core part of SAFe (From Scaled Agile Framework)

Key Elements of Measuring and Growing Change Outcomes

To operationalize the “Measure and Grow” principle in change management, it is crucial to establish a set of metrics and assessment frameworks. Here are some broad categories of different types of change measurements that are relevant.  Note that since we are talking about SAFe, it is not just at the initiative level that we are talking about metrics.  More importantly, it is about establishing a system to promote change improvement across the organisation.

Change Management KPIs and OKRs

Key Performance Indicators (KPIs) and Objectives and Key Results (OKRs) are essential tools for tracking the success of change management initiatives. KPIs provide quantitative measures of performance, while OKRs align change efforts with broader organizational goals.  A change management stream or function should focus on establishing KPIs or OKRs to achieve laser focus on achieving change outcomes.

Examples of Initiative-Level Change Management KPIs that may roll out to form portfolio views

  1. Employee Engagement Levels: This KPI assesses how change impacts employee morale and engagement, providing insight into the overall acceptance and support of the change initiative.
  2. Learning Achievement Rates: This can include tracking the percentage of employees who have completed necessary training programs, as well as achieving the target level of competence to ensure that the workforce is adequately prepared for the change.
  3. Feedback Scores: Collecting feedback from stakeholders through surveys or feedback forms helps gauge perception and identify areas needing improvement.  It is important to note that depending on the change context, stakeholders may not be happy with the content of the change.  However, understanding and tracking this perception is still important.
  4. Change Adoption Rate: This KPI measures the percentage of stakeholders who have adopted the change. High adoption rates are the ultimate goal for initiatives.
  5. Issue Resolution Time: Measuring the time taken to resolve user-related issues related to the change highlights the efficiency of support mechanisms and the responsiveness of the change management team.  This is especially important during an agile environment where there may be constant changes.

Change Readiness and Stakeholder Engagement Metrics

Evaluating change readiness and stakeholder engagement is crucial to the success of any change initiative. These metrics help assess the organization’s preparedness for change and the level of involvement and support from key stakeholders.  Readiness and engagement rates can also roll up at a portfolio level to provide oversight.

Change Readiness Metrics

  1. Readiness Assessments: Conduct surveys or interviews to gauge the organization’s preparedness for the impending change. This can include evaluating awareness, understanding, and acceptance of the change.
  2. Resource Availability: Measure the availability of necessary resources, such as budget, personnel, and tools, to support the change initiative.
  3. Communication Effectiveness: Assess the clarity, frequency, and effectiveness of communication regarding the change to ensure stakeholders are well-informed and engaged.

Stakeholder Engagement Metrics

  1. Engagement Scores: Use surveys or feedback forms to measure the engagement levels of stakeholders, indicating their commitment and support for the change.
  2. Participation Rates: Track stakeholder participation in change-related activities, such as workshops, meetings, and training sessions, to gauge their involvement.
  3. Influence and Support: Assess the influence and support of key stakeholders in driving the change, ensuring that influential figures are actively endorsing the initiative.

By monitoring these metrics, change management professionals can identify potential barriers to change and take proactive steps to enhance readiness and engagement.

Stakeholder Competency Assessment

Successful change initiatives rely on the competence and readiness of key stakeholders. Assessing stakeholder competency involves evaluating the capability of sponsors and change champions to support and drive the change.

Sponsor Readiness/Capability Assessment

  1. Sponsor Engagement: Measure the level of engagement and commitment from sponsors, ensuring they are actively involved and supportive of the change.
  2. Decision-Making Effectiveness: Assess the ability of sponsors to make timely and effective decisions that facilitate the change process.
  3. Resource Allocation: Evaluate the sponsor’s ability to allocate necessary resources, such as budget and personnel, to support the change initiative.

Change Champion Capability Assessment

  1. Training and Knowledge: Measure the knowledge and training levels of change champions to ensure they are well-equipped to support the change.
  2. Communication Skills: Assess the ability of change champions to effectively communicate the change message and address stakeholder concerns.
  3. Influence and Leadership: Evaluate the influence and leadership capabilities of change champions, ensuring they can effectively drive and sustain the change.

By conducting these assessments, change management professionals can ensure that key stakeholders are prepared and capable of supporting the change initiative.

Change Adoption Metrics

Change adoption metrics provide insight into how well the change has been accepted and integrated into the organization. These metrics help assess the effectiveness of the change initiative and identify areas for improvement.  At a portfolio level, there may be different levels of change adoption set for different initiatives depending on priority and complexity.

Key Change Adoption Metrics

  1. Adoption Rate: Measure the percentage of stakeholders who have adopted the change, indicating the overall acceptance and integration of the new processes or systems.
  2. Usage Metrics: Track the usage of new tools, processes, or systems introduced by the change to ensure they are being utilized as intended.
  3. Performance Metrics: Assess the impact of the change on key performance indicators, such as productivity, efficiency, and quality, to determine the overall success of the change initiative.

By monitoring these metrics, change management professionals can gauge the success of the change initiative and identify opportunities for further improvement.  To read more about change adoption metrics check out The Comprehensive Guide to Change Management Metrics for Adoption.

Change Impact and Capacity Metrics

Understanding the impact of change and the organization’s capacity to manage it is crucial for successful change management. Change impact metrics assess the effects of the change on the organization, while capacity metrics evaluate the organization’s ability to manage and sustain the change.

Change Impact Metrics

  1. Aggregate impacts: Aggregate impacts across initiatives to form a view of how various teams and roles are impacted by various changes.
  2. Risk Assessments: Identify potential risks associated with the change and evaluate their impact, ensuring that mitigation strategies are in place.  A particular focus should be placed on business performance during change, across initiatives.

Capacity Metrics

  1. Resource Capacity: Assess the availability of resources, such as personnel, budget, and tools, to support the change initiative.
  2. Change Fatigue: Measure the risk for potential fatigue within the organization and its impact on stakeholders, ensuring that change initiatives are paced and driven appropriately.
  3. Support Structures: Evaluate the effectiveness of support structures, such as training programs, information hubs, and help desks, in facilitating the change.  Support structures may also include change champion networks.

By assessing change impact and capacity, change management practitioners can ensure that the organization is well-equipped to manage and sustain the change initiative.

Change Maturity Assessment

Change maturity assessments provide a comprehensive evaluation of the organization’s capability to manage change effectively. These assessments help identify strengths and weaknesses in the organization’s change management practices and provide a roadmap for improvement.

The Change Management Institute (CMI) Change Maturity Model is a comprehensive framework that takes a holistic approach to enhancing an organization’s change management maturity. It’s divided into three core functional domains, each playing a vital role in the overall journey toward maturity: 

  1. Project Change Management
  2. Business Change Readiness
  3. Strategic Change Leadership. 

These domains serve as the foundation for achieving higher levels of maturity within the organization.

Within each of these domains, the CMI model outlines a structured path, consisting of five distinct maturity levels. These levels represent a continuum, starting at Level 1, which serves as the foundational stage, and progressing all the way to Level 5, the zenith of maturity and effectiveness. This multi-tiered approach offers organizations a clear roadmap for growth and development, ensuring that they have the tools and insights necessary to navigate the complexities of change management.

By conducting regular change maturity assessments, change management professionals can identify areas for improvement and develop targeted strategies to enhance the organization’s change management capability.

To read more about building Change Management Maturity check out this article.

The “Measure and Grow” principle is a powerful tool for improving change outcomes in a Scaled Agile environment. By leveraging data and fact-based decision-making, change management professionals can ensure that change initiatives are effective, aligned with strategic objectives, and continuously improving. Establishing robust metrics and assessment frameworks, such as KPIs, OKRs, change readiness and stakeholder engagement metrics, stakeholder competency assessments, change adoption metrics, change impact and capacity metrics, and change maturity assessments, is essential to applying the “Measure and Grow” principle effectively.

Incorporating these metrics and assessments into change management practices enables organizations to identify areas for improvement, make informed decisions, and drive continuous improvement. By doing so, change management professionals can enhance the effectiveness of change initiatives, ensure successful adoption, and ultimately achieve better business outcomes.

Rethinking change management analogy – why “the light at the end of the tunnel” falls short

Rethinking change management analogy – why “the light at the end of the tunnel” falls short

When navigating the complexities of organizational change, leaders often rely on analogies to communicate the journey and keep their teams motivated. One common analogy is the “light at the end of the tunnel,” which portrays the change process as a long, dark journey with an illuminating endpoint.  We explores why the “light at the end of the tunnel” analogy is inadequate, proposes a more accurate depiction, and provides practical tips for developing a clear vision and crafting a compelling narrative to guide your organization through change.

‘The light at the end of the tunnel’ is often used an analogy when describing the change journey.  The tunnel describes the change journey, often dark with potential obstacles along the way.  People may not know exactly what the end looks like and at times it may feel frustrating and challenging.  Eventually, approaching the end of the journey, people start to see the light at the end of the tunnel.  Excitement builds and people get more excited and relieved.  The end.  

The other key reason why people use this analogy is to stress how important to engage employees so that they are clear with what the end of the tunnel looks like.  Being clear with what the end state looks like is critical to sustain momentum and energy to want to keep going along the change journey.  The ability to ‘see’ the light at the end of the tunnel in your impacted stakeholders is a key indicator of eventual change success.  However, this analogy falls short in capturing the dynamic and multifaceted nature of modern organizational transformations.

In reality, the path to successful change is more like a tunnel with intermittent windows of light, reflecting the multiple initiatives and milestones that punctuate the journey. By adopting this more nuanced analogy, leaders can better communicate the realities of change, maintain momentum, and foster sustained engagement across the organization. 

The Shortcomings of the “Light at the End of the Tunnel” Analogy

Misleading Simplicity

The “light at the end of the tunnel” analogy suggests a linear, singular path with a single destination. It implies that the journey is uniformly dark and challenging until the very end, where a sudden and complete transformation occurs. This perspective can be misleading for several reasons:

  1. Oversimplification: Organizational change is rarely a single, straightforward journey. It involves multiple phases, each with its own challenges and victories. The analogy fails to account for the complexity and non-linear nature of most change processes.
  2. Unrealistic Expectations: By implying that the journey is mostly dark and only brightens at the end, this analogy can demoralize teams. It suggests that rewards and progress are only visible at the conclusion, which can lead to fatigue and disengagement.
  3. Neglect of Ongoing Progress: The analogy does not recognize the incremental achievements and intermittent successes that occur throughout the change process. These smaller victories are crucial for maintaining motivation and momentum.

Failing to Reflect Reality

In reality, organizational change involves multiple initiatives running concurrently, each with its own goals, challenges, and successes. These initiatives create a landscape that is far from uniformly dark; instead, it is punctuated with periods of light—moments of clarity, success, and learning.

When there are multiple initiatives the key then becomes to pain the overall picture of what the end of the tunnel looks like.  This is not just what the end state of one initiative looks like.  It is what the culmination of all the various changes look like.  It is about articulating super clearly what it means to have reached particular milestones within the various strategies undertaken (of which the various changes are aimed to support).

A More Accurate Analogy: A Tunnel with Intermittent Windows of Light

Embracing the Multifaceted Nature of Change

A more fitting analogy for the change journey is a tunnel with intermittent windows of light. This analogy acknowledges the complexity and multifaceted nature of change. Here’s why it’s more appropriate:

  1. Multiple Initiatives: Organizations often undertake several change initiatives simultaneously. Each initiative represents a different window of light, providing opportunities for progress and insight along the way.
  2. Intermittent Successes: This analogy highlights the importance of recognizing and celebrating interim successes. These windows of light can rejuvenate the team’s spirit and provide evidence that the change is working.
  3. Continuous Learning: Intermittent light symbolizes moments of learning and adaptation. As the organization progresses, these windows provide valuable feedback, allowing for adjustments and improvements.
  4. Sustained Motivation: By acknowledging periodic achievements, this analogy helps sustain motivation. Teams can look forward to these windows of light, making the journey less daunting and more engaging.

Developing a Clear Picture of the End State

Importance of a Clear Vision

A clear and compelling vision is essential for guiding the organization through change. It provides a sense of direction and purpose, helping teams understand the ultimate goal and their role in achieving it. Here are practical steps to develop and communicate a clear picture of the end state:

  1. Define the Vision: Articulate a clear, concise, and inspiring vision that encapsulates the desired end state. This vision should align with the organization’s values and strategic objectives.
  2. Involve Stakeholders: Engage key stakeholders in the vision development process. Their input and buy-in are critical for ensuring that the vision is relevant and achievable.
  3. Visualize the Future: Create visual representations of the end state, such as diagrams, infographics, or mock-ups. These tools can help make the vision more tangible and relatable.
  4. Break Down the Vision: Decompose the vision into specific, measurable objectives and milestones. This makes the vision more manageable and provides clear targets for the team to aim for.
  5. Communicate Consistently: Regularly communicate the vision and progress towards it. Use multiple channels and formats to ensure that the message reaches all parts of the organization.

Crafting the Story for Your Audience

Tailoring the Narrative

Crafting a compelling story that resonates with different audiences within the organization is crucial for maintaining engagement and momentum. Here’s how to tailor the narrative effectively:

  1. Understand Your Audience: Different groups within the organization will have different concerns, priorities, and levels of influence. Tailor the narrative to address the specific needs and interests of each audience segment.
  2. Highlight Relevance: Explain how the change will impact each audience group. Highlight the benefits and address potential concerns to demonstrate relevance and importance.
  3. Use Relatable Examples: Use examples and stories that resonate with each audience group. Relatable narratives can make the vision more accessible and credible.
  4. Showcase Interim Wins: Regularly share stories of interim successes and milestones. These stories can serve as proof points that the change is progressing and having a positive impact.
  5. Leverage Champions: Identify and empower change champions within each audience group. These individuals can help amplify the narrative and foster a sense of ownership and commitment.

The story can be, and should be, articulated at different levels of the organisation.  Senior leaders have a role to play to illustrate what business will look like and how the organisation will function differently.  Departmental managers also have a role to play to spell out how the work of the department will change accordingly.  Team leaders also need to play a part in deciphering what the changes will look like and how the work of the team will evolve in the future.  The managerial skills required in doing this and to help employee join dots is critical and cannot be neglected.

Keeping the Momentum

Maintaining momentum throughout the change process requires continuous effort and strategic communication. Here are some tips to keep the energy and enthusiasm alive:

  1. Celebrate Milestones: Acknowledge and celebrate interim successes and milestones. This not only boosts morale but also reinforces the perception of progress.
  2. Provide Regular Updates: Keep the organization informed about the progress, challenges, and next steps. Transparency builds trust and keeps the team aligned.
  3. Encourage Feedback: Create channels for feedback and actively seek input from the team. This fosters a sense of involvement and helps identify areas for improvement.
  4. Adapt and Iterate: Be prepared to adapt the approach based on feedback and changing circumstances. Flexibility is key to navigating the complexities of change.
  5. Recognize Effort: Regularly recognize and reward the efforts and contributions of individuals and teams. Appreciation and recognition can significantly enhance motivation and engagement.

The “light at the end of the tunnel” analogy, while common, fails to capture the true nature of organizational change. A more accurate depiction is a tunnel with intermittent windows of light, reflecting the multiple initiatives, interim successes, and continuous learning that characterize the change journey. By adopting this more nuanced analogy, leaders can better communicate the realities of change, maintain momentum, and foster sustained engagement across the organization.

To navigate the complexities of change effectively, it is crucial to develop a clear vision of the end state and craft a compelling narrative tailored to different audiences. Regularly celebrating milestones, providing updates, encouraging feedback, and recognizing effort are all essential strategies for maintaining motivation and ensuring the successful implementation of change initiatives. By embracing these practices, organizations can not only survive the journey through the tunnel but thrive and emerge stronger on the other side.

Unleashing the Power of Enterprise Change Management Reporting: A Guide to Creating Impactful Reports

Unleashing the Power of Enterprise Change Management Reporting: A Guide to Creating Impactful Reports

Enterprise change management reporting is changing. It no longer consists of general updates of change streams of project progress or updates on various change capability training session volumes and satisfaction rates. Executives are demanding more value from enterprise change functions. The pace of change since Covid has not slowed down. For many, it has increased in pace and volume. To gain better insight into how the change management function is supporting the success of organisations, reports and dashboards have often become a visible linchpin of what value an enterprise change management delivers.


Having the right content and format for your enterprise reports can make or break your reputation. Do it right and you could start a ripple of high-impact and strategic conversations across senior stakeholders that drive focus on improving change. You can be in the spotlight in influencing change leadership and the achievement of change and transformation goals. Do it wrong and you may never have another opportunity to have the room to talk about change management to senior leaders. You may be associated with not providing much value and too ‘operational’.

Unlocking the Potential of Enterprise Change Management Reporting:


At its core, enterprise change management reporting goes beyond merely tracking progress. It encompasses a holistic approach that considers various factors crucial to the success of organizational initiatives. While monitoring progress, readiness, and the amount of work done may be interesting components, true impact comes from focusing on impacts, adoption and predictors for benefit realization.

Executives and stakeholders are not just interested in receiving progress updates; they seek insights into the likelihood of initiative success and the potential risks that may impede desired outcomes. These risks extend beyond project timelines and budget constraints to encompass broader business implications such as performance impacts, capacity constraints, prioritization effectiveness, and the sustainability of behavioural change.

Impacts of change:


Quantifying and visualising impacts are not new to change practitioners. The key is how the data is presented over time. A lot of change practitioners would settle with a standard heatmap based on personal ratings. This does not deliver much value as the data cannot be easily substantiated by evidence (since it is more of a finger in the air estimation). Standard heatmaps also are too high level and does not really support key decision making.

Decision making requires specific data points such as:

  • Change saturation or change tolerance levels (these levels need to be substantiated based on business indicator reference to justify the levels, and not be someone’s personal opinion)
  • What division, team, role and which week the saturation points are forecasted
  • Corresponding data on what initiatives, and their respective impact activities that contribute to the saturation risk, and therefore proposed options

A key part of representing change impacts should not just be at an operational level, which is more concerned about capacity and bandwidth. Impact should also be tied to strategic levers, portfolio types, benefit types and readiness.

Predictive Indicators for Success:


To create impactful change management reports, organizations must incorporate predictive indicators that go beyond change volume and risk assessment. These indicators should provide insights into business performance, strategy achievement, and the realization of intended benefits.


These are some of the ways you can incorporate predictive indicators:

  • Forecast lines. With sufficient data you can forecast such as impact or capacity levels (which may be seasonal), or even readiness levels across the initiative lifecycle historically across initiatives.
  • The types of factors that can be included as predictive indicators can include readiness. It could be that readiness levels only get lifted just before go live or at go live. Adoption levels can also be forecasted if you have trend data across initiatives
  • Change tolerance levels across different parts of the business can also be seen as a predictive way of forecasting how much capacity there is for change beyond which saturation may be a key risk

Adoption and Behaviour Tracking:


Central to successful change management is the adoption and sustained implementation of new processes or technologies. Tracking adoption rates, user engagement, and behavioural changes are crucial indicators of initiative success. However, it’s essential to strike a balance between capturing relevant metrics and overwhelming stakeholders with unnecessary data.


Capturing behaviour change data can be key for larger initiatives or transformations. Behavioural change can be central in a range of changes such as customer centricity, efficiency, team collaboration or effectiveness. Measuring key behaviour changes that drive the initiative outcome the most is critical. For example, having effective conversations with customers to improve customer experience is a behaviour that can be rated, tracked and reported. Depending on the change, there may also be system features that can aid the tracking of these behaviours.


To read more about driving behaviour change check out The Ultimate Guide to Behaviour Change.


Business Performance and Strategy Alignment:

Effective change management goes hand in hand with strategic alignment. Reports should assess how initiatives contribute to overarching business objectives and whether they align with the organization’s strategic direction. Metrics related to revenue growth, cost savings, customer satisfaction, and employee productivity can provide valuable insights into the impact of change initiatives on business performance.


You can also link your change impacts to each strategic lever. In this way you can visually show the size of the impact per strategic lever. This will give your executives a way to examine whether the right level of impacts in the right areas of business are planned as a part of the course of each strategic lever.


The other angle is to visually show the pace of change against the strategic levers. Are certain key initiatives being driven at the right pace at the right time? Will the velocity of change exceed the ability of the business to absorb the changes? Or is the velocity not sufficiently meeting leadership expectations?

Benefit Realization:

Ultimately, the success of change initiatives is measured by their ability to deliver tangible benefits. Change management reports should include metrics that track the realization of expected benefits, whether they are financial gains, process efficiencies, or competitive advantages. By monitoring benefit realization, organizations can course-correct as needed and ensure that investments in change deliver the intended outcomes.


A key responsibility for change is to focus on those foreward looking measures that predict eventual benefit realisation, including readiness, adoption, engagement and behaviour change. Be sure to link these specifically to high benefit initiatives to provide strategic oversight.

Balancing Complexity and Clarity:

While incorporating a diverse range of metrics is essential for comprehensive reporting, it’s equally important to maintain clarity and focus. Reports should be structured in a way that highlights key insights and trends without overwhelming stakeholders with excessive detail. Visualizations such as charts, graphs, and dashboards can help distill complex data into actionable insights, facilitating informed decision-making at all levels of the organization.


All aspects of chart and dashboard designs are critical. These range from colour scheme chosen, number of charts, commentary, titles, legends, sequencing of charts, and type of charts chosen all act to either contribute to simplicity and clarity or complexity and confusion. Your narrative as you talk through the charts also plays a key role in building the story-line, and simplifying the key messages and actions you would like to impart to the audience.

Charts and dashboards tell a story and in presenting them you should always incorporate any actions required from the audience. If this is not done then it will always remain a FYI. FYI content will be deemed lower in the value curve over time and your stakeholders will lose interest. Instead, you should work on crafting a continual story that ebbs and flows. The following are key questions you should be asking when crafting you ongoing charts and dashboards:

  • Is there an emerging risk or opportunity that warrants specific focus for this month?
  • How are we tracking the effectiveness of stakeholder actions through data? This feedback loop is critical and gives your stakeholders a reference point for their own effectiveness
  • Is your data-based story uni-dimensional? Are there other dimensions beyond what you have been presenting that stakeholder should be aware of?
  • Are you giving stakeholders what they are most interested in? Whether it be strategic success progress, or benefit realisation?
  • Are you presenting change data in a holistic way in terms of how the business is run? Vs. just focused on standard change management function-specific metrics such as training sessions, or number of workshops completed?

Enterprise change management dashboard


Enterprise change management reporting is a critical tool for navigating the complexities of organizational change. By focusing on predictive indicators, including adoption and behavior tracking, business performance alignment, and benefit realization, organizations can unlock the full potential of their change management initiatives. However, achieving impactful reporting requires a careful balance between complexity and clarity, ensuring that stakeholders receive actionable insights without being inundated with unnecessary information. Ultimately, by harnessing the power of enterprise change management reporting, organizations can drive successful outcomes and thrive in an ever-evolving business landscape.

To find out more about enterprise change management reporting leveraging digital automation and analytics chat to us here.

To read up more about change analytics and reporting check out our other articles.

Data driven revolution: The Crucial Role of Strategic Change Data Management

Data driven revolution: The Crucial Role of Strategic Change Data Management

There is now a lot of attention and focus on data. However, is the same applied to change management data? With the substantial financial investments companies make in change efforts, there’s a growing recognition of the need to leverage change management data strategically. Senior managers and executives are increasingly demanding data-driven insights to make informed business decisions. Here, we explore the challenges associated with change data, the strategic approaches to managing it effectively, and how incorporating it into the decision-making process can drive organizational success.

Common Challenges in Working with Change Data

  1. Ad hoc and Tactical Approaches
    One common challenge in working with change data is the ad hoc and tactical nature of its collection. Often, data is gathered as needed, primarily at the project level. This can result in a fragmented view of change initiatives, making it challenging to derive meaningful insights. For instance, progress data may be limited to generic metrics such as the number of change impact sessions or completed training sessions, lacking depth and context.
  2. Data Insufficiently Fact-Based
    Another prevalent issue is the creation of data that lacks a solid factual foundation. Change practitioners sometimes rely on gut-feel ratings or broad categories that are difficult to defend or substantiate infront of stakeholders. Heatmaps, a popular visualization tool, may be based on subjective assessments rather than objective, quantifiable measures, hindering the data’s credibility and utility.
  3. Ineffective Data Visualizations
    Data visualizations play a crucial role in conveying information effectively. Unfortunately, some visualizations fall short of making a significant impact. Whether they are overly colorful, fail to use the right chart to highlight key points, or present data in a way that obscures the primary message, ineffective visualizations can impede the decision-making processes.
  4. Seeking Easy Fixes
    Many change practitioners view working with data as a chore and opt for quick fixes. They may collect just enough data to generate a report or dashboard, neglecting the importance of a thorough understanding and management of the data. This short-sighted approach can compromise the quality and reliability of the insights derived from the data.

Strategic Approaches in Working with Change Data

Strategic approaches to manage change data can result in significant value for the organisation. Imagine the power of a range of change management data that highlights anything from impact levels, saturation risks, sentiments, adoption risks and benefit realization progress. Such is the power of change data, if managed effectively. What are some of these strategic approaches?

  1. Managing Data as a Core Routine
    To address the challenges associated with ad hoc and tactical data collection, organizations must establish routines for managing change data. Monthly data reviews, updates, and audits create a disciplined approach to ensure the data remains accurate, relevant, and valuable. By making data management a core routine, organizations foster a culture of accountability and accuracy. This can be applied across a large program, a business unit, a portfolio of initiatives or across the enterprise.
  2. Leveraging AI for Data Auditing and Cleansing
    Artificial Intelligence (AI) can play a pivotal role in auditing and cleansing change data. Platforms like The Change Compass offer features that automate these processes, reducing the likelihood of errors and ensuring data integrity. AI-driven tools can identify inconsistencies, outliers, and inaccuracies, providing a more reliable foundation for decision-making.
  3. Linking Change Data with Other Business Sources
    The true power of change data emerges when it is connected with other relevant business data sources. By integrating change management data with project data, HR data, risk data, and operations data, organizations gain a holistic view of their business landscape. This interconnected approach allows for a comprehensive understanding of key business risks and opportunities, facilitating more informed decision-making.
  4. Incorporating Data into Decision-Making Bodies
    Change data should not exist in isolation; it should be integrated into key decision-making forums and processes. From executive leadership forums and strategic planning sessions to portfolio planning and operational meetings, incorporating change data into these discussions ensures that insights derived from the data inform critical business decisions. This alignment helps organizations proactively address challenges and capitalize on opportunities.

While recognizing the strategic importance of change data is a significant step forward, change practitioners must actively implement practical measures to enhance their approach to change data management. Here are some recommendations to help change practitioners become more strategic in their utilization of change data:

  1. Standardize/Routinize Data Collection Processes:
    o Develop standardized processes for collecting change data across different projects and initiatives.
    o Implement consistent data collection templates and methodologies to ensure uniformity and comparability of data across initiatives and business units
  2. Invest in Training and Skill Development:
    o Provide training for change practitioners on data management best practices, including data collection, analysis, audit and interpretation. This is critical to drive data capability and maturity.
    o Foster a data-driven culture within the organization by equipping practitioners with the necessary skills to leverage data effectively.
  3. Utilize Technology and Automation:
    o Embrace technological solutions, such as data analytics tools and AI-driven platforms, to automate data auditing, cleansing, and visualization processes.
    o Leverage technology to streamline data collection and reporting, reducing manual effort and minimizing the risk of errors.
  4. Encourage Cross-Functional Collaboration:
    o Facilitate collaboration between change management teams and other departments, encouraging the sharing of data and insights.
    o Establish cross-functional teams to integrate change data with project data, HR data, and other relevant business sources.
  5. Implement Data Governance Frameworks:
    o Develop and implement robust data governance frameworks to ensure the accuracy, security, and compliance of change data.
    o Define roles and responsibilities for data management within change initiatives, promoting accountability and ownership.
  6. Enhance Data Visualization and Reporting:
    o Invest in training or hiring professionals with expertise in data visualization to create compelling and impactful reports.
    o Tailor visualizations to the audience, ensuring that key messages are communicated clearly and effectively.
  7. Conduct Regular Data Reviews and Audits:
    o Establish a routine for regular data reviews, updates, and audits to maintain the accuracy and relevance of change data.
    o Use audits as an opportunity to identify and rectify data discrepancies or inconsistencies.
  8. Integrate Change Data into Decision-Making Processes:
    o Actively participate in executive leadership forums, strategic planning sessions, and other decision-making bodies.
    o Present change data alongside other relevant business data to contribute to well-informed decision-making.
  9. Measure and Communicate Value:
    o Develop metrics to measure the value generated by change initiatives and communicate these metrics to key stakeholders.
    o Regularly assess the impact of change data on decision-making processes and adjust strategies accordingly.
  10. Seek Continuous Improvement:
    o Foster a culture of continuous improvement within the change management function.
    o Encourage practitioners to reflect on past experiences, learn from challenges, and refine their approach to change data management over time.

The strategic management of change data is not just a necessity but a critical component of achieving business success in today’s dynamic environment. By addressing common challenges and adopting strategic approaches, organizations can unlock the true potential of change data. As the business landscape continues to evolve, leveraging data-driven insights becomes a strategic imperative for navigating change, mitigating risks, and capitalizing on opportunities. Embracing change data as a strategic exercise positions organizations to not only survive but thrive in an ever-changing marketplace.

The Ultimate Guide To Change Management Reports Your Executives Want to See

The Ultimate Guide To Change Management Reports Your Executives Want to See

Why Nailing the Right Change Management Metrics is Critical and Can Make or Break Your Reputation

As organizations strive to adapt and thrive in dynamic environments, how change management is tracked has become a strategic imperative. However, the success of any change initiative hinges not only on effective planning and execution but also on the ability to measure and communicate its impact accurately.  After all, without the right measures how do we know that we are moving in the right direction? In this article, we explore critical change management reports that executives value in shaping organizational understanding and decision-making. We delve into the metrics that may compromise your credibility and, more importantly, highlight the metrics that executives truly value, providing a roadmap to creating reports that resonate with leadership.

Reading your executives and where they are

Prior to designing the right change management reports and metrics it is absolutely essential that you understand where they are coming from.  Understanding their key concerns and perspectives will help you design the right content to engage them.  Key questions you may want to delve into include:

  1. What issues are top of mind for executives when it comes to managing change?
  2. What has worked or not worked well in the past for change that should be taken into account?
  3. How experienced are these executives in driving complex change?
  4. Putting your strategic hat on, what are the key business performance challenges that executives are facing into? What are the people and change connections to these?
  5. What are the top key organisational risks that executives are focused on?  What are the people and change connections to these?

Metrics That May Downgrade Your Credibility

  1. Vanity Metrics – Metrics That Don’t Connect to Business Outcomes

One of the pitfalls in change management reporting is the reliance on vanity metrics—superficial measures that may look impressive but lack a direct connection to tangible business outcomes. Metrics such as the number of training hours delivered, numbers of stakeholder groups who received communications or the volume of communication materials distributed might seem impressive and easy to measure, but they provide little insight into the real impact of the change on the organization.

Executives are not interested in surface-level data; they want to understand how the change contributes to the achievement of strategic objectives and positively influences key performance indicators. To enhance credibility, change management reports must move beyond vanity metrics and focus on indicators that align with broader business goals.

  1. Activity Metrics – Counting Without Context

Measuring the sheer volume of activities related to a change initiative can be misleading, or worse, meaningless, if not accompanied by context and relevance. Activity metrics, such as the number of workshops conducted, numbers of impact assessment activities conducted, number of deliverables worked on, or emails sent, might create an illusion of progress. However, these metrics fail to provide insights into the quality of engagement, the depth of understanding among employees, or the actual impact on work behaviours.  Operational managers may find these interesting, but less likely for executives.

Instead of focusing solely on activities, change management reports should emphasize the effectiveness of these activities in driving desired outcomes. Metrics should, instead, highlight the quality of engagement, the level of understanding, and the behavioural shifts observed within the organization.

  1. Cost-Focused Metrics – Counting Dollars Without Value

While cost-related metrics are important for financial stewardship, solely focusing on cost without considering the value generated by the change can undermine the perceived success of the initiative. Metrics such as the budget spent or the cost per participant may provide financial insights but do not necessarily convey the broader impact on organizational performance.

To read more about how cost-focused metrics may be less valuable, check out our article Why using change management ROI calculations severely limits its value.

Change management reports should focus more on value metrics than cost metrics.  Focusing purely on cost is restricting the value of managing change as another cost to the business.  However, focusing on the value created in maximising business performance and achieving greater adoption can significant extend the understanding of change management value. Executives are interested in understanding what business value is created through managing change.  Value includes how the targeted benefits are better realised and how the business performance is protected or maximised during the implementation of change.

  1. Intra-Practice Metrics – Metrics That Only Change Management Cares About

It’s a common misstep to develop metrics that only resonate within the change management function but fail to capture the attention of other business units or executives. Metrics that focus exclusively on communication buzz generated, training satisfaction rates, or employee satisfaction with change processes might be valuable for internal assessments but lack the relevance needed to engage executives.

Even the focus on change maturity, that is often the single most critical focus for change management functions, may or may not appeal to a lot of executives.  Unless you have already taken the executives on the journey of why focusing on change maturity is critical and you have them fully onboard with this, treat carefully in reporting on change maturity metrics.

At executive level, change management reports should transcend departmental boundaries and speak to the broader organizational impact.  This means that your focus should be on reporting at a portfolio level and key strategic initiatives as relevant.  Focus on generating insights of what the totality of changes mean to the organisation, and what employee experiences are across multiple initiatives.  Metrics should also align with strategic goals and showcase how the change initiatives contributes to overarching business objectives.

The Right Metrics

I. Change Readiness Metrics – Assessing the Pulse of the Organization

Change readiness metrics serve as a barometer for understanding how prepared an organization is for a change initiative. To provide meaningful insights, these metrics should delve into the engagement journey, capturing key elements such as awareness, involvement, and participation.

  • Engagement Journey: Awareness, Involvement, Participation
    • Awareness: Measure the level of understanding and awareness of the upcoming change across different employee segments.
    • Involvement: Assess the degree to which employees are actively engaged in the change process, seeking their input and involvement.
    • Participation: Evaluate the extent to which employees are actively participating in change-related activities and initiatives.
  • Data Collection Methodology
    • Utilize a mix of quantitative and qualitative methods to gather data, including surveys, focus groups, and feedback mechanisms.
    • Ensure a representative sample across different organizational levels and functions to capture a comprehensive view of readiness.
  • Change Readiness Topic Areas

1. Awareness Assessment:

This section evaluates the extent to which employees are aware of the impending changes across initiatives. It includes an analysis of communication effectiveness, the clarity of messaging, and the overall visibility of the change initiatives. Metrics may encompass the percentage of employees who understand the change purpose and the reach of communication channels.

2. Involvement Evaluation:

Involvement is a key factor in gauging how actively employees are participating in the change process. This explores the degree to which employees feel engaged and have opportunities to contribute to the planning and decision-making aspects of the change.  Employees may not have the opportunities to contribute to all types of change initiatives but for those that are relevant this can be quite insightful.  Metrics include participation rates in change-related workshops, the number of submitted suggestions, and levels of engagement in feedback sessions.

3. Perceived Impact:

This area delves into employees’ perceptions of how the changes will affect them personally and professionally. It includes an analysis of perceived benefits, risks, and the overall impact on day-to-day responsibilities. Metrics may encompass the percentage of employees who feel well-informed about the impact of the change and qualitative insights from open-ended survey questions.

4. Change Champions performance:

Identifying and nurturing change champions can be crucial for successful change implementation, especially across the change portfolio. The presence of key business change champions who actively support and advocate for the changes within their teams and business units can shed light on how the change is performing. Metrics include the presence of key change champions across business areas, their engagement levels, and the effectiveness of their engagement strategies within their respective departments.

5. Learning and Development Readiness:

Learning and development play a vital role in equipping employees with the skills necessary for the upcoming changes. This section evaluates the organization’s readiness to deliver learning programs effectively, including the availability of resources, the alignment of learning content with change objectives, and the accessibility of learning materials.  This can be outlined not just at initiative levels, but from business unit perspectives. Different business units may have different processes and channels from which to deploy learning and development across initiatives.  The readiness and maturity of these can make or break the adoption of changes.

6. Resource Allocation and Availability:

Change initiatives often require additional resources, and this section examines the organization’s capacity to allocate and provide the necessary resources for a smooth transition. Metrics include the allocation and availability of SME resources, business representatives, the availability of technology and tools, and the overall preparedness of support functions for the myriad of change initiatives.  Is there adequate allocation of these resources?  For example, for digital transformation is there still reliance on manual work processes that should be upgrade to drive efficiency and effectiveness?

7. Leadership Alignment:

Leadership alignment is a critical factor influencing change readiness. This section evaluates the extent to which various leaders are aligned with the change vision and actively communicate their support. Metrics encompass leadership messaging consistency, visibility, and the perceived commitment of leaders to the success of the change.

8. Employee Feedback Mechanisms:

Establishing effective feedback mechanisms is essential for continuous improvement during change initiatives. This section assesses the availability, content and effectiveness of channels through which employees can provide feedback, ask questions, and express concerns. Metrics include response rates to feedback requests, the variety of feedback channels used, and themes of responses from targeted employee groups.

Change Readiness Data Collection Methods

Collecting data on change readiness is a crucial step in understanding an organization’s preparedness for a change initiative. Various approaches can be employed to gather relevant information. Here’s a list of key approaches:

  1. Surveys and Questionnaires
  2. Focus Groups
  3. Interviews
  4. Observation
  5. Benchmarking
  6. Document Analysis
  7. Readiness Workshops
  8. Network Analysis
  9. Online Platforms and Social Listening
  10. Pulse Surveys
  11. Interactive Assessments

II. Change Journey Analytics – Navigating the Transformation Landscape

Change journey analytics provide a view of what key employee change experience highlights are, including insights on any behavioural changes, attitudinal changes, the volume of changes and how changes are being driven against key business performance challenges.

  • Change Volume Risks
    • Change volume risk measures highlight key change impact volumes across the business over time, with key call outs on any risks on heightened change periods.  The volume and nature of changes can be mapped against strategies to indicate to what extent the level and pace of impacts are aligned with strategic plans 
  • Change Activity Design
    • The totality of change management activities across initiatives from the lens of impacted employee groups should be analysed with potential risks highlighted including the alignment of learning content, communication message consistency and alignment, and to what extent there maybe excessive or below expected types of change activities in facilitating the change journeys
  • Single View of Change of BAU and Strategic Initiatives
    • Provide a consolidated view of ongoing business-as-usual (BAU) changes alongside strategic initiatives. This ensures that executives have a comprehensive understanding of the organizational change landscape.  From the perspective of the impacted change stakeholders or employee groups, they may not care about the source of the change and whether it is strategic or not.  BAU initiatives may also be even more impactful than strategic initiatives.
  • Business Performance
    • Link change activities to business performance metrics. Demonstrate how the change initiative contributes to key performance indicators and strategic goals.  Also shed light how the nature and volume of changes may or may not impact the overall business performance.  Executives are focused on keeping the business running successfully during change implementation as much as possible, with minimum disruption

Nurturing Lasting Transformation: The Role of Adoption Analytics in Sustainable Change

Adoption Analytics Unveiled: Beyond Implementation

When we discuss adoption analytics, we transcend the traditional boundaries of project management. While implementation marks the beginning of change, adoption analytics guide us through the more profound stages, measuring the extent to which the organization has embraced and embedded the change. It’s about ensuring that the seeds of change and transformation take root, flourish, and yield sustainable benefits.

1. Business Performance Metrics: Gauging Impact on Organizational Vital Signs

To truly understand the success of change initiatives, one must look beyond the surface and delve into its impact on key business performance metrics. This involves a holistic examination of factors such as productivity, efficiency, and customer satisfaction (depending on what the changes are).

  • Productivity: Assessing the changes’ effects on productivity involves measuring the organization’s output and efficiency post-implementation. Has there been an increase in task completion rates, a reduction in errors, or an enhancement in overall workflow efficiency?
  • Efficiency: Changes often aim to streamline processes and enhance efficiency. Analyzing the efficiency metrics helps determine whether the new procedures or tools have resulted in a smoother and more effective workflow.
  • Customer Satisfaction: In many cases, change initiatives are driven by a desire to improve customer experience. Adoption analytics in this context involve gauging customer satisfaction levels, whether through surveys, feedback mechanisms, or other relevant indicators.

By examining these metrics, organizations can gauge the real impact of the change on their vital signs, ensuring that the intended improvements manifest in tangible and measurable ways.

2. Benefit Realization: From Anticipation to Tangible Outcomes

Anticipated benefits form the backbone of any change initiative, but true success lies in the tangible realization of these expected outcomes. Benefit realization assessment through adoption analytics involves tracking key performance indicators (KPIs) directly influenced by the change.

  • Tracking KPIs: Identify and monitor KPIs that are closely tied to the specific objectives of the change. These could include financial metrics, customer retention rates, employee engagement scores, or any other relevant indicators.
  • Tangible Outcomes: Work hand-in-hand with initiative benefit owners to ensure clear ownership and tracking of benefits. Establish a system that allows for the ongoing assessment of whether the anticipated benefits are being realized in practice.
  • Continuous Improvement: Benefit realization is an ongoing process. Regularly review and adjust strategies based on the data collected. This iterative approach ensures that the organization remains agile, adapting to changing circumstances and continuously optimizing the impact of the change.

Collaboration with Initiative Benefit Owners: A Crucial Element

A vital aspect of successful adoption analytics is collaboration with initiative benefit owners. These are individuals or teams responsible for overseeing the realization of anticipated benefits. Establishing clear ownership ensures accountability and facilitates a more targeted and effective approach to tracking and optimizing outcomes.

  • Clear Communication: Foster open lines of communication between change management teams and initiative benefit owners. Clearly communicate the expected benefits and collaborate on defining relevant metrics and tracking mechanisms.
  • Regular Check-Ins: Establish a framework for regular check-ins to assess progress, identify challenges, and strategize for ongoing success. These check-ins provide an opportunity to recalibrate efforts based on real-time insights.
  • Data-Driven Decision Making: Encourage initiative benefit owners to make data-driven decisions. Regularly review adoption analytics data together, and use these insights to inform strategic adjustments, ensuring that the organization is on a trajectory towards sustained success.

Adoption analytics are the linchpin in the journey from change initiation to sustainable integration. By meticulously measuring the impact on business performance and diligently tracking benefit realization, organizations can ensure that their transformative efforts result in lasting and meaningful change. Collaboration with initiative benefit owners enhances this process, fostering a culture of continuous improvement and adaptability that is crucial for navigating the ever-evolving landscape of organizational transformation.

Change practitioners may not be involved in all aspects of benefit realization and tracking. It could be that the focus is on ‘people’ and behaviour elements of changes that contribute to benefit realization. Incorporating these metrics into change management reports offers a comprehensive view of the change journey, from initial readiness to long-term adoption and benefits realization.

Crafting Compelling Change Management Reports

In the fast-paced world of change management, the ability to convey the impact of initiatives through well-crafted reports is a skill that cannot be underestimated. Executives require more than superficial metrics; they demand a nuanced understanding of how change aligns with strategic goals and influences organizational performance.

By steering clear of vanity metrics, activity-focused measurements, and overly cost-centric reporting, change management professionals can elevate their credibility and influence within the organization. Instead, a focus on change readiness, journey analytics, and adoption metrics provides a holistic perspective that resonates with executives, ensuring that the true value of change initiatives is accurately portrayed.

To gear up for the digital/AI-enabled world that we are already in, change practitioners should also be ready to adopt a range of digital tools to better present and converse about change management reports in a way that is interactive, and easy to generate data insights.  Executives may ask a series of questions to probe deeper into the data, or want access themselves to be able to look into certain data points.  The ability to answer these questions straight away using digital solutions will be the key to creating confidence, impact and trust with executives.  

As organizations continue to navigate the complexities of change, the importance of insightful reporting cannot be overstated. It is not just about delivering change; it is about articulating its impact in a language that executives understand and appreciate. In doing so, change management professionals become not just implementers of change but strategic partners in driving organizational success.  This is ultimately the goal for change teams and change practices.

To read more about change management metrics check out The Ultimate Guide to Measuring Change.