Elevate Data Change Management with Data Science Tips

Elevate Data Change Management with Data Science Tips

Organisational change management professionals are increasingly requested to provide measurement, data, and insights to various stakeholder groups.  Not only does this include tracking various change management outcomes such as business readiness or adoption, but stakeholder concerns also include such as change saturation and visibility of incoming initiative impacts.  

To become better at working with data there is much that change managers can learn best practices from data scientists (without becoming one of course).  Let’s explore how change management can benefit from the practices and methodologies employed by data scientists, focusing on time allocation, digital tools, system building, hypothesis-led approaches, and the growing need for data and analytical capabilities.

Data scientists spend a substantial portion of their time on data collection and cleansing from data sources. According to industry estimates, about 60-80% of a data scientist’s time is dedicated to these tasks. This meticulous process ensures that the data used for analysis is accurate, complete, and reliable.

In the below diagram from researchgate.net you can see that for data scientists the vast majority of the time is spent on collecting, cleansing and organising data.  

You might say that change managers are not data scientists because the work nature is different, and therefore should not need to carve out time for these activities? Well, it turns out that the type of activities and proportions of time spent is similar across a range of data professionals, including business analysts.

Below is the survey results published by Business Broadway, showing that even business analysts and data analysts spend significant time in data collection, cleansing, and preparation.

Lessons for Change Management

a. Emphasize Data Collection and Cleansing: For change managers, this translates to prioritizing the collection of reliable data related to change initiatives as a part of a structured approach. This might include stakeholder feedback, performance metrics, impact data and other relevant data points. Clean data is essential for accurate analysis and insightful decision-making.  Data projects undertaken by change managers are not going to be as large or as complex as data scientists, however the key takeaway is that this part of the work is critical and sufficient time should be allocated and not skipped.

What is data change management and why is it important?

Data change management involves overseeing and controlling changes in data systems to ensure accuracy and consistency. It’s crucial for minimizing errors, maintaining data integrity, and enhancing decision-making processes. Effective management safeguards against potential risks associated with data alterations, ensuring organizations can adapt to shifts in information seamlessly.

b. Allocate Time Wisely: Just as data scientists allocate significant time to data preparation, change managers should also dedicate sufficient time to gathering and cleaning data before diving into analysis. This ensures that the insights derived are based on accurate and reliable information.

It also depends on the data topic and your audience.  If you are presenting comparative data, for example, change volume across different business units.  You may be able to do spot checks on the data and not verify every data line.  However, if you are presenting to operations business units like call centres where they are very sensitive to time and capacity challenges, you may need to go quite granular in terms of exactly what the time impost is across initiatives.

c. Training and Awareness: Ensuring that the change management team understands the importance of data quality and is trained in basic data cleansing techniques can go a long way in improving the overall effectiveness of change initiatives in the desired future state.  Think of scheduling regular data sessions/workshops to review and present data observations and findings to enhance the team’s ability to capture accurate data as well as the ability to interpret and apply insights.  The more capable the team is in understanding data, the more value they can add to their stakeholders leveraging data insights.

2. Leveraging Digital Tools: Enhancing Efficiency and Accuracy

Data scientists rely on a variety of digital tools to streamline their work. These tools assist in data collection, auditing, visualization, and insight generation. AI and machine learning technologies are increasingly being used to automate and enhance these processes.

Data scientists rely on various programming, machine learning and data visualisation such as SQL, Python, Jupyter, R as well as various charting tools. 

a. Adopt Digital Tools: Change managers should leverage digital tools to support each phase of their data work. There are plenty of digital tools out there for various tasks such as surveys, data analysis and reporting tools.

For example, Change Compass has built-in data analysis, data interpretation, data audit, AI and other tools to help streamline and reduce manual efforts across various data work steps.  However, once again even with automation and AI the work of data checking and cleansing does not go away.  It becomes even more important.

b. Utilize AI and Machine Learning: AI can play a crucial role in automating repetitive tasks, identifying patterns, data outliers, and generating insights. For example, AI-driven analytics tools can help predict potential change saturation, level of employee adoption or identify areas needing additional support during various phases of change initiatives.

With Change Compass for example, AI may be leverage to summarise data, call out key risks, generate data, and forecast future trends.

c. Continuous Learning: Continuous learning is essential for ensuring that change management teams stay adept at handling data and generating valuable insights. With greater stakeholder expectations and demands, regular training sessions on the latest data management practices and techniques can be helpful. These sessions can cover a wide range of topics, including data collection methodologies, data cleansing techniques, data visualisation techniques and the use of AI and machine learning for predictive analytics. By fostering a culture of continuous learning, organizations can ensure that their change management teams remain proficient in leveraging data for driving effective change. 

In addition to formal training, creating opportunities for hands-on experience with real-world data can significantly enhance the learning process. For instance, change teams can work on pilot projects where they apply new data analysis techniques to solve specific challenges within the organization. Regular knowledge-sharing sessions, where team members present case studies and share insights from their experiences, can also promote collective learning and continuous improvement. 

Furthermore, fostering collaboration between change managers and data scientists or data analysts can provide invaluable mentorship and cross-functional learning opportunities. By investing in continuous learning and development, organizations can build a change management function that is not only skilled in data management but also adept at generating actionable insights that drive successful change initiatives.

3. Building the Right System: Ensuring Sustainable Insight Generation

It is not just about individuals or teams working on data. A robust system is vital for ongoing insight generation. This involves creating processes for data collection, auditing, cleansing, and establishing data governance and governance bodies to manage and report on data.

Governance structures play a vital role in managing and reporting data. Establishing governance bodies ensures that there is accountability and oversight in data management practices. These bodies can develop and enforce data policies, and oversee data quality initiatives. They can also be responsible for supporting the management of a central data repository where all relevant data is stored and managed.  

a. Establish Clear Processes: Develop and document processes for collecting and managing data related to change initiatives and document any new processes. This ensures consistency and reliability in data handling. There should also be effective communication of these processes using designated communication channels to ensure smooth transition and adherence.

b. Implement Governance Structures: Set up governance bodies to oversee data governance practices as a part of data governance efforts. This includes ensuring compliance with data privacy regulations and maintaining data integrity.  The governance can sponsor the investment and usage of the change data platform.  This repository should be accessible to stakeholders involved in the change management process, promoting transparency and collaboration.  Note that a governance group can simply be a leadership team regular team meeting and does not need to be necessarily creating a special committee. Data governance group members (potentially representative business owners) foster a sense of ownership and can be empowered to resolve potential issues with data and usage. Key performance indicators and key change indicators may be setup as goals.

c. Invest in system Infrastructure: Build the necessary system infrastructure to support data management and analysis that is easy to use and provides the features to support insight generation and application for the change team. 

4. Hypothesis-Led Approaches: Moving Beyond Descriptive Analytics

Data scientists and data teams often use a hypothesis-led approach, where they test, reject, or confirm hypotheses using data. This method goes beyond simply reporting what the data shows to understanding the underlying causes and implications.

a. Define Hypotheses: Before analyzing data, clearly define the hypotheses you want to test. For instance, if there is a hypothesis that there is a risk of too much change in Department A, specify the data needed to test this hypothesis.

b. Use Data to Confirm or Reject Hypotheses: Collect and analyze data to confirm or reject your hypotheses. This approach helps in making informed decisions rather than relying on assumptions or certain stakeholder opinions.

c. Focus on Actionable Insights: Hypothesis-led analysis often leads to more actionable insights. It is also easier to use this approach to dispel any myths of false perceptions.

For example: Resolving Lack of Adoption

Hypothesis: The lack of adoption of a new software tool in the organization is due to insufficient coaching and support for employees.

Data Collection:

  1. Gather data on the presence of managerial coaching and perceived quality.  Also gather data on post go live user support.
  2. Collect feedback from employees through surveys regarding the adequacy and clarity of coaching and support.
  3. Analyse usage data of the new software to identify adoption rates across different departments.

Analysis:

  1. Compare adoption rates between employees who received sufficient coaching and support versus those who did not.
  2. Correlate feedback scores on training effectiveness with usage data to see if those who found the training useful are more likely to adopt the tool.
  3. Segment data by department to identify if certain teams have lower adoption rates and investigate their specific training experiences.

Actionable Insights:

  1. If data shows a positive correlation between coaching and support, and software adoption, this supports the hypothesis that enhancing coaching and support programs can improve adoption rates.
  2. If certain departments show lower adoption despite completing coaching sessions, investigate further into department-specific issues such as workload or differing processes that may affect adoption.
  3. Implement targeted interventions such as additional training sessions, one-on-one support, or improved training materials for departments with low adoption rates.

5. Building Data and Analytical Capabilities: A Core Need for Change Management

As data and analytical capabilities become increasingly crucial, change management functions must build the necessary people and process capabilities to leverage data-based insights effectively.

a. Invest in Training: Equip change management teams with the skills needed to manage data and generate insights. This includes training in data analysis, visualization, and interpretation.

b. Foster a Data-Driven Culture: A lot of organisations are already on the bandwagon to encourage a culture where data is valued and used for decision-making from current state to future state.  The change process needs to promote this equally within the change management function. This involves promoting the use of data in everyday tasks and ensuring that all team members understand its importance.  Think of incorporating data-led discussions into routine meeting meetings.

c. Develop Analytical Frameworks: Create frameworks and methodologies for analyzing change management data. This includes defining common key metrics, setting benchmarks, and establishing protocols for data collection and analysis for change data.  Data and visual templates may be easier to follow for those with lower capabilities in data analytics.

Practical Steps to Implement Data-Driven Change Management

To integrate these lessons effectively, senior change practitioners can follow these practical steps:

  1. Develop a Data Strategy: Create a comprehensive data strategy that outlines the processes, tools, and governance structures needed to manage change management data effectively.
  2. Conduct a Data Audit: Begin by auditing the existing data related to change management. Identify gaps and areas for improvement.
  3. Adopt a Hypothesis-Led Approach: Encourage the use of hypothesis-led approaches to move beyond descriptive analytics and derive more meaningful insights.
  4. Invest in Technology: Invest in the necessary digital tools and technologies to support data collection, cleansing, visualization, and analysis.
  5. Train the Team: Provide training and development opportunities for the change management team to build their data and analytical capabilities.
  6. Collaborate Across Functions: Foster collaboration between change management and data science teams to leverage their expertise and insights.
  7. Implement Governance Structures: Establish governance bodies to oversee data management practices and ensure compliance with regulations and standards.

By learning from the practices and methodologies of data scientists, change management functions can significantly enhance their effectiveness. Prioritizing data collection and cleansing, leveraging digital tools, building robust systems, adopting hypothesis-led approaches, and developing data and analytical capabilities are key strategies that change management teams can implement. By doing so, they can ensure that their change initiatives are data-driven, insightful, and impactful, ultimately leading to better business outcomes.

To read more about change analytics and change measurement check out our other articles.

To read more about maturing change management analytics check out our infographic here.

Boost Success with Organizational Change Management Software

Boost Success with Organizational Change Management Software

It used to be that change management is the ‘poor’, neglected cousin of other disciplines in terms of access to functional software to assist in its performance across every aspect of change and risk management. There is a wide range of software available for a range of project management disciplines such as, business analysis, testing, project management, portfolio management, etc. However, for change management, the pickings have been almost non-existent 10 years ago.

Fast forward to 2022, there is now a handful of change management software in the market to assist with various work categories for the change manager. However, there is still ways to go in the understand of organisational change management in the marketplace. Compilations of change management software offering on the internet is usually a mixture of all types of software, many of which are not organisational change management in nature, and instead, technical change management (used by IT folks). For example https://orgmapper.com/change-management-tool/

How does a change management process help a company?

A change management process helps a company by providing a structured approach to minimizing disruptions and transitioning individuals, teams, and organizations from a current state to a desired future state. It minimizes resistance, enhances communication, and ensures that changes align with business goals, ultimately leading to smoother transitions and improved outcomes.

How can change management software help the change practitioner?

What is the implementation of change management?

The implementation of change management involves a structured approach to transitioning individuals, teams, and organizations from a current state to a desired future state. It includes strategies for managing resistance, communication plans, and training initiatives to ensure that changes are adopted effectively and sustainable within the organization.

Project change delivery

The vast majority of change management professionals in the industry are focused on delivering projects and implementing effective change management strategies to enable them to make an informed decision about their approach. It’s no wonder that most change management tools, including project management software and various change tools, are focused to support the entire change process and project delivery as a result, maintaining consistency throughout all initiatives. What are some of the areas in which project change delivery work can be made easier by software?

1. Automating change management deliverable work

A significant part of the work of change management professionals is spent on preparing for and documenting a clear roadmap of change management deliverables. These include detailed impact assessment, learning plan, stakeholder matrix, and type of change plans, etc. These deliverables are critical documents which are critical dependency for other project milestones. For example, stakeholder analysis and matrix is critical before broader stakeholder engagement can be made, since the analysis reveals who the stakeholders are and how they may be engaged throughout the change process.

One of the biggest pains faced by change management professionals is the amount of time required to manually create these deliverable documents. The work can be tedious, requiring weeks of manual work to complete. For example, the stakeholder matrix document can be a brain-numbing piece of activity, wading through a data dump of the organisational directory to determine every Tom, Dick and Harry which titles and names should be included in the stakeholder list for the project. Then, a lot of similar information then must be re-typed and entered into different versions in other change management deliverable documents such as detailed impact assessment or learning needs analysis, ultimately affecting customer satisfaction.

Software can automate much of the manual work involved. For example, Change Automator, a robust workflow automation software, allows the ease of use to link data already captured earlier on in the project, such as the relevant stakeholders matrix, with other change management deliverables such as detailed impact assessment, to ensure the right people are involved and to minimise manual re-work. With the ability to track changes, any data updated in one document will therefore update content in other documents, including integrations with tools like Power BI. This then saves on the tedious re-work required when data is updated or changes, which is pretty much a given throughout the project lifecycle. From a quality perspective, this also ensures any human-error is reduced in the data that should be synchronised across documents.

A common risk in change management delivery is that stakeholders may be left out inadvertently, or that a previously captured stakeholder in the stakeholder matrix is left out in the engagement process due to human-error. The impact of this type of error can be disastrous to the outcome of the project. Having cross-linked documents in one central place reduces the risk for this type of error.

2. Change management survey (readiness and adoption)

A key part of change management success is through careful monitoring of stakeholders throughout the change process to ensure visibility. In the earlier part of the project, this involves understanding to what extent stakeholders may be clear of the objectives of the project, their roles in it, and general awareness. Later on in the project, it could be more on understanding their engagement level of support which can be a predictor of ultimate adoption and overall support for the change. This overall change readiness level should be monitored across the project through surveys or interviews.

Surveys are inherently time consuming to design, administer and report manually. Significant time can be taken throughout each phase of the survey process. This is a no-brainer in terms of using a software tool. Most projects use Microsoft Forms or SurveyMonkey to do the job. However, you may want more robust features such as conditional question design, for example, if a respondent answers ‘yes’ for not supporting the change, then an additional question pops up to ask why.

Surveys can include sentiment analysis where the focus of the survey is on any shifts in stakeholder feelings and attitudes toward the project. In this case, it is critical to define in detail the characters of each stakeholder group in concern. These would then determine respondent characteristics to measure in the survey design.

There are also tools that measure employee sentiments through corporate social media channels such as Yammer and Teams. For example, Swoop Analytics can help to measure collaboration styles and other behavioural insights about how employees interact with each other on those channels. The data map can reveal key influencers and core influential network connectors.

The biggest value of change surveys lies in the reporting. Most survey tools offer fairly simple reporting using bar charts or pie charts. For short, simple surveys these may suffice. However, if you are working on a fairly detailed change adoption tracking survey, more advanced reporting features may be required. You may want to easily change the colour scheme of the chart, change different chart types, identify anomalies and trends, or highlight certain parts of the data to make it easier for your audience.

3. Project change reporting

Having the ease and flexibility of experimenting with different chart designs is critical for stakeholder impact. If you need hours of work to come up with a few charts the likelihood is that you will not bother. Some stakeholders may also have various personal preferences which can easily take significant time to modify. This is especially when you need the time to focus on engaging with your stakeholders, rather than tweaking excel spreadsheets.

Creating the right AI dashboard can create significant impact on stakeholders and help achieve your change objectives. Data speaks for itself and the right data visualisation can create memorable impact more than words alone. If you are driving toward change adoption, then having an AI-enhanced dashboard of core behaviour changes and tracked capability shifts, along with key metrics and key features, can act as a core part of change governance conversations. With a monthly cadence of reviewing these core data points, stakeholders can hold each other accountable to understand remaining work involved and zoom in on how to drive full change adoption.

Change reporting may not be limited to just survey results. Even seemingly ‘boring’ spreadsheet data such as detailed impact assessment may be easily turned into highly visual and interesting reports to help stakeholders understand what the changes mean and how different groups are impacted by the change.

For more tips on designing the right data visualisations check out our infographic Making Impact with Change Charts.

4. Learning

One of the more popular ways in which change delivery has adopted software is in leveraging digital tools that provide functions to onboard or train users of new or changed systems. There are numerous providers in this area. These include WalkMe, UserGuiding, and Userlane.

Most of the tools provide similar functions to help walk users through interfaces of the system and even allow interactive experience where users can be tested in clicking on the right part of the system as a part of the training or onboarding process. The application is always for system interfaces since the tool only supports web-based systems.

Change capability

Another way in which change management software may assist change practitioners is in building change management capabilities related to change capability and documentation methodologies. There are various tools that help to measure, track, and report on change management activities and assess the impact of change initiatives, including key performance indicators and change impact analysis. This clarity could be that you would like to measure the change leadership skills of leaders, change alignment agility of stakeholder groups, or test employees as a part of skills assessment to ensure they have the right skills for the new system or process.

Using change management software, you can easily pre-program test items and answers to make it easy for yourself to score and tabulate audit test results without any manual work. You can also assign weightings to different questions to evaluate the capability of the respondent as a part of an assessment. You can even configure the assessment to provide results to the respondent at the end of the assessment, and email the feedback as well. Generally, these features are only offered as a part of a learning management system where significant time and effort is required to prepare the system for the assessment. Now, digital tools offer easy point-and-click features, with pre-configured templates saving you significant time and cost.

Change portfolio management

Managing a portfolio of initiatives used to be an approach only adopted by more mature organisations. However, with the rapid pace and intensity of changes, more and more organisations are adopting this approach to manage multiple initiatives.

Managing a portfolio of initiatives can only be done via data. There is already a myriad of project portfolio management systems in the market to help PMOs and project portfolio managers manage a slew of initiatives. The focus of project portfolio management systems is on project timelines, cost, resourcing, etc.

Change portfolio management focuses on the impact of changes and how they may impact the organisation across initiatives. There is also focus on change delivery resourcing and change capability development. One of the most critical pain points faced by organisations is change saturation and change fatigue. To better manage a portfolio of initiatives from a change perspective and manage potential change saturation, data is required.

Effective change portfolio management tools can help you:

  1. Identify and plot change saturation points for different parts of the organisation
  2. Identify risk levels of potential change saturation across roles, locations, layers of the organisations, etc.
  3. Assess to what extent changes may be better delivered as an integrated package to one part of the organisation, or broken down to smaller, more digestable chunks
  4. Assess to what extent changes may be better aligned and delivered through integrated messaging from an impacted stakeholder perspective (vs. from project perspective)
  5. Plan for change management delivery resourcing

To read more about managing a change portfolio visit 7 change portfolio management best practices.

In summary, there are many strong reasons why change management professionals should adopt digital change management solutions to achieve greater change outcomes as well as to automate the tedious parts of the work to gain time to spend with stakeholders. With the ever increasing pace of digitisation in organisations, change management must also follow suit in digitising itself. Just as we could use modern fabrication techniques to build skyscrapers that are stronger and more resilient vs using traditional brick and mortar, so should change managers in leveraging digital tools to support digital transformations.

7 Change Portfolio Management Best Practices You Need

7 Change Portfolio Management Best Practices You Need

Managing a set of change initiatives through a systematic approach in the project intake process and portfolio management process, often outlined in a table of contents, is relatively new for some organizations. This strategic approach is drawn from the portfolio project management method by dividing a set of initiatives into different teams and viewing various project ideas and initiatives in unison. By doing this, organizations can make more informed decisions, allowing things to become more manageable from the perspective of planning how to organize the strategic objectives and business goals of the planning and sequencing of these changes.

Project portfolio managers are focused on investment funding, program management, governance, project execution, project selection, and resource allocation, including selecting the best individual projects related to the best projects and those related projects endeavors. For portfolio change managers, there are similar focus areas such as change program management, change initiative execution, resource management, and quality assurance. However, there are also several marked differences, including a focus on business change governance, business change capability, change leadership, and change tools and methodology.

In practice, there is often a wide range of practices in the service delivery and model of portfolio change management. Some focus purely on supporting project delivery and provide valuable insights, and in the process fail to uplift business change capability. Others tend to focus on general change capability through training and development and very little on change governance and supporting strategy implementation.

So, what are some of the best practices in strategic portfolio management that align with strategic organizational goals and change portfolio management by coordinating with individual project managers in achieving a strategic portfolio of projects that support strategic goals and overall business strategy? How does the change portfolio management function position itself to be strategic, value-adding, and seen as a driver of business results? Here are 10 best practices.

1. Use hard data.

A lot of change professionals often shy away from data. We prefer to focus on behavior, leadership, mindsets, norms, and culture. Whilst the ‘soft’ things may matter we need to be comfortable in working with data. Peter Drucker’s famous saying goes ‘What gets measured gets done’.

Disciplines with a strong focus on data usually have a strong seat at the business table. For example, Finance, Operations, and Sales. Even Marketing is not just about creative ideas and concepts, but there is a strong focus on cost, revenue forecast, and customer responses. Armed with data that drives business decisions you get a strong seat at the decision-making table.

What types of data should portfolio change managers focus on? The standard change measures include training attendance, stakeholder ratings, and arbitrary business readiness ratings. To really demonstrate value, portfolio change managers need to turn change management into a science and be able to quantify change to inform investment decisions effectively. Change Impacts is one great example. By quantifying change impacts into discrete units one can start to measure and understand what changes are and how they move over time and across different parts of the business.

2. Link change practices with business outcomes

Continuing from the previous point – armed with quantitative change impact data, the portfolio change manager is able to analyze the data to find any correlations between change impact data and business performance data. This can become a very powerful picture to take to the senior management team – drawing out the impact of changes on business performance.

Based on data from The Change Compass. An organization has been able to draw significant correlations between change impacts and customer satisfaction levels. This has since raised meaningful discussions regarding the approach of implementing changes and how to mitigate any potential negative impacts on the customer experience. It does not necessarily mean minimize on change impacts on the customer. Instead, it challenges the group to think through how to better engage and prepare for the customer to transition through changes. This is a great example of demonstrating the importance of linking change impacts with business outcomes.

3. Focus on building change capability more than just execution

A lot of organizations treat change management as only discrete pieces of work that need to be carried out as a part of a project. With this approach, these organizations have hired mainly contractors with some permanent change managers purely focused on project execution. Whilst this work is absolutely required to successfully land initiatives, these resources come and go and in the end, the organization is often no better off in managing change.

Instead, there needs to be a continual focus on developing business change capability. This may be carried out in different ways. With each project implementation, the change manager may focus on uplifting change management capabilities in the business within its leaders. Effective engagement and learning channels can be established to better aid the deployment of change initiatives. These include self-paced training systems, know-how regarding establishing and measuring various learning interventions, and different types of employee engagement channels, both face-to-face and digital.

As change portfolio managers, a concerted focus on embedding business change capability can ensure that the business becomes more mature at undergoing change. A strategic plan can be developed that includes different ways of targeting capability uplift and change maturity. This requires business sponsorship and focus. It is also a critical part of effective operational management.

4. Design and manage change governance

Establishing effective change governance does not mean complicated multi-level governance with lots of documentation, policies, and procedures and lots of headcounts to manage the processes. Change governance means having the right processes to ensure there is sufficient oversight and visibility on what changes are going to happen and the effectiveness of change delivery.

Different organizations will establish different governance processes to suit the particular cultural and business environment. However, at the most basic level, there should be a regular cadence where managers can see and visualize the changes that are going to happen, and discuss any risks and issues with the picture they are seeing. At the same cadence, there should also be a review of the previous changes and how they’ve been rolled out, with a view to identifying opportunities for improvement.

There should also be different levels of change governance for larger organizations. For a business unit, there should be a change governance focusing on changes within the business unit. There should also be an enterprise-level change governance focused on changes across the organization. At the enterprise level, the discussion will be on strategic initiatives that run across the company. There should also be discussions on any risks and issues with business readiness and the progress of the change.

A standard meeting agenda for change governance would include the following:

  1. Review the previous month’s changes including callouts of highlights, challenges, employee engagement, results, and overall progress
  2. Examining metrics around the amount of change and to what extent the level of changes can be digested by the business appropriately
  3. Identifying potential contentions of concurrent changes within the plan. If concurrent changes are being released into the business, discussions should zoom in on the quantum and nature of change contention, rationale as to why the business may not be able to handle the volume of changes, and implications if the releases were to proceed
  4. Examining the data to ensure that all changes are captured and there is nothing missing. Change data should contain key projects being implemented, BAU changes, and other corporate programs from groups such as IT or HR
  5. Examining the overall upcoming change slate and identify upcoming risks and opportunities as a part of risk management. Opportunities may include potential gaps where there is very little change, and where there may be opportunities for initiatives to land

5. Leverage digital tools

Change portfolio managers manage the slate of projects using a structured process of funding, prioritization, analysis, and review based on data, ensuring strategic alignment with business objectives and maximizing business value. In a similar vein, so should change portfolio managers, particularly when considering insights from project proposals and a project management office. The power that change managers have is not around cost or schedule data; it is on change impact and change readiness as discrete data points, including the crucial role of the contributions of team members. The challenge is how to collect, analyze, present, and leverage the power of these data.

The Change Compass is a change portfolio management software that quantifies and packages change impacts into data that can be easily analyzed and presented in various visual formats to decision-makers in real time, as a part of effective portfolio management. Visuals are specifically designed to make people change decisions, and are not just simple headlamps or Gantt charts. Initiative owners who own the source of the information update change impact data. Up-to-date change impact project data can be accessed at any time with reporting generated automatically. The portfolio change manager can easily dissect, drill down, and cut data to find out the change health of the portfolio:

  1. Is there too much change?
  2. How is our staffing resource impacted by change activities (especially for resource-sensitive areas such as call centres)
  3. What’s the change tolerance level for the business?
  4. How are various stakeholder groups impacted by the changes?
  5. How are initiatives under particular strategic themes impacting the business?
  6. How are customers and their respective experiences impacted by our initiatives?

6. Examine customer impacts

At a portfolio level, it is not sufficient to just focus on internal employee and stakeholder impacts. The change portfolio management team manager also needs to place focus on how are customers impacted by the planned changes. This drives at the core of the focus of a lot of the organizations on the customer.

One large financial services organization that was focused on customer experiences started analyzing data on customer change impacts across initiatives. Through this, there was a significant realization that the same group of customers was impacted by 6 significant initiatives at the same time. Across each of these initiatives, there was no coordination and the silo approach meant that poor synchronization and coordination could lead to a very poor customer experience. Subsequently, new roles and remits were created to manage this customer experience through facilitating a coordinated approach to planning and implementing initiative rollout.

7. Iterative planning

Iterative planning is a core of agile ways of working. At the core of iterative planning is the belief that we don’t always know the solution that we are striving for at the beginning of the change initiative. It is when we start testing and getting feedback from users that we are able to refine our proposal and be able to come up with a solution that suits the organization.

To truly support agile ways of working, change management needs to be able to develop prototypes of the change approach, and be able to morph or tweak the approach as required based on feedback. For example, a change approach can be tested on a particular team, the change champion group, or a selected trial group. Communication and engagement approaches as well as learning approaches can be tested in these groups.

Want to learn more about managing change portfolios?

Managing change as a change driver

Managing change as a change receiver

Ultimate guide to change portfolio management

If you’re ready to start to manage a portfolio of change initiatives using data and insights, have a chat to us about how to leverage The Change Compass capabilities to help you pinpoint key risks and opportunities in managing across initiatives. To book a demo click here.

How to measure change saturation

How to measure change saturation

Digitisation, competition and changing industry conditions have amongst other things brought on an accelerated change agenda for a lot of organisations.  What were previously thought to be 1 to 5 year horizons of change suddenly became an immediate change.  Not only is working from home a norm for a lot of organisations but the struggle for enterprises to survive and stay relevant in the new norm means more changes.  The normal equilibrium for a lot of these organisations is one that consumes a smaller number of changes at any one time.  Suddenly, with the increased number of changes this leads to change saturation.

In change management, think of change saturation as a cup that fills up.  The size of the cup is the change capacity.  With limited capacity, there is only so much volume that is inherent.  As the amount of change or the pace of change increases and the cup overflows the changes don’t stick and simply fall by the waist side and may result in change fatigue. This is when the negative impact of changes can occur.

What impacts an organisation’s change capacity?

1.Change leadership

Leaders can have significant influence on the organisation.  Also, change leadership is a significant part of how change is managed and delivered.  Effective change leadership can build on the capability of teams to be more agile and capable of absorbing more changes.  Effective change leadership can also help to maximise how optimal the change is socialised and implemented, and therefore how it lands.

2. Change capability

The organisation’s change capability is one of the most important factors in determining their change capacity.  Think of agile startup organisations that are constantly pivoting, introducing new operating models, products and services.  This is part of their cultural norm.  Other organisations that maybe less agile can also develop some of these capabilities through experience and development.

3. Nature of change

Not all types of changes are the same.  Typically, a lot of the changes driven by senior leaders are about improving the bottom line or top line, improving customer experience or improving efficiency.  Some are more complex changes requiring significant change journeys.  Others may even be inherently ‘negatively perceived’ such as organisational restructuring and layoffs.  However, there are also changes that are inherently seen as benefiting the work of employees (such as process improvement leading to less red tape).

4. Number of changes

The number of changes also impact the change capacity.  Obviously more changes mean more capacity consumed, within an extent.  

5. Impact of each change

The impact level of each change is also critical.  Some initiatives have significant impact that requires a long period of time to embed the changes, e.g. culture change and complex system and process changes.  On the other hand, simple process changes may not require much capacity and simple communication is all that is needed.

6. Overall change landscape

The overall change landscape of the organisation also affects perception and therefore in some ways the capacity for change.  If competitors within the industry are all undergoing significant transformations then it sets the tone for what’s to come.  In the same way, if all our friends are used to virtual ways of working then we become more open to it.

What’s the benefits of measuring change saturation?

Measuring change saturation can be significantly beneficial for the organisation.  Understanding the tipping point means that PMO and change teams can work to avoid this from a planning perspective.  Finding out during or after the releases that there is too much change saturation is an expensive exercise that diminishes the planned initiative benefits.  It also leads to loss of productivity and operational disruptions.  Moreover, employees lose faith in the ability of the organisation to manage change.

With greater clarity of the change saturation points organisations can work to monitor, track and manage the risk of over saturation.  Measures can then be put in place to ensure minimal business disruption and protection of initiative benefits.  This should be a key focus for risk in change.

How to measure change saturation?

Firstly, there is not one change saturation point for the whole organisation.  Each department or even team may have different change saturation points.  This is because they have different leaders, different cultural norms and different change capabilities.

So how do we measure the change saturation at a department or division level?  Look historically at how changes have been received, starting with the past few months.

1. Monitor operational indicators

Depending on what the department is in charge of, understanding the change saturation point means closely monitoring the operational indicators.  During change saturation operational indicators are usually also negatively impacted, depending on the nature of the changes.

For a call centre this could be average handling time, customer satisfaction rate, absenteeism, etc.  For a back office department it could be efficiency or effectiveness measures, case completion rate, case quality rating, etc.  You don’t need to be the expert in all the various operational measures of each department as you can tap on the operations representatives of these departments.

2. Get feedback from leaders

Interview or conduct surveys with departmental leaders to understand their perception of how changes have been implemented and any potential disruptions on the business.  Understand how their teams have experienced change.  Ask them whether it has been challenging to balance operational needs with change-induced activities.  For example, were there challenges in employees attending initiative training sessions, and completing their role delivery obligations?

3. Be aware of potential biases

Be careful of opinions and feedback from leaders and employees.  There may be a tendency to over-state and complain that there is constantly too much change.  This happens because some over-state the risk of change saturation hoping that this may lead to less change and therefore easier to manage the operations of a business.  Take care to avoid this bias.

4. Identify points of change saturation

If the department has undergone periods with multiple change initiatives that has resulted in negative impact on operational indicators and leaders have also provided feedback of similar change disruptions then measure this level of change.  Record this specifically.

This requires a portfolio-level view of all the changes that have occurred and the various impacts of each initiative.  With this change portfolio measurement you are able to then identify this level as perhaps just exceeding the change saturation point for that department.  With this identified you can then plot this change saturation line.  You should also closely monitor this level and adjust as needed.

Using The Change Compass change impact can be expressed in terms of hours of impact per week.  The change saturation line can the plotted against the change impact levels.  From this, you’re able to easily visualise to what extent there could be risk in exceeding the change saturation line.

It is important to note that measuring change impacts and therefore change saturation should ideally be at a weekly level.  Measuring change impact at a monthly level may not be sufficiently detailed enough since there could be changes in impact levels within each month.  For example, for Finance the quarter-end consolidation cycle could start mid-month and therefore the change impact indication may show up as less than it actually should be simply because the data is rolled-up by month. 

Deriving a monthly dashboard in which to inform not just the change volume, but types of changes, risks, and impacted areas will do wonders to provide clear visibility for the business to get ready for and to track changes.

Other disciplines such as HR, Marketing or Operations rely on data to make critical business decisions.  The Change function and change leaders should also follow best practices.  Being armed with the right change impact data means that you can help the business to precisely pin-point change saturation points.  This can provide tremendous value to the business in terms of business, initiative and risk protection.

If you’re keen to chat more about how you are managing change saturation and to find out more about our solutions feel free to contact us here to organise a chat.

Read more about 4 common assumptions about change saturation that is misleading.

Unlock Change: How to Measure and Grow Effectively

Unlock Change: How to Measure and Grow Effectively

Scaled Agile Framework (SAFe) has emerged as a leading methodology to address the organisational change demands of fostering flexibility, collaboration, and continuous improvement. A cornerstone of SAFe is the principle of ‘Measure and Grow,’ which emphasizes using data and fact-based decisions to enhance change outcomes over time, including predictability. Despite its centrality, SAFe does not explicitly detail the change management components essential for its success, including its deep understanding of SAFe’s measurement model that enables the design of a tailored metrics strategy for ensuring strategic alignment. Here we outline how change management practitioners can effectively apply the ‘Measure and Grow’ principle within an Agile Release Train (ART) to lead change and improve outcomes to support the Scaled Agile environment.

What does it mean to “measure and grow” in a business context?

In a business context, “measure and grow” refers to the process of evaluating performance metrics to identify how our work drives business value and areas for improvement, aligning with strategic business goals. By analyzing data, companies can implement strategies that foster growth, enhance productivity, and improve overall outcomes. This approach ensures continuous development aligned with organizational goals.

The “Measure and Grow” Principle in Scaled Agile

What does it mean to “measure and grow” in a business context?

“Measure and grow” in a business context refers to the process of assessing performance metrics and outcomes to identify areas for improvement. By analyzing data, businesses can implement strategies that foster growth, enhance customer satisfaction, and optimize resource allocation, ultimately driving sustainable success and competitive advantage.

“Measure and Grow” is integral to SAFe, focusing on systematic measurement and continuous improvement for overall business agility within the value stream. By leveraging data and analytics, organizations can quickly respond to market changes, make informed decisions that meet the needs of our customers, identify areas needing attention, uncover improvement opportunities, and iteratively enhance meaningful change in performance. For change management professionals, this principle translates into a structured approach to evaluate the effectiveness of change initiatives, pinpoint areas for improvement, and implement necessary adjustments.

In a Scaled Agile environment, “Measure and Grow” is a core tenant or principle that applies in all types of agile environments. By continuously assessing and refining change efforts, organizations can align their initiatives with strategic objectives, mitigate risks, and ensure sustained success.

In practice, a lot of organisations have not pinpointed exactly how change management measures can make or break the outcome of the change, and in a SAFe environment, across the program, portfolio as well as enterprise.

The ‘Measure and Grow’ principle as a core part of SAFe (From Scaled Agile Framework)

To operationalize the “Measure and Grow” principle in change management, it is crucial to establish a set of metrics and assessment frameworks. Here are some broad categories of different types of change measurements that are relevant.  Note that since we are talking about SAFe, it is not just at the initiative level that we are talking about metrics.  More importantly, it is about establishing a system to promote change improvement across the organisation.

Change Management KPIs and OKRs

Key Performance Indicators (KPIs) and Objectives and Key Results (OKRs) are essential tools for tracking the success of change management initiatives. KPIs provide quantitative measures of performance, while OKRs align change efforts with broader organizational goals.  A change management stream or function should focus on establishing KPIs or OKRs to achieve laser focus on achieving change outcomes.

Examples of Initiative-Level Change Management KPIs that may roll out to form portfolio views

  1. Employee Engagement Levels: This KPI assesses how change impacts employee morale and engagement, providing insight into the overall acceptance and support of the change initiative.
  2. Learning Achievement Rates: This can include tracking the percentage of employees who have completed necessary training programs, as well as achieving the target level of competence to ensure that the workforce is adequately prepared for the change.
  3. Feedback Scores: Collecting feedback from stakeholders through surveys or feedback forms helps gauge perception and identify areas needing improvement.  It is important to note that depending on the change context, stakeholders may not be happy with the content of the change.  However, understanding and tracking this perception is still important.
  4. Change Adoption Rate: This KPI measures the percentage of stakeholders who have adopted the change. High adoption rates are the ultimate goal for initiatives.
  5. Issue Resolution Time: Measuring the time taken to resolve user-related issues related to the change highlights the efficiency of support mechanisms and the responsiveness of the change management team.  This is especially important during an agile environment where there may be constant changes.

Change Readiness and Stakeholder Engagement Metrics

Evaluating change readiness and stakeholder engagement is crucial to the success of any change initiative. These metrics help assess the organization’s preparedness for change and the level of involvement and support from key stakeholders.  Readiness and engagement rates can also roll up at a portfolio level to provide oversight.

Change Readiness Metrics

  1. Readiness Assessments: Conduct surveys or interviews to gauge the organization’s preparedness for the impending change. This can include evaluating awareness, understanding, and acceptance of the change.
  2. Resource Availability: Measure the availability of necessary resources, such as budget, personnel, and tools, to support the change initiative.
  3. Communication Effectiveness: Assess the clarity, frequency, and effectiveness of communication regarding the change to ensure stakeholders are well-informed and engaged.

Stakeholder Engagement Metrics

  1. Engagement Scores: Use surveys or feedback forms to measure the engagement levels of stakeholders, indicating their commitment and support for the change.
  2. Participation Rates: Track stakeholder participation in change-related activities, such as workshops, meetings, and training sessions, to gauge their involvement.
  3. Influence and Support: Assess the influence and support of key stakeholders in driving the change, ensuring that influential figures are actively endorsing the initiative.

By monitoring these metrics, change management professionals can identify potential barriers to change and take proactive steps to enhance readiness and engagement.

Stakeholder Competency Assessment

Successful change initiatives rely on the competence and readiness of key stakeholders. Assessing stakeholder competency involves evaluating the capability of sponsors and change champions to support and drive the change.

Sponsor Readiness/Capability Assessment

  1. Sponsor Engagement: Measure the level of engagement and commitment from sponsors, ensuring they are actively involved and supportive of the change.
  2. Decision-Making Effectiveness: Assess the ability of sponsors to make timely and effective decisions that facilitate the change process.
  3. Resource Allocation: Evaluate the sponsor’s ability to allocate necessary resources, such as budget and personnel, to support the change initiative.

Change Champion Capability Assessment

  1. Training and Knowledge: Measure the knowledge and training levels of change champions to ensure they are well-equipped to support the change.
  2. Communication Skills: Assess the ability of change champions to effectively communicate the change message and address stakeholder concerns.
  3. Influence and Leadership: Evaluate the influence and leadership capabilities of change champions, ensuring they can effectively drive and sustain the change.

By conducting these assessments, change management professionals can ensure that key stakeholders are prepared and capable of supporting the change initiative.

Change Adoption Metrics

Change adoption metrics provide insight into how well the change has been accepted and integrated into the organization. These metrics help assess the effectiveness of the change initiative and identify areas for improvement.  At a portfolio level, there may be different levels of change adoption set for different initiatives depending on priority and complexity.

Key Change Adoption Metrics

  1. Adoption Rate: Measure the percentage of stakeholders who have adopted the change, indicating the overall acceptance and integration of the new processes or systems.
  2. Usage Metrics: Track the usage of new tools, processes, or systems introduced by the change to ensure they are being utilized as intended.
  3. Performance Metrics: Assess the impact of the change on key performance indicators, such as productivity, efficiency, and quality, to determine the overall success of the change initiative.

By monitoring these metrics, change management professionals can gauge the success of the change initiative and identify opportunities for further improvement.  To read more about change adoption metrics check out The Comprehensive Guide to Change Management Metrics for Adoption.

Change Impact and Capacity Metrics

Understanding the impact of change and the organization’s capacity to manage it is crucial for successful change management. Change impact metrics assess the effects of the change on the organization, while capacity metrics evaluate the organization’s ability to manage and sustain the change.

Change Impact Metrics

  1. Aggregate impacts: Aggregate impacts across initiatives to form a view of how various teams and roles are impacted by various changes.
  2. Risk Assessments: Identify potential risks associated with the change and evaluate their impact, ensuring that mitigation strategies are in place.  A particular focus should be placed on business performance during change, across initiatives.

Capacity Metrics

  1. Resource Capacity: Assess the availability of resources, such as personnel, budget, and tools, to support the change initiative and optimize flow time, enhance flow velocity, and improve flow efficiency while monitoring Flow Load.
  2. Change Fatigue: Measure the risk for potential fatigue within the organization and its impact on stakeholders, ensuring that change initiatives are paced and driven appropriately.
  3. Support Structures: Evaluate the effectiveness of support structures, such as training programs, information hubs, and help desks, in facilitating the change.  Support structures may also include change champion networks.

By assessing change impact and capacity, change management practitioners can ensure that the organization is well-equipped to manage and sustain the change initiative.

Change Maturity Assessment

Change maturity assessments provide a comprehensive evaluation of the organization’s capability to manage change effectively. These assessments help identify strengths and weaknesses in the organization’s change management practices and provide a roadmap for improvement.

The Change Management Institute (CMI) Change Maturity Model is a comprehensive framework that takes a holistic approach to enhancing an organization’s change management maturity. It’s divided into three core functional domains, each playing a vital role in the overall journey toward maturity: 

  1. Project Change Management
  2. Business Change Readiness
  3. Strategic Change Leadership. 

These domains serve as the foundation for achieving higher levels of maturity within the organization.

Within each of these domains, the CMI model outlines a structured path, consisting of five distinct maturity levels. These levels represent a continuum, starting at Level 1, which serves as the foundational stage, and progressing all the way to Level 5, the zenith of maturity and effectiveness. This multi-tiered approach offers organizations a clear roadmap for growth and development, ensuring that they have the tools and insights necessary to navigate the complexities of change management.

By conducting regular change maturity assessments, change management professionals can identify areas for improvement and develop targeted strategies to enhance the organization’s change management capability.

To read more about building Change Management Maturity check out this article.

The “Measure and Grow” principle is a powerful tool for improving change outcomes in a Scaled Agile environment. By leveraging data and fact-based decision-making, change management professionals can ensure that change initiatives are effective, aligned with strategic objectives, and continuously improving. Establishing robust metrics and assessment frameworks, such as KPIs, OKRs, change readiness and stakeholder engagement metrics, stakeholder competency assessments, change adoption metrics, change impact and capacity metrics, and change maturity assessments, is essential to applying the “Measure and Grow” principle effectively.

Incorporating these metrics and assessments into change management practices enables organizations to identify areas for improvement, make informed decisions, and drive continuous improvement. By doing so, change management professionals can enhance the effectiveness of change initiatives, ensure successful adoption, and ultimately achieve better business outcomes.