Without goals and measurements in place, it’s hard to know if you have hit the mark or need to change course. Collecting and analyzing data can help plot a purposeful path and provide guidance for steering a project or initiative forward – such as implementing a document management system (DMS).
You’ll want to start your deployment off on the right foot by setting goals and identifying the metrics for measuring success at each stage of the project. By having SMART goals (Specific in what you are trying to achieve, ensuring it’s Measurable and Attainable, Relevant to the business, and have a Timeframe), you can make it easier to identify and track appropriate metrics that that directly tie back to your goal(s).[i]
O ANTES DO ESTÁGIO
Know your starting point. At the earliest stages of the project, conduct surveys, focus groups, and interviews across the organization to inform your integration team as well as your communications and learning strategy. Collecting baseline data points for systems usage, needs, and issues prior to deployment is necessary to have something to compare post-rollout numbers against. You won’t know how far you moved the needle if you don’t know where the needle started.
Verify your current position. Early communications are part of an effective change management strategy to cut through confusion and reduce push back[ii] as well as a robust learning strategy for laying the initial foundation of knowledge.[iii] Measuring people’s reaction to messaging and pre-learning can be an early indicator of their intent to embrace the change.[iv] One way to measure reactions is by gathering anecdotal evidence:
Be agile. Gauge the emotion behind responses. Confusion indicates people don’t know why the change is happening, while resistance indicates people don’t understand how the change will benefit or affect them.[v] By diagnosing the shortcomings of your communication efforts in advance, you have time to be agile and course-correct prior to deployment.
O ESTÁGIO DURANTE
Engage learners. As a trainer, in the moment of learning ask open-ended questions to measure audience understanding and knowledge.[vi] Track the questions and share them with the project team, use them to create a list of FAQs or knowledge base. If you notice that an individual has an inordinate number of questions, notify the support team that the person may need a little extra attention.
Look for trends. During and after training, track and look for trends in questions or issues. This can indicate a need to adjust training, provide a just-in-time workshop, or create additional content. Plan for the possibility that new needs may surface. It is normal that when doing something for the first time more questions will surface. Expect a spike in helpdesk and support calls during the first week and tapering each day. This is an indicator of application and behavioral change.[vii] Questions may also morph to a more advanced-level as people increase their usage—another positive indication—so consider having a plan for coding the level of questions.
A FASE DEPOIS
Rerun system usage reports. One-week, two-weeks, one-month, three-months, and six-months after deployment rerun the system usage reports and compare to the previous report.[viii]
Analyze and take action. Don’t collect data for data’s sake but analyze and draw conclusions from it—then take appropriate action.
Hold people accountable. What gets measured, gets done. Leverage sponsors and supervisors to conduct interviews, touch base with employees, observe behavior, and encourage compliance to reinforce the change as needed.
Quantify and qualify the data. Over time, data begins to tell a story. Look for the leading indicators of success such as compliance using the new system, processing time, employee satisfaction scores, fewer critical incident reports, and audit findings.[ix]
O sucesso por trás do cumprimento de metas é amplamente determinado por quão bem eles são definidos e medidos. O poder dos dados está nos detalhes e no que escolhemos fazer com esse conhecimento. Deixe que os dados sejam sua luz guia em cada estágio de um projeto para garantir uma transição suave e um resultado positivo.
By Carolyn Humpherys, Learning and Change Management Consultant at Traveling Coaches
[i] Metas inteligentes
[ii] Modelo ADKAR da Prosci para Mudança
[iii] Taxonomia de Bloom
[iv] Quatro níveis de avaliação de Kirkpatrick - Nível 1
[v] Modelo ADKAR Gap
[vi] Nível de Kirkpatrick 2
[vii] Nível de Kirkpatrick 3
[viii] Nível de Kirkpatrick 3
[ix] Nível de Kirkpatrick 4