Comments on: Measuring Impact (or not) https://blog.learnlets.com/2020/12/measuring-impact-or-not/ Clark Quinn's learnings about learning Wed, 09 Dec 2020 16:34:05 +0000 hourly 1 By: Clark https://blog.learnlets.com/2020/12/measuring-impact-or-not/#comment-1048345 Wed, 09 Dec 2020 16:34:05 +0000 https://blog.learnlets.com/?p=7721#comment-1048345 In reply to Ingo ter Meulen.

Ingo, quite the response! Interestingly, the way I see it (and I had to look up OKRs ;), is that you start with OKRs, and those drive KPIs. E.g. strategy down to tactical measures. I think the fuzzy stuff about opinions matters, when you’re evaluating subjective experience: employee experience, customer experience. And there are ways to collect that in valid ways. But to your key question, the data points, in my opinion they are driven by the change you’re trying to achieve. But those should be tied to performance gaps, and the data that should be used are the evidence of the gap and how you’ll know it’s fixed. Too many errors in manufacturing? That’d be the errors per (time, piece, etc). Too long a sales cycle? Then time to close. And so on. If it’s about customer experience, it could just be a satisfaction rating. But you should have a performance you’re trying to improve, then you find the cause, and if it’s a skill gap, then it’s a course. Otherwise it might be a job aid, or a change in incentives, or messaging campaign, or… And then you can measure the impact of those. Hope this helps.

]]>
By: Ingo ter Meulen https://blog.learnlets.com/2020/12/measuring-impact-or-not/#comment-1047955 Tue, 08 Dec 2020 09:06:15 +0000 https://blog.learnlets.com/?p=7721#comment-1047955 The company defines, based on their vision, mission and strategy, in which direction they want to go and provides a framework. To measure it needs hard facts… measurable and comparable. Then goals for single resources, roles, departments, subsidiaries and the whole company needs to be set (KRA, KPI).
A kind of second layer would be on how these impact each other to allow steering based on hard facts (and a lot of data points). OKRs could define on how to achieve the goals.
As a next step incorporating the results in improvement plans, Business Modelling and product development. And HR plays an also an important role in this.

Another layer would be, even fuzzy and hard to measure, behavior, meaning, what people think. Personal thoughts about “do we provide enough trainings” or “do we provide spot on training, even, if not overall many trainings” could be a very personal opinion based on experience and expectations.
This should be tracked separately to be able to deep dive into the data to not miss possible relations between hard and soft values. It’s a bit like a “just in case” data collection. And sometimes patterns appear at places you don’t expect.

I remember a customer we always had to chase to pay the bills. No meeting with the customer fixed it.
Analyzing past data on customer satisfaction, who had been the Sales Reps in the past, which trainings were moved/cancelled in the past, training survey results, lost opportunities and even, where the customer worked before revealed, that something went wrong in his previous company, which had been also our customer. And the same Sales Rep and the same Admin that created this situation in the past (that never had been fully fixed), where now the ones responsible for him again. Situation is now fixed, but without the combination of hard and soft facts we wouldn’t have been able to.

Hope not too much of above is rubbish :D… Just my experience… But I would be very interested in getting to know which data points (hard/soft) you consider as crucial, less important or meaningless and how do you measure those (direct or per relation).

]]>
By: Clark https://blog.learnlets.com/2020/12/measuring-impact-or-not/#comment-1047838 Tue, 08 Dec 2020 00:37:13 +0000 https://blog.learnlets.com/?p=7721#comment-1047838 In reply to Brian Steeves.

I couldn’t ask them why, as I didn’t conduct the survey. I’m reacting to what I’ve seen elsewhere and what on principle makes sense.

]]>
By: Brian Steeves https://blog.learnlets.com/2020/12/measuring-impact-or-not/#comment-1047102 Sat, 05 Dec 2020 11:05:21 +0000 https://blog.learnlets.com/?p=7721#comment-1047102 It’s an opinion.
Did you ask the respondents “why” they think about impact in the way they described?

I find it better to walk on boyth sides of the street.

]]>
By: Clark https://blog.learnlets.com/2020/12/measuring-impact-or-not/#comment-1046754 Fri, 04 Dec 2020 01:06:21 +0000 https://blog.learnlets.com/?p=7721#comment-1046754 In reply to DM.

Though I have to confess that I’ve written for them! Hopefully better grounded than those you’ve seen…

]]>
By: DM https://blog.learnlets.com/2020/12/measuring-impact-or-not/#comment-1046726 Thu, 03 Dec 2020 15:34:53 +0000 https://blog.learnlets.com/?p=7721#comment-1046726 I’ve browsed articles on CLO before and found either the views they express – or at least the people to whom they give a platform – to often be problematic and counter to research.

]]>