Learnlets

Secondary

Clark Quinn’s Learnings about Learning

Archives for December 2024

Looking forward

31 December 2024 by Clark Leave a Comment

Woman on the ocean, peering into the distance.Last week, I expressed my gratitude for folks from this past year. That’s looking back, so it’s time to gaze a touch ahead. With some thoughts on the whole idea! So here’s looking forward to 2025. (Really? 25 years into this new century? Wow!)

First, I’m reminded of the talk I heard once. The speaker, who’d if memory serves had written a book about predicting the future, explained why it was so hard. His point was that, yes, there are trends and trajectories, but he found that there was always that unexpected twist. So you could expect X, but with some unexpected twist. For instance, I don’t think anyone a year ago really expected Generative AI to become such a ‘thing’.

There was also the time that someone went back and looked at some predictions of the coming year, and evaluated them. That didn’t turn out so well, including for me! While I have opinions, they’re just that. They may be grounded in theory and 4+ decades of experience, but they’re still pretty much guesswork, for the reason above.

What I have done, instead, for a number of years now is try to do something different. That is, talk about what I think we should see. (Or to put it another way, what I’d like to see. ;). Which hasn’t changed much, somewhat sadly. I do think we’ve seen a continuing rise of interest in learning science, but it’s been mitigated by the emergence of ways to do cheaper and faster. (A topic I riffed on for the LDA Blog.) When there’s pressure to do work faster, it’s hard to fight for good.

So, doing good design is a continued passion for me. However, in the conversations around the Learning Science conference we ran late this year, something else emerged that I think is worthy of attention. Many folks were looking for ways to do learning science. That is, resolving the practical challenges in implementing the principles. That, I think, is an interesting topic. Moreover, it’s an important one.

I have to be cautious. When I taught interface design, I deliberately pushed for more cognition than programming. My audience was software engineers, so I erred on getting them thinking about thinking. Which, I think, is right. I gave practical assignments and feedback. (I’d do better now.) I think you have to push further, because folks will backslide and you want them as far as you can get them.

On the other hand, you can’t push folks beyond what they can do. You need to have practical answers to the challenges they’ll face in making the change. In the case of user experience, their pushback was internal. Here, I think it’s more external. Designers want to do good design, generally. It’s the situation pragmatics that are the barrier here.

If I want people to pay more attention to learning science, I have to find a way to make it doable in the real world. While I’m finding more nuances, which interests me, I have to think of others. Someone railed that there are too many industry pundits who complain about the bad practices (mea culpa). That is, instead of cheering on folks that they can do better. And I think we need both, but I think it’s also incumbent to talk about what to do, practically.

Fortunately, I have not only principle but experience doing this in the real world. Also, we’ve talked to some folks along the way. And we’ll do more. We need to find that sweet spot (including ‘forgiveness is easier than permission’!) where folks can be doing good while doing well.  So that’s my intention for the year. With, of course, the caveat above! That’s what I’m looking forward to. You?

Gratitude

24 December 2024 by Clark Leave a Comment

While I’ve another post I’m meaning to write, it’s not the time ;). For now, it’s time to express gratitude. Research says actually listing the things you’re grateful for improves your mind! So, time to explore what I have to be grateful for. (And I’m being positive here. ;)

One of the good things happened in the first half of the year. I had the pleasure to continue my relationship with the folks at Upside Learning. Amit Garg continued to support learning science through his deeply grounded perspective, which led to a number of good things. One was the continual ideas from Isha Sood for marketing. There were a plethora of steps around publicizing the benefits of learning science. We did webinars, presentations, videos, and more, causing me to think afresh.  Another was working with Vidya Rajagopal to bake learning science into their design practices. She prodded me about the pragmatic constraints and we collaborated on generating new ideas about how to succeed.

Speaking of proselytizing learning science, I was engaged in many activities for the Learning Development Accelerator (LDA). With my co-director Matthew Richter, and the team, we ran a wide variety of activities. While some were members-only, others were publicly available or separate events. For instance, the Learning Science Conference was an opportunity to explore the underlying concepts and research results. We greatly benefitted from the excellent presenters, who we learned much from (as did I in particular!). Stay tuned for the followup!

I’m also grateful for those who participated in a couple of the programs the LDA ran. Both the Think Like A… and the You Oughta Know: Practitioner series drew upon folks who enlarged our perspectives on related fields and doing the work. Likewise with the debates. Of course, the LDA members are also always inquiring about the nuances. The lists are long, but you know who you are; heartfelt thanks!

I also had the chance to continue my involvement with Elevator 9. I learned a lot as the focus moved from a ‘no code’ developed-solution to a focus on developing a serious platform. A benefit was when David Grad’s passion and smart focus was coupled with Page Chen’s learning background and practical experience. It was a pleasure to work with both of them, and we plan to be able to tell you more early in the next year!

Of course, Quinnovation had its own work to do, and I had some really great experiences working with folks on their projects. We looked at the contexts and goals, and figured out steps to proceed along the path. I’m grateful, as I always learn a lot working with folks, and getting the chance to meld my background with their situations and expertise to craft viable solutions. Of course, I welcome hearing if I can assist you in the coming year!

I also did lots of interviews via podcasts, which are enlightening. The many smart hosts ask interesting questions, prompting me to think (and, regularly, rethink). These were coupled with articles for Upside, LDA, and more. I found out that one article back in January for Training Journal was their most read article of that month! Like my blogging here, these are further opportunities that cause me to reprocess my previous thinking.

I’m sure there’re more folks I’m forgetting. Mea culpa, and thanks!

In all, I’ve got a lot to be grateful for. As the research says, I find it boosting my mood as I write. So thanks to the folks above who helped me continue to explore the opportunities and solutions. I’ve much to have gratitude for, and that is the best thing of all. May you, too, have much to be grateful for, and may the holidays and the new year bring you more.

 

 

 

Uniqueness

17 December 2024 by Clark 2 Comments

In a conversation yesterday, we were talking about what works in presenting yourself (in this case, for a job). I mentioned that in the US you have to perhaps overpromise, whereas my experience in Oz (coloured, as it is, by its Brit origins ;), was that you underpromise. The latter worked well for me, because I believe I tend to err on the side of quiet; I don’t like boasts. I was suggesting, in this case, that you needed what made one unique to a particular situation. Thinking further, I think I do value what is uniqueness. What do I mean?

So, to get a (proper?) Ph.D., you are expected make a unique contribution to understanding. Consider our knowledge as a giant ball, and what a thesis does is push out one tiny bump. The goal is something no one else has done. For instance, for my Ph.D., I broke analogy up into a different set of steps, and measured performance. My specification of steps was unique, but that wasn’t the contribution (in my mind, at least). What I also did was try training to improve those processes (four of the six, for reasons), and it did impact a couple, with good reasons not to have impacted the others. It wasn’t earth-shattering, by any means (I suspect no one cites my thesis!), but it was a contribution. (And, of course, it grounded me in the literature and practices.)

When I think of folks I respect, in many cases it’s because they have made a unique contribution. By the way, I suppose I should be clear: unique isn’t enough, it has to be a positive contribution (which can include ruling out things). It’s like innovation: not just an idea, but a good one!  So, for instance, Will Thalheimer’s been a proponent of evidence-informed practices, but his unique contribution is LTEM. So too with Patti Shank and multiple choice questions, Michael Allen with SAM, Harold Jarche with PKM, etc. I’m kind of thinking right now that Julie Dirksen’s new book is what’s really new!  I am inclined to think that new syntheses are also valuable.

For instance, my own books on myths and learning science are really syntheses, not new ideas. (Maybe my mobile books too?) Reflecting, I think that the three books that I wanted to publish, my first on games, my fourth on L&D strategy, and my most recent on engagement (channeling the core from the first book), are more unique contributions.  Though I will self-servingly and possibly wrongly suggest my way of thinking about contexts, models, and more are innovations. Like Allen’s CCAF (Context – Challenge – Activity – Feedback), perhaps.

Which isn’t to say syntheses that organize things into new and more comprehensible ways isn’t also a contribution. In addition to (immodestly) my afore-mentioned books in that category, I think of folks like Connie Malamed, Christy Tucker, Matthew Richter, Ruth Clark, Jane Bozarth, etc. These folks do a great job of taking received wisdom and collating and organizing it so as to be comprehensible. And I could be providing too short a shrift in some cases.

My stance is that I don’t see enough ‘uniqueness’. Original ideas are few and far between. Which may be expected, but we have to be careful. There are a lot more touted ideas than there are good ones. What really is different? What’s worth paying attention to? It’s not an easy question, and I may be too harsh. There is a role for providing different perspectives on existing things, to increase the likelihood that people hear of it. But those should be new perspectives. I’m not interested in hearing the same ideas from different folks. So, does this make sense, or am I being too harsh?

By the way, I suspect that there are more ideas than we actually hear about. I know people can be hesitant about sharing them for a variety of reasons. If you’ve got an idea, share it with someone! If they get excited, it may well be new and worthwhile. Take a chance, we may all benefit.

The enemy of the good

10 December 2024 by Clark Leave a Comment

We frequently hear that ‘perfection is the enemy of the good’. And that may well be true. However, I want to suggest that there’s another enemy that plagues us as learning experience designers. We may be trying to do good, but there are barriers. These are worthy of explicit discussion.

You also hear about the holy trinity of engineering: cheap, fast, or good; pick two. We have real world pressures that want us to do things efficiently. For instance, we have lots of claims that generative AI will allow us to generate more learning faster. Thus, we can do more with less. Which isn’t a bad thing…if what we produce is good enough. If we’re doing good, I’ll suggest, then we can worry about fast and cheap. But doing bad faster and cheaper isn’t a good thing! Which brings us to the second issue.

What is our definition of ‘good’? It appears that, too often, good is if people ‘like’ it. Which isn’t a bad thing, it’s even the first level in the Kirkpatrick-Katzell model: asking what people think of the experience. One small problem: the correlation between what people think of an experience, and it’s actual impact, is .09 (Salas, et al, 2012). That’s zero with a rounding error! What it means is that people’s evaluation of what they think of it, and the actual impact, isn’t correlated at all. It could be highly rated and not be effective, or highly rated and be effective. Etc. At core, you can’t tell by the rating.

What should be ‘good’? The general intent of a learning intervention (or any intervention, really) is to have an impact! If we’re providing learning, it should yield a new ability to ‘do’. There are a multitude of problems here. For one, we don’t evaluate performance, so how would we know if our intervention is having an impact? Have learners acquired new abilities that are persisting in the workplace and leading to the necessary organizational change? Who knows? For another, folks don’t have realistic expectations about what it takes to have an impact. We’ve devolved to a state where if we build it, it must be good. Which isn’t a sound basis for determining outcomes.

There is, of course, a perfectly good reason to evaluate people’s affective experience of the learning. If we’re designing experiences, having it be ‘hard fun’ means we’ve optimized the engagement. This is fine, but only after, we’ve established efficacy. If we’re not having a learning impact in terms of new abilities to perform, what people think about it isn’t of use.

Look, I’d prefer us to be in the situation where perfection to be the enemy of the good! That’d mean we’re actually doing good. Yet, in our industry, too often we don’t have any idea whether we are or not. We’re not measuring ‘good’, so we’re not designing for it. If we measured impact first, then experience, we could get overly focused on perfection. That’d be a good problem to have, I reckon. Right now, however, we’re only focused on fast and cheap. We won’t get ‘good’ until we insist upon it from and for ourselves. So, let’s shall we?

Convincing stakeholders

3 December 2024 by Clark Leave a Comment

As could be expected (in retrospect ;), a recurrent theme in the discussions from our recent Learning Science Conference was how to deal with objections. For instance, folks who believe myths, or don’t understand learning. Of course, we don’t measure, amongst other things. However, we also have mistaken expectations about our endeavors. That’s worth addressing. So, here I’m talking about convincing stakeholders.

To be clear, I’m not talking about myths. Already addressed that. But is there something to be taken away? I suggested (and practiced in my book on myths in our industry), that we need to treat people with respect. I suggest that we need to:

  • Acknowledge the appeal
  • Also address what could be the downsides
  • Then, look to the research
  • Finally, and importantly, provide an alternative

The open question is whether this also applies to talking learning.

In general, when talking about trying to convince folks about why we need to shift our expectations about learning, I suggest that we need to be prepared with a suite of stories. I recognize that different approaches will work in different circumstances. So, I’ve suggested we should have to hand:

  • The theory
  • The data/research
  • A personal illustrative anecdote
  • Solicit and use one of their personal anecdotes
  • A case study
  • A case study of what competitors are doing

Then, we use the one we think works best with this stakeholder in this situation.

Can we put these together? I think we can, and perhaps should. We can acknowledge the appeal of the current approach. E.g., it’s not costing too much, and we have faith it’s working. We should also reveal the potential flaws if we don’t remedy the situation: we’re not actually moving any particular needle. Then we can examine the situation: here we draw upon one of the second list about approaches. Finally, we offer an alternative: that if we do good learning design, we can actually influence the organization in positive ways!

This, I suggest, is how we might approach convincing stakeholders. And, let me strongly urge, we need to! Currently there are far too many who believe that learning is the outcome of an event. That is, if we send people off to a training event, they’ll come back with new skills. Yet, learning science (and data, when we bother) tells us this isn’t what happens. People may like it, but there’s no persistent change. Instead, learning requires a plan and a journey that develops learners over time. We know how to do good learning design, we just have to do it. Further, we have to have the resources and understanding to do so. We can work on the former, but we should work on the latter, too.

Clark Quinn

The Company

Search

Feedblitz (email) signup

Never miss a post
Your email address:*
Please wait...
Please enter all required fields Click to hide
Correct invalid entries Click to hide

Pages

  • About Learnlets and Quinnovation

The Serious eLearning Manifesto

Manifesto badge

Categories

  • design
  • games
  • meta-learning
  • mindmap
  • mobile
  • social
  • strategy
  • technology
  • Uncategorized
  • virtual worlds

License

Previous Posts

  • May 2025
  • April 2025
  • March 2025
  • February 2025
  • January 2025
  • December 2024
  • November 2024
  • October 2024
  • September 2024
  • August 2024
  • July 2024
  • June 2024
  • May 2024
  • April 2024
  • March 2024
  • February 2024
  • January 2024
  • December 2023
  • November 2023
  • October 2023
  • September 2023
  • August 2023
  • July 2023
  • June 2023
  • May 2023
  • April 2023
  • March 2023
  • February 2023
  • January 2023
  • December 2022
  • November 2022
  • October 2022
  • September 2022
  • August 2022
  • July 2022
  • June 2022
  • May 2022
  • April 2022
  • March 2022
  • February 2022
  • January 2022
  • December 2021
  • November 2021
  • October 2021
  • September 2021
  • August 2021
  • July 2021
  • June 2021
  • May 2021
  • April 2021
  • March 2021
  • February 2021
  • January 2021
  • December 2020
  • November 2020
  • October 2020
  • September 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • April 2020
  • March 2020
  • February 2020
  • January 2020
  • December 2019
  • November 2019
  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • January 2019
  • December 2018
  • November 2018
  • October 2018
  • September 2018
  • August 2018
  • July 2018
  • June 2018
  • May 2018
  • April 2018
  • March 2018
  • February 2018
  • January 2018
  • December 2017
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • July 2017
  • June 2017
  • May 2017
  • April 2017
  • March 2017
  • February 2017
  • January 2017
  • December 2016
  • November 2016
  • October 2016
  • September 2016
  • August 2016
  • July 2016
  • June 2016
  • May 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • December 2015
  • November 2015
  • October 2015
  • September 2015
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • March 2015
  • February 2015
  • January 2015
  • December 2014
  • November 2014
  • October 2014
  • September 2014
  • August 2014
  • July 2014
  • June 2014
  • May 2014
  • April 2014
  • March 2014
  • February 2014
  • January 2014
  • December 2013
  • November 2013
  • October 2013
  • September 2013
  • August 2013
  • July 2013
  • June 2013
  • May 2013
  • April 2013
  • March 2013
  • February 2013
  • January 2013
  • December 2012
  • November 2012
  • October 2012
  • September 2012
  • August 2012
  • July 2012
  • June 2012
  • May 2012
  • April 2012
  • March 2012
  • February 2012
  • January 2012
  • December 2011
  • November 2011
  • October 2011
  • September 2011
  • August 2011
  • July 2011
  • June 2011
  • May 2011
  • April 2011
  • March 2011
  • February 2011
  • January 2011
  • December 2010
  • November 2010
  • October 2010
  • September 2010
  • August 2010
  • July 2010
  • June 2010
  • May 2010
  • April 2010
  • March 2010
  • February 2010
  • January 2010
  • December 2009
  • November 2009
  • October 2009
  • September 2009
  • August 2009
  • July 2009
  • June 2009
  • May 2009
  • April 2009
  • March 2009
  • February 2009
  • January 2009
  • December 2008
  • November 2008
  • October 2008
  • September 2008
  • August 2008
  • July 2008
  • June 2008
  • May 2008
  • April 2008
  • March 2008
  • February 2008
  • January 2008
  • December 2007
  • November 2007
  • October 2007
  • September 2007
  • August 2007
  • July 2007
  • June 2007
  • May 2007
  • April 2007
  • March 2007
  • February 2007
  • January 2007
  • December 2006
  • November 2006
  • October 2006
  • September 2006
  • August 2006
  • July 2006
  • June 2006
  • May 2006
  • April 2006
  • March 2006
  • February 2006
  • January 2006

Amazon Affiliate

Required to announce that, as an Amazon Associate, I earn from qualifying purchases. Mostly book links. Full disclosure.

We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.Ok