Learnlets

Secondary

Clark Quinn’s Learnings about Learning

Missing LXD Workshop

20 April 2023 by Clark Leave a Comment

We interrupt your regularly scheduled reading for this commercial announcement:

What is Learning Experience Design (LXD)? Further, why should you care? Finally, (and arguably most important) what does it mean you should do differently? Those, to me, are important questions. My short answer is that LXD is the elegant integration of learning science and engagement. Which, to me, implies some important nuances on top of what’s traditionally done in instructional design (ID). How to address it? There’s actually quite a lot in LXD, but it’s also a lot of overlap with traditional ID practices and processes. I reckon the easiest (and best) way to address it is to talk about the delta. That is, what’s different between the two. So, in my role for Upside Learning, I developed a missing LXD workshop. We ran it internally to good outcomes, and now, you can take it!

I believe that the difference starts with objectives; you can’t make a meaningful experience if you don’t have learners acquiring relevant new skills (not just an information dump). From there, there are nuances on designing individual practice activities, and then aggregated into practices (that is, putting practices together). Moving on, we look at the content elements of models and examples, and then the emotional aspects of learning. The workshop closes by looking at a design process that accommodates these. Recognizing that folks don’t want to throw out their whole process to start anew, it works from a generic model.

In the workshop, I cover each of those topics in a week; so it’s a six week experience. In between, I ask attendees to do some interim processing to both cement their understanding and to change their practices. Each week we’ll cover underlying concepts, see examples of what we’re talking about, actively process the information, and do a major application task.

To make this available more broadly, Upside’s partnered with the Learning Development Accelerator (LDA) to deliver it. Full disclosure: I’m co-director of the LDA, and Chief Learning Strategist for Upside Learning (in addition to my ongoing role for Quinnovation). (So, it’s all about me! :) Seriously, I think this puts together the tools I believe are necessary to lift our industry.

To be clear, since the advance notice timeframe puts this in summer, we’re offering it in Asia time-frames first (tho’ anyone is welcome!):

Australian Eastern Standard Time: July 7, 14, 21, 28, August 4 and 11 from 12h00 to 14h00 each day
Singapore Time: July 7, 14, 21, 28, August 4 and 11 from 10h00 to 12h00 each day
India Standard Time: July 7, 14, 21, 28, August 4 and 11 from 07h30 to 09h30 each day
New York Time: July 6, 13, 20, 27, August 3 and 10 from 22h00 to 24h00 each day

We’re offering it for US$100 to LDA members, and US$350 to non-members (for only $40 more, you get the full LDA offerings as well).

We’re planning to offer the missing LXD workshop again at a later date at East Coast/Europe friendly times (probably at a steeper price, we’ll have worked the bugs out ;). You can find out more at the LDA site. It’s got learning science and engagement bundled up into a coherent whole, for those who’ve already been doing ID and want to lift their game. I hope you’ll find it worth your while.

We now return you to your regularly scheduled reading until next week at the usual time.

The details matter

18 April 2023 by Clark 2 Comments

For many reasons, I end up reading relevant books to our field. A recent one underway is Wiggins & McTighe’s Understanding by Design. In it, I found a quote that really resonated. It highlights to me one of the biggest barriers I think we face, that the details matter. Not everyone will see this, however.

So, the quote is from Bransford, Brown, & Cocking’s masterwork, How People Learn, funded by the National Academies of Sciences. It chronicles what was known at the time about the subject of learning, aggregating learning science research. I don’t know if it’s true outside the US, but within you can get a free PDF copy!

Wiggins & McTighe’s book is a primary argument for working backwards. They’re not concerned with the pedagogy, but the planning. Of course, it also matters what your learning goals are. Thus, they also discuss what understanding means. That’s where this quote comes from:

Many approaches to instruction look equivalent when the only measure of learning is memory. …Instructional differences become more apparent when evaluated from the perspective of how well the learning transfers to new problems and settings.

This resonates because it highlights something I think we struggle with. To folks who don’t know any better, as I’ve argued before, well-produced, versus well-designed and well-produced, is hard to distinguish. As a respondent noted, we don’t always even test memory! Yet our goals should be (retention and) transfer.

I think the field has fallen into a superstition that information dump and knowledge test is learning! Which is mistaken, but if you don’t know any better, it’s hard to tell. Reckon we have to continue to focus on outcomes, measuring if  learning transfers to new problems and settings. When we do, we’ll have evidence to help make the case for learning that works. Then we can have the resources to pay attention, reflecting that the details matter. ‘Til then, we’ll continue to fight to do it right.

Comic openings

11 April 2023 by Clark Leave a Comment

Humor is important, we have to address this seriously!

Speaking of irreverent, I’ve argued, in the past, that we don’t use comics enough in learning. In general, I mean serious comics, graphic novel formats, to tell dramatic stories. However, we can use comics for humor, as well. In particular, to accomplish our motivation goals on opening. So here I ponder comic openings.

To start, as I mention in talking about making learning meaningful, I believe you need to open up people emotionally. Even before you open up cognitively! We know that activating relevant knowledge is important cognitively, but I suggest that it won’t stick as well unless you’ve piqued their awareness. I’m arguing that we need a visceral awareness that this is relevant.

It doesn’t take much, but I suggest it is worth doing. I like to use the consequences of having, or not, this ability is what’s key. There are things you can do that you couldn’t without it. Making that clear is, to me, a WIIFM (What’s In It For Me).

I believe you can do this dramatically or humorously. That is, you could make a dramatic story of saving someone because of the information you have, or the bad outcomes from not having it. Then there’s the alternative.

You can also have humorous aspects of having the info. For instance, saving the day not because the hero knows it, but the sidekick happens to, instead. However, my favorite approach is to humorously point out the consequences of not having the knowledge. (OK, admitting my predilection for sarcasm. ;) This can be done with just a simple comic! I’ve done so in content we developed for a client, and am doing so again in a demo we’re creating.

It might also set the tone for the learning. It can help learners relax, trust that the environment’s safe, reducing anxiety.

I suggest this is easy to create, easy to develop, quick, engaging for the learners, and effective. Now, I don’t have specific research on that (I’d love to: anyone got pointers or want to do the study?). However, I think it’s a plausible inference from what we do know from learning science.

I’ll also acknowledge that there are times this won’t be the best approach! Certain topics probably aren’t good candidates, similarly certain audiences might similarly not match. However, I do think it’s more broadly applicable than we think. Even for modules within an overall topic. If they’re inexpensive and high impact, use them liberally. So I’ll suggest we use comic openings liberally!

Irreverence

4 April 2023 by Clark 4 Comments

I’m not flamboyant, nor funny. I’m occasionally irreverent, and those who know me personally can probably regale you with my love for puns and wordplay. Of course, I think irreverence is undervalued, and am inclined to think it may be the only truly effective tool for addressing myths, superstitions, and misconceptions. So I took some time on my walk today and thought about it a bit. Here’re the results with some extensions.

X Styles (e.g. learning, leadership, etc)

Why don’t you just use astrology? It’s cheaper, and has about as much validity!

Dale’s Cone

People will believe about 10% of what you write, 50% of what has a cute alliterative phrase, 70% of what you tout in a video, and 90% of what’s in a well-produced infographic. (Aside: I think this is the secret to marketing.)

Images processed 60K times faster than text

That has to be right, because images are processed visually, while text is processed…hey, wait a minute!

Attention span of a goldfish

Because we no longer…’scuse me, I’ve a notification on my phone…

Generations

This new generation has no respect for tradition, said the ancient Greek philosophers.

I could go on, but that would spoil the fun. I’d like to hear yours! Cheers to irreverence!

Tradeoffs in aesthetics

28 March 2023 by Clark Leave a Comment

For the LDA debate this month, Ruth Clark talked to Matt Richter and I about aesthetics in learning. Ruth, you should know, is the co-author of eLearning and the Science of Instruction, amongst other books, a must-have which leverages Rich Mayer’s work on multimedia learning. Thus, she’s knowledgeable about what the research says. What emerged in the conversation was a problem about tradeoffs in aesthetics, that’s worth exploring.

So, for one thing, we know that gratuitous media interferes with learning. From John Sweller’s work on cognitive load theory, we know that processing the unnecessary data reduces cognitive resources available to support learning. There’s usually enough load just with the learning materials. Unless the material materially supports learning, it should be avoided.

On the other hand, we also know that we should contextualize learning. The late John Branford’s work with the Cognitive Technology Group while at Vanderbilt, for instance, demonstrated this. As the late David Jonassen also demonstrated with his problem-based learning, we retain and transfer better with concrete problems. Thus, creating a concrete setting for applying the knowledge is of benefit to learning.

What this sets up, of course, is a tradeoff. That is, we want to use aesthetics to help communicate the context, but we want to keep them minimal. How do we do this? Even text (which is a medium), can be extraneous. There really is only one true response. We have to create our first best guess, and then we test. The testing doesn’t have to be to the level of scientific rigor, mind you. Even if it just passes the scrutiny of fellow team members, it can be the right choice, though ideally we run it by learners.

What we have to fight is those who want to tart it up. There will be folks who want more aesthetics. We have to push back against that, particularly if we think it interferes with learning. We need to ensure that what’re producing doesn’t violate what’s known. It’s not always easy, and in situations we may not always win, but we have to be willing to give it a go.

There are tradeoffs in aesthetics, so we have to know what matters. Ultimately, it’s about the learning outcomes. Thus, focusing on the minimum contextualization, and the maximum learning, is likely to get us to a good first draft. Then, let’s see if we can’t check. Right?

Time is the biggest problem?

21 March 2023 by Clark 1 Comment

In conversations, I’ve begun to suspect that one of the biggest, if not the biggest, problem facing designers wishing to do truly good, deep, design, is client expectations. That is, a belief that if we’re provided with the appropriate information, we can crank out a solution. Why, don’t you just distribute the information across the screen and add a quiz? While there are myriad problems, such as lack of knowledge of how learning works, etc, folks seem to think you can turn around a course in two weeks. Thus, I’m led to ponder if time is the biggest problem.

In the early days of educational technology, it was considered technically difficult. Thus, teams worked on instantiations: instructional designers, media experts, technologists. Moreover, they tested, refined, and retested. Over time, the tools got better. You still had teams, but things could go faster. You could create a draft solution pretty quickly, with rapid tools. However, when people saw the solutions, they were satisfied. It looks like content and quizzes, which is what school is, and that’s learning, right? Without understanding the nuances, it’s hard to tell well-produced learning from well-designed and well-produced learning. Iteration and testing fell away.

Now, folks believe that with a rapid tool and content, you can churn out learning by turning the handle. Put content into the hopper, and out comes courses. This was desirable from a cost-efficiency standpoint. This gets worse when we fail to measure impact. If we’re just asking people whether they like it, we don’t really know if it’s working. There’s no basis to iterate! (BTW, the correlation for learner assessment of learning quality, and the actual quality, is essentially zero.)

For the record, an information dump and knowledge test is highly unlikely to lead to any significant change in behavior (which is what learning we are trying to accomplish). We need is meaningful practice, and to get that right requires a first draft, and fine tuning. We know this, and yet we struggle to find time and resources to do it, because of expectations.

These expectations of speed, and unrealistic beliefs in quality, create a barrier to actually achieving meaningful outcomes. If folks aren’t willing to pay for the time and effort to do it right, and they’re not looking at outcomes, they will continue to believe that what they’re spending isn’t a waste.

I’ve argued before that what might make the biggest impact is measurement. That is, we should be looking to address some measurable problem in the org and not stop until we have addressed it. With that, it becomes easier to show that the quick solutions aren’t having the needed impact. We need evidence to support making the change, but I reckon we also need to raise awareness. If we want to change perception, and the situation, we need to ensure that others know time is the biggest problem. Do you agree?

Process and Product

14 March 2023 by Clark Leave a Comment

Of late, I’ve been talking a fair bit about my take on learning experience design (LXD). To me, it’s the elegant integration of learning science with engagement. Of course, I’m biased, as my two most recent books are specifically to those ends! I don’t claim it’s automatic, but I do believe that with practice, it gets easier. You need to address both process and product, of course.

Our goals are, ultimately, to achieve learning outcomes, typically retention and transfer. That is, retaining skills over time ’til needed and transferring to all appropriate (and no inappropriate) situations. This requires, cognitively, sufficient practice and an appropriate spread of contexts. Emotionally, it requires an initial hook and then maintaining commitment through the experience via relevant activities.

I’ve been running a workshop with my partner, Upside Learning, on the ‘missing bits’. That is, the fine tuning that takes what you normally do in ID and fills in the extra steps that will successfully provide the integration. It’s been great for stress-testing the workshop (stay tuned!), and extremely insightful. I get to hear what these smart and experienced folks are realizing in their own practices, and what they’re struggling to change.  That’s my goal, of course: to help them bake learning science and engagement into their processes and products.

One of the concerns, not surprisingly, is that it takes more time. That includes upfront analysis (which clients can also resist). Then it requires a bit more thought on designing practice and winnowing content. Finally, it should be iterative. I’m not the only one focusing on the latter, of course. However, I argue that it ultimately really doesn’t take that much more time, but there will be a speed bump until the new way of thinking becomes automatic.

Still, it will require adjusting how we develop, to impact what we develop. Process and product are linked at the wrist and ankles. Understanding the underlying principles, the learning science and engagement integration, is a necessary foundation. That’s my take, I welcome yours.

I’ll be offering a free webinar with Training Magazine Network on the core principles of LXD on Wednesday March 22 at 9AM PT (noon ET). I note that if there’s a conflict, they’ll make the recording available afterwards if you register. I welcome seeing you there!

What to do?

7 March 2023 by Clark 2 Comments

Let me suggest that one of the biggest gaps in our thinking is about doing. Too often, we think about ‘learning’ as the end goal, and it’s not. (I’ve gone as far as suggesting we rename L&D!) We need to rethink and ask about doing, not learning; we need to ask about people: what to do?

To start with, for organizational needs we don’t learn for intellectual self-gratification. (Though, too often, it seems that way: ‘awareness’ courses continue to perplex me. What possible organizational value will they achieve?) Instead, there should be identified gaps that are targeted because remedying them will improve outcomes.

There’s a whole process of analysis that starts with looking at gaps between ideal and real performance. Where are we lacking? Then, for any particular gap, we look for the root cause: is it a lack of skill, lack of knowledge, lack of resources, lack of motivation, … ? This up front work keeps us from using training to address a misalignment between incentives and desired behavior, for instance. Training isn’t going to keep people from doing things that are in their best interest! (And rightly so.)

Then, when we identify the root cause, we can target the appropriate intervention. Not all interventions may be within L&D’s purview, of course. We design courses. We could also be the ones who design performance support and facilitate informal learning (who better?). Of course, we shouldn’t be responsible for hiring or resourcing or compensation; at least not without a job description and skilling rethink. Our organizations deserve to invest in things that will move important needles.

This all is a shift to a focus on performance, on doing, not learning. While there are a variety of terms, this, to me, falls under the label ‘performance consulting’. It starts by asking “what should people be doing?” With the caveat that they aren’t doing now, or are doing wrongly. Then we ask “why?” Finally, we’re ready to design a solution. We’re focusing on outcomes. If it’s skills, it has to be in the head; and learning’s involved. If it’s knowledge, if it has to be in the head, learning can be involved, otherwise we should put it in the world. And so on.

My intent here is to suggest focusing on performance, not learning or knowing. That makes a better focus for investment, and is easier to recognize when it’s been remedied. So, what to do? Focus on performance first. Determine if a learning solution is your best choice, before you invest in it. Otherwise, you could be throwing money away. If you’ve got money to throw away, I can help ;), but I’d rather help you use it wisely.

The Learning Development Accelerator is running a mini-conference on performance consulting. It’s four half-days of immersion in the topics, with some of the top folks in the field. All with the usual focus on evidence-based practices. If you want to start doing L&D right, it’s a good start! 

A step backward?

14 February 2023 by Clark Leave a Comment

In working with colleagues about redesigning design (our goal is better incorporating learning science into practices), I had a realization. I frequently see in practice, and it’s pretty much the orientation of the tools, that we work forwards. That is, we start at the beginning, work our way forward through content and practice, and end at, well, the end. While this may make sense from a workflow perspective, there’s a fundamental flaw. So I think it’s time we take a step backward.

Once we’ve done the analysis, and put our goal in mind, it can seem reasonable to move forward, through the various steps. It’s one way to create a coherent experience. However, there’s a flaw with this. For one, it takes our eye off the ball. That is, what’s core is what our performers come out able to do. Getting lost in the flow of experience may lead us astray. For another, it’s assuming we’ll get it right the first time. That’s a mistake.

You can start at either of two places to see an alternative. For one, as McTighe and Wiggins have advocated in Understanding by Design, they focus on the outcomes first and work backwards. For another, modern successors to older design practices – Michael Allen’s Successive Approximations Model (SAM), Megan Torrance’s Lot Like Agile Management Approach (LLAMA), Cathy Moore’s Action Mapping, and David Merrill’s Pebble in the Pond, for some prominent examples – all start designing from the practice first. They iterate on the practice with testing, while working backwards to necessary prerequisite problems, until you get to where your audience starts.

This is both pragmatic and principled. On principle, you work backwards from the core problem. This keeps you aligned with the outcome. Then you supplement with the minimal material to help performers succeed. This includes examples, models, etc. Then, like with a proper paper, you write the introduction and closing last. Pragmatically, this keeps the focus on the critical parts, and ensures you’re focusing your valuable time honing the most important elements first.

It’s easy (trust me, I fall prey to this too) to work forward. Still, it’s smarter to take a step backward and work that way. If you want an impact. Which, I suspect, you do. Or you should, eh?

It’s complex

7 February 2023 by Clark Leave a Comment

In a recent conversation, I was talking about good design. Someone asked a question, and I elaborated that there was more to consider. Pressed again, I expanded yet more. I realized that when talking good learning design, it’s complex. However, knowing how it’s complex is a first step. Also, there are good guidelines. Still, we will have to test.

I’m not alone in suggesting that, arguably, the most complex thing in the known universe is the human brain. I jokingly ask whether bullet points are going to lead to sustained changes in behavior in such a complex organism? Yet, I also tout learning science design principles that help us. Is there a resolution?

The complexity comes from a number of different issues. For one, the type, quantity, challenge, and timing of practice depends on multiple factors. Things that can play a role include how complex the task is, how frequently it’s performed, and how important the consequences are. Similarly, the nature of the topic, whether it’s evolutionarily primary or secondary can also have an influence. The audience, of course, makes a difference, as does the context of practice. Addressing the ‘conative’ element – motivation, anxiety, confidence – also require some consideration.That’s a lot of factors!

Yet, we know what makes good practice, and we can make initial estimates of how much we need. Likewise, we can choose a suite of contexts to be covered to support appropriate transfer. We have processes as well as principles to assist us in making an initial design.

Importantly, we should not assume that the first design is sufficient. We do, unfortunately, and wrongly. Owing to the complexity of items identified previously, even with great principles and practices, we should expect that we’ll need to tune the experience. We need to prototype, test, and refine. We also need to build that testing into our timelines and budgets.

There is good guidance about testing, as well. We know we should focus on practice first, using the lowest technology possible. We should test early and often. Just as we have design guidance, these are practices that we know assist in iterating to a sufficient solution. Similarly, we know enough that it shouldn’t take much tuning since we should be starting from a good basis.

Using the cognitive and learning sciences, we have good bases to start from on the way to successful performance interventions. We have practices that address our limitations as designers, and the necessities for tuning. We do have to put these in practice in our planning, resourcing, and executing. Yet we can create successful initiatives reliably and repeatedly if we follow what’s known, including tuning. It’s complex, but it’s doable. That’s the knowledge we need to acknowledge, and ensure we possess and apply.

« Previous Page
Next Page »

Clark Quinn

The Company

Search

Feedblitz (email) signup

Never miss a post
Your email address:*
Please wait...
Please enter all required fields Click to hide
Correct invalid entries Click to hide

Pages

  • About Learnlets and Quinnovation

The Serious eLearning Manifesto

Manifesto badge

Categories

  • design
  • games
  • meta-learning
  • mindmap
  • mobile
  • social
  • strategy
  • technology
  • Uncategorized
  • virtual worlds

License

Previous Posts

  • May 2025
  • April 2025
  • March 2025
  • February 2025
  • January 2025
  • December 2024
  • November 2024
  • October 2024
  • September 2024
  • August 2024
  • July 2024
  • June 2024
  • May 2024
  • April 2024
  • March 2024
  • February 2024
  • January 2024
  • December 2023
  • November 2023
  • October 2023
  • September 2023
  • August 2023
  • July 2023
  • June 2023
  • May 2023
  • April 2023
  • March 2023
  • February 2023
  • January 2023
  • December 2022
  • November 2022
  • October 2022
  • September 2022
  • August 2022
  • July 2022
  • June 2022
  • May 2022
  • April 2022
  • March 2022
  • February 2022
  • January 2022
  • December 2021
  • November 2021
  • October 2021
  • September 2021
  • August 2021
  • July 2021
  • June 2021
  • May 2021
  • April 2021
  • March 2021
  • February 2021
  • January 2021
  • December 2020
  • November 2020
  • October 2020
  • September 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • April 2020
  • March 2020
  • February 2020
  • January 2020
  • December 2019
  • November 2019
  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • January 2019
  • December 2018
  • November 2018
  • October 2018
  • September 2018
  • August 2018
  • July 2018
  • June 2018
  • May 2018
  • April 2018
  • March 2018
  • February 2018
  • January 2018
  • December 2017
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • July 2017
  • June 2017
  • May 2017
  • April 2017
  • March 2017
  • February 2017
  • January 2017
  • December 2016
  • November 2016
  • October 2016
  • September 2016
  • August 2016
  • July 2016
  • June 2016
  • May 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • December 2015
  • November 2015
  • October 2015
  • September 2015
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • March 2015
  • February 2015
  • January 2015
  • December 2014
  • November 2014
  • October 2014
  • September 2014
  • August 2014
  • July 2014
  • June 2014
  • May 2014
  • April 2014
  • March 2014
  • February 2014
  • January 2014
  • December 2013
  • November 2013
  • October 2013
  • September 2013
  • August 2013
  • July 2013
  • June 2013
  • May 2013
  • April 2013
  • March 2013
  • February 2013
  • January 2013
  • December 2012
  • November 2012
  • October 2012
  • September 2012
  • August 2012
  • July 2012
  • June 2012
  • May 2012
  • April 2012
  • March 2012
  • February 2012
  • January 2012
  • December 2011
  • November 2011
  • October 2011
  • September 2011
  • August 2011
  • July 2011
  • June 2011
  • May 2011
  • April 2011
  • March 2011
  • February 2011
  • January 2011
  • December 2010
  • November 2010
  • October 2010
  • September 2010
  • August 2010
  • July 2010
  • June 2010
  • May 2010
  • April 2010
  • March 2010
  • February 2010
  • January 2010
  • December 2009
  • November 2009
  • October 2009
  • September 2009
  • August 2009
  • July 2009
  • June 2009
  • May 2009
  • April 2009
  • March 2009
  • February 2009
  • January 2009
  • December 2008
  • November 2008
  • October 2008
  • September 2008
  • August 2008
  • July 2008
  • June 2008
  • May 2008
  • April 2008
  • March 2008
  • February 2008
  • January 2008
  • December 2007
  • November 2007
  • October 2007
  • September 2007
  • August 2007
  • July 2007
  • June 2007
  • May 2007
  • April 2007
  • March 2007
  • February 2007
  • January 2007
  • December 2006
  • November 2006
  • October 2006
  • September 2006
  • August 2006
  • July 2006
  • June 2006
  • May 2006
  • April 2006
  • March 2006
  • February 2006
  • January 2006

Amazon Affiliate

Required to announce that, as an Amazon Associate, I earn from qualifying purchases. Mostly book links. Full disclosure.

We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.Ok