Learnlets

Secondary

Clark Quinn’s Learnings about Learning

The illusion of (my) competency

13 May 2025 by Clark 2 Comments

I have a cobbled together tech environment. My monitor and printer are years old, and my laptop is relatively new. To make them fit together, particularly with the limited ports of a laptop, I’ve a hub. And, now a few weeks ago, things went wonky. In weird ways. And I still don’t know it all, but there are some lessons here, not least the illusion of (my) competency. We all have travails, but this one has some lessons.

So, the first symptom was my microphone suddenly not working. I’d gotten a reasonable one, but it died (and apparently wasn’t good enough anyway), so my co-director in the LDA, Matt Richter, got me a nice one. It was this fancy, heavy one, that stopped working. It’s USB, so has LEDs, which are blue normally but green when in use. Except what happened was that when I wanted to use it, it started not working and blinking between blue and green. Hold that thought.

Then, the camera in my monitor stopped working. I have one in my laptop that’s better/newer, but it’s a bit away (I prefer to work on the big monitor, of course). I use the laptop camera when I want to look impressive and show my book case beside me ;). But I prefer the monitor camera for work meetings and the like. Yet, I couldn’t. Now hold that thought, too!

The icing on the proverbial cake came when my backup drive stopped backing up. It would start, and say it was finding probs, but then would time out with an error. I tried to run diagnostics, which said it was corrupt. I also got SMART results saying it was fine. All very confused.

Finally, I decided I had to contact Apple (fortunately Matt’s also insisted I keep up my service plan). After a lot of shenanigans that I won’t bore you with, the question came: is my hub powered? As it was, the answer’s no. If memory serves (dodgy proposition), I got it for free when Amazon was experimenting with providing things to people who wrote reviews. Which would be a weird issue, as I’d been using it for several years this way.

Still, went and ordered a powered hub. Then ordered another, realizing I wanted the faster version. BTW, I had to pick up both, because the other was fulfilled before I got the second, and the solution seemed to be that I picked up both and returned the first. Which took an extra 5 minutes, apparently to defend against fraud. Why we can’t have nice things…(Lesson: allow people to cancel orders via chat or online, don’t make them come in, take and immediately return).

While I was dealing with the hub, I decided to call the maker of the microphone (remember?). I’d called them before and left a message, and also emailed, to no reply. (Lesson: return your customer queries.) I was leaving a voicemail when I got a call from them, so I switched. It turns out that the blinking means the mic’s muted. There’s a knob on the back that’s ‘gain’, BUT it turns out it’s also a button, and if you push it, it mutes the mic. Now, I’d gone to the site and the mic instructions, and it doesn’t talk about that at all! I mentioned it to the person on the phone, and they said that they’d tried to get it changed, to no avail. (Lesson: put all the information about operation in the <expletive deleted> documents!) Problem fixed.

Then, when I installed the powered hub, the video camera in the monitor started working again. It’s not clear why it suddenly stopped, but…it was fixed. The lesson here, and for me (tho’ feel free to take it to heart), is probably never to trust an unpowered hub to be sufficient. However, and in my defense, it had been working for months if not years. (And, if you could’ve told me that, I don’t want to hear it.)

Finally, we get back to the drive. The powered hub didn’t fix it. I spent an unreasonable amount of time trying to run diagnostics, both Apple’s and the manufacturers. Finally, I delisted it from the backup software, erased it, then reintroduced it. And, voila’, it’s working! Not sure what the problem was. (Lesson: provide more feedback to the user on what’s going on.)

As a weird aside, I asked for a support call, but when it came it shut off my wifi calling. I live in a slight depression and have a bad signal, so I use wifi. But by turning it off, they ensured that the call would get dropped. I can’t imagine why they would do such a thing, but I’ve had real trouble getting calls from them, and this time just happened to see that the wifi calling had stopped at the time of the call. I had to use chat. Very puzzling and unresolved.

All told, this took way too much time, and while I learned one lesson, there was too much the result of bad design, not incompetence. As Don Norman said in The Design of Everyday Things, if it’s difficult to use, blame the designer, not the user. We know how to do better, we just don’t do it frequently enough. (I also recommend Kathy Sierra’s Badass as a guiding light.) I’m willing to assume responsibility for my culpability, and admit to the illusion of (my) competency. But I also recognize that I’m not stupid, and better design would’ve limited my frustrations and time wasting.

Locus of intelligence

6 May 2025 by Clark 1 Comment

I’m not a curmudgeon, or even anti-AI (artificial intelligence). To the contrary! Yet, I find myself in a bit of a rebellion in this ‘generative‘ AI era. And I’m wondering why. The hype, of course, bugs me. But it occurs to me that a core problem may reside in where we put the locus of intelligence. Let me try to make it clear.

In the early days of the computer (even before my time!), the commands were to load memory into registers, conduct boolean operations on them, and to display the results. The commands to do so were at the machine level. We went a level above with a translation of that machine instructions into somewhat more comprehensible terms, assembly language. As we went along, we went more and more to putting the onus on the machine. This was because we had more processor cycles, better software etc. We’re largely to the point where we can stipulate what we want, and the machine will code it!

There are limits. When Apple released the Newton, they tried to put the onus on the machine to read human writing. In short, it didn’t work. Palm’s Pilots succeeded because Jeff Hawkins went for Graffiti as the language, which shared the responsibility between person and processor. Nowadays we can do speech and text recognition, but there are still limitations. Yes, we have made advances in technology, but some of it’s done by distributing to non-local machines, and there are still instances where it fails.

I think of this when I think of prompt engineering. We’ve trained LLMs with vast quantities of information. But, to get it out, you have to ask in the right way! Which seems like a case of having us adapt to the system instead of vice versa. You have to give them heaps more context than a person would need, and they still can hallucinate.

I’m reminded of a fictional exchange I recently read (of course I can’t find it now), where the AI user is being advised to know the domain before asking the AI. When the user queries why they would need the AI if they know the domain, they’re told they’re training the AI!

As people investigate AI usage, one of the results is that your initial intelligence indicates how much use you’ll get out of this version of AI. If you’re already a critical thinker, it’s a good augment. If you’re not, it doesn’t help (and may hinder).

Sure, I have problems with the business models (much not being accounted for: environmental cost, IP licensing, security, VC boosting). But I’m more worried about people depending too much on these systems without truly understanding what the limitations are. The responsible folks I know advocating for AI always suggest having a person in the loop. Which is problematic if you’re giving such systems agency; it’ll be too late if they do something wrong!

I think experimenting is fine. I think it’s also still too early to place a bet on a long-term relationship with any provider. I’m seeing more and more AI tools, e.g. content recommenders, simulation avatars, and the like. Like with the LMS, when anyone who could program a database would build one, I’m seeing everyone wanting to get in on the goldrush. I fear that many will end up losing their shirts. Which is, I suppose, the way of the world.

I continue to be a big fan of augmenting ourselves with technology. I still think we need to consider AI a tool, not a partner. It’s nowhere near being our intellectual equal. It may know more, but it still has limitations overall. I want to develop, and celebrate our intelligence. I laud our partnership with technologies that augment what we do well with what we don’t. It’s why mobile became so big, why AI has already been beneficial, and why generative AI will find its place. It’s just that we can’t allow the hype to blind us to the real locus of intelligence: us.

Applied learning science

18 March 2025 by Clark Leave a Comment

One of my favorite things to do is to help people apply the cognitive and learning sciences (under realistic constraints). That can be to their practices, processes, or products, via consulting, workshops, writing, and more. One thing I’ve done over the past few years is doing this for a particular entity. I was found via a workshop, and ended up coming on as an advisor. They’re now about ready to go live, and it’s time for me to tell you what they’re doing, why, and how. So here’s an application of applied learning science.

It starts with a problem, as many good solutions do. The issue is that, in L&D, too often they’re delivering live sessions to address a particular situation. Whether someone’s said “we need a course on this”, or there’s been a deep analysis, at some point they’ve pulled people together. It could be a day, several days in a row, or even spaced out every other week, every month, what have you. And, we know, that by and large, this isn’t going to lead to change!

Research on learning tells us, quite strongly, that to achieve a persistent new ability to ‘do’, we need to strengthen the learning over time. New information gets forgotten after only a day or two, according to the forgetting curve! So, we need to reactivate the learning. That can be reconceptualization, recontextualization, or reapplication. It can also be reflection, and even planning, and evaluation.

However, it’s been tough to do this reactivation. It typically requires finagling, and faces objections; not just the learners, but also the stakeholders! Such interventions need to be small but effective. That’s what this solution does. Other approaches have been tried, and some other solutions do exist, but this one has a couple of advantages. For one, a clear focus. It’s not doing other things, except reactivating learning.

Ok, one other thing, it’s also collecting data. Too often,  there’s no way to know if it learning’s effective. Even if there’s intent, it’s hard to get approval. So, this solution not only reactivates learning as mentioned, it tracks the responses. In practical ways.

What’s been my role? That’s the other thing; we’re applying this in ways that reflect what learning science tells us. Ok, we have to make some inferences, that we’re testing, but we’re starting from good principles. So, I’m advising on the spacing of the learning and the content of the reactivation. We call those prompts, that ask learners to respond. These prompts then gather into small chunks called LIFTs (Learning Interventions Fueling Transformation). (Everyone’s gotta have an acronym, after all, and this plays along with the company name, Elevator 9 ;).  The sequence of LIFTs makes a learning journey.

What’s important is how many we need, and how frequently we deliver them. It’s dependent on some factors, so we’re asking about those too: frequency of application, complexity, importance, and prior experience. Hopefully, in clear and useful ways.  They’re actively  looking for companies that are keen to help us refine this, too (in return for the usual considerations ;).

The end result is a product that easily supplements your live events. Your learners get reactivations, and you get data. Importantly, you get better outcomes from your interventions. This capability is possible, the goal is just to make it easy to do. Moreover, with a solution that not only embodies but shares the underlying learning science, improving you as it does your learners. Win-Win! I generally don’t tout solutions, but this one has actively put learning science (tempered by reality, to be sure) at the forefront. Applied learning science, and technology, the way it ought to be done. It’s been an honor to work with them!

Getting smarter

14 January 2025 by Clark Leave a Comment

A number of years ago now, I analyzed the corporate market for a particular approach. Not normally something I do (not a tool/market analyst), but at the time it made sense. My recommendation, at the end of the day, was the market wasn’t ready for the product. I am inclined to think that the answer would be different today. Maybe we are getting smarter?

First, why me? A couple of reasons. For one, I’m independent. You (should) know that you’ll get an unbiased (expert) opinion. Second, this product was something quite closely related to things I do know about, that is, learning experiences that are educationally sound. Third, the asker was not only a well-known proponent of quality learning, but knew I was also a fan of the work. So, while I’m not an analyst, few same would’ve really understood the product’s value proposition, and I do know the tools market at a useful level. I knew there was nothing else on the market like it, and the things that were closest I also knew (from my authoring simulation games work, as in my first book, and the research reports for the Learning Guild).

The product itself allowed you to author deep learning experiences. That is, where you immerse yourself in authentic tasks, with expert support and feedback. Learning tasks that align with performance tasks are the best practice environments, and in this case were augmented with resources available at the point of need. The main problem was that they required an understanding of deep learning to be able to successfully author. In many cases, the company ended up doing the design despite offering workshops about the underlying principles. Similarly, the industrial-strength branching simulation tools I knew then struggled to survive.

And that was my reason, then, to suggest that the market wasn’t ready. I didn’t think enough corporate trainers, let alone the managers and funding decision-makers, would get the value proposition. There still are many who are ‘accidental’ instructional designers, and more so then. The question, then, is whether such a tool could now succeed. And I’m more positive now.

I think we are seeing greater interest in learning science. The big societies have put it on their roadmaps, and our own little LDA learning science conference was well received. Similarly, we’re seeing more books on learning science (including my own), and more attention to same.  I think more folks are looking for tools that make it easy to do the right thing. Yes, we’re also confronting the AI hype, but I think after the backlash we’ll start thinking again about good, not just cheap and fast. I not only hope, but I think there’s evidence we are getting smarter and more focused on quality. Fingers crossed!

Taking a higher perspective

12 November 2024 by Clark Leave a Comment

A number of years ago, I did some consulting to a training organization. The issue was that they didn’t seem to have a sustained relationship with their folks. And, this has seemed to me like an obvious and solvable problem. However, I may be missing something, so perhaps you can help me in taking a higher perspective.

In the particular instance, they provided training in particular areas. That is, folks would attend their courses and then, at least theoretically, be able to perform in new ways. Yet, they felt that folks didn’t necessarily sustain allegiance to them nor their offerings.

I asked what else they offered.  From the perspective of a performer, I’m not there to learn! Instead, I’m there to acquire new skills so I can perform better. And, if we take to heart what performance consulting has to say, there’re also resources such as job aids. These lead to success where learning isn’t even necessary. There’s more, too.

We can go further, of course. What about community? If you’re focused on a particular area of performance, would it make sense to be connected to others in the same endeavor? I’ll suggest that it’s likely. As folks develop in ability, they need to start interacting with others.

This organization wasn’t alone, of course. I’ve engaged with a number of organizations over the years that faced the same issue. (Whether they knew it or not.) In fact, I suspect it’s more prevalent that we agree. Particularly in this era of information available online, how do you generate a sustained relationship?

It seems to me that if we’re taking a higher perspective, we’ll realize that courses are just a component of a full development ecosystem. Of course, there are lots of issues involved: finding ways to curate or create all the elements, content management, platform choice and integration, and more. Still, this seems to me to be at least part of the answer. So, what am I missing?

 

What L&D resources do we use?

29 October 2024 by Clark 1 Comment

This isn’t a rhetorical question. I truly do want to hear your thoughts on the necessary resources needed to successfully execute our L&D responsibilities. Note that by resources in this particular case, I’m not talking: courses, e.g. skill development, nor community. I’m specifically asking about the information resources, such as overviews, and in particular tools, we use to do our job. So I’m asking: what L&D resources do we need?

A diagram with spaces for strategy, analysis, design, development, evaluation, implementation, evaluation, as well as topics of interest. Elements that can be considered to be included include tools, information resources, overviews, and diagrams. There are some examples populating the spaces.I’m not going to ask this cold, of course. I’ve thought about it a bit myself, creating an initial framework (click on the image to see it larger). Ironically, considering my stance, it’s based around ADDIE. That’s because I believe the elements are right, just that it’s not a good basis for a design process. However, I do think we may need different tools for the stages of analysis, design, development, implementation, and evaluation, even if don’t invoke them in a waterfall process. I also have categories for overarching strategy, and for specific learning topics. These are spaces in which resources can reside.

There are also several different types of resources I’ve created categories for. One is an overview of the particular spaces I indicate above. Another are for information resources, that drill into a particular approach or more. These can be in any format: text or video typically. Because I’m weird for diagrams, I have them separately, but they’d likely be a type of info resource. Importantly, one is tools. Here I’m thinking performance support tools we use: templates, checklists, decision trees, lookup tables. These are the things I’m a bit focused on.

Of course, this is for evidence-based practices. There are plenty of extant frameworks that are convenient, and cited, but not well-grounded. I am looking for those tools you use to accomplish meaningful solutions to real problems that you trust. I’m looking for the ones you use. The ones that provide support for excellent execution. In addition to the things listed above, how about processes? Frameworks? Models? What enables you to be successful?

Obviously, but importantly, this isn”t done! That is, I put my first best thoughts out there, but I know that there’s much more. More will come to me (already has, I’ve already revised the diagram a couple of times), but I’m hoping more will come from you too. That includes the types of resources, spaces, as well as particular instances.

The goal is to think about the resources we have and use. I welcome you putting in, via comments on the blog or wherever you see this post, and let me know which ones you find to be essential to successful execution. I’d really like to know what L&D resources do we use. Please take a minute or two and weigh in with your top and essential tools. Thanks!

Top 10 Tools for Learning 2024

27 August 2024 by Clark 2 Comments

Once again, the inimitable Jane Hart is running her Top 10 Tools for Learning survey. The insights are valuable, not least because it points out how much of our learning comes from other than formal learning. So, here are my Top 10 Tools for Learning 2024, in no particular order:

Google Docs. I write, a lot. And, increasingly, I want others to weigh in. I am cranky that I have to choose a tool instead of just going to one place to collaborate,  and I struggle with the file structure of Drive, but the feature set within Docs is good enough to support collaborative writing. And collaborative work in general is something I strongly advocate for. Collective intelligence, as Nigel Paine refers to it. For myself, however, – articles, books –  I still use…

Microsoft Word. I’m not a big fan of the parent company (they have glommed on to the current plan for subscriptions, which makes financial sense but is a bad customer experience), and it’s not the writing tool that Scrivener is, but I’m so familiar with it (started using circa 1988) and the outlining is industrial strength (a feature I love and need). It’s the start of most of my writing.

Apple Freeform.  I still use Omnigraffle, but I’m keen to support free tools, and this one’s proprietary format isn’t any worse than any others. I could use Google Draw, I suppose, particularly when collaborating, but somehow folks don’t seem to collaborate as much around diagrams. Hmm…

WordPress. This is the tool I use to write these blog posts. It’s a way for me to organize my thinking. Yes, it’s writing too, but it’s for different types of writing (shorter, more ‘in the moment’ thoughts). While the comments here are fewer, they still do come. Announcements get auto-posted to LinkedIn, Mastodon, & Bluesky.

LinkedIn. This is where I get more comments than, these days, I do on my blog. Plus, we use it to write and talk about the Learning Development Accelerator and Elevator 9. I follow some folks, and connect with lots. It remains my primary business networking tool. Feel free to connect with me (if you’re in L&D strategy ;).

Mastodon & Bluesky. Yes, this counts as two, but I use them very similarly. Since the demise of Twitter (eX), I’ve looked for an alternative, and regularly stay with these two. They’re (slightly) different; Mastodon seems a bit more thoughtful, Bluesky is more dynamic, but they’re both ways to stay in touch with what people are thinking, largely outside the L&D space. Still haven’t found all my peeps there, but I’m Quinnovator (of course) on both.

News Apps/Sites. I’m also learning via news apps, again staying up with what’s happening in the larger world. So, I get Yahoo News because one email is there. Also, I check some sites regularly: ABC (Australia, not US), BBC, and Apple News (because it’s on my iPad). I’m counting this as one because otherwise it’d overwhelm my count.

Apple Mail. I subscribe to a few newsletters, mostly on learning science, and some blogs. They come in email (directly or via Feedblitz). This is all part of Harold Jarche’s Personal Knowledge Mastery elements of Seek – Sense – Share, and these are updated regularly but are part of the seek. Some of the writing I do is the sharing. Making sense is the above writing, diagramming, and…

Apple Keynote. Creating presentations for webinars, workshops, speaking engagements such as keynotes, and the like is another way I make sense of the world. So, having a good tool to create them is critical, and Keynote works more the way I think than PowerPoint does.

So that’s it, my 10. It may not work for Jane’s categorization (sorry!), but it captures the way I think about it. Please do share yours, too! (There are more ways than writing a post, so find the one that works for you.)

 

Reflecting on adaptive learning technology

11 June 2024 by Clark 1 Comment

My last real job before becoming independent (long story ;) was leading a team developing an adaptive learning platform. The underlying proposition was the basis for a topic I identified as one of my themes. Thinking about it in the current context I realize that there’re some new twists. So here I’m reflecting on adaptive learning technology.

So, my premise for the past couple of decades is to decouple what learners see from how it’s delivered. That is, have discreet learning ‘objects’, and then pull them together to create the experience. I’ve argued elsewhere that the right granularity was by learning role: concepts are separate from examples, from practice, etc. (I had team members participating in the standards process.) The adaptive platform was going to use these learning objects to customize the sequence for different learners. This was both within a particular learning objective, and across a map of the entire task hierarchy.

The way the platform was going to operate was typical in intelligent tutoring systems, with a twist. We had a model of the learner, and a model of the pedagogy, but not an explicit model of expertise. Instead, the expertise was intrinsic to the task hierarchy. This was easier to develop, though unlikely to be as effective. Still, it was scalable, and using good learning science behind the programming, it should do a good job.

Moreover, we were going to then have machine learning, over time, improve the model. With enough people using the system, we would be able to collect data to refine the parameters of the teaching model. We could possibly be collecting valuable learning science evidence as well.

One of the barriers was developing content to our specific model. Yet I believed then, and still now, that if you developed it to a standard, it should be interoperable. (We’re glossing over lots of other inside arguments, such as whether smart object or smart system, how to add parameters, etc.) That was decades ago, and our approach was blindsided by politics and greed (long sordid story best regaled privately over libations). While subsequent systems have used a similar approach (*cough* Knewton *cough*), there’s not an open market, nor does SCORM or xAPI specifically provide the necessary standard.

Artificial intelligence (AI) has changed over time. While evolutionary, it appears revolutionary in what we’ve seen recently. Is there anything there for our purposes? I want to suggest no. Tom Reamy, author of Deep Text, argues that hybrids of symbolic and sub-symbolic AI (generative AI is an instance of the latter) have potential, and that’s what we were doing. Systems trained on the internet or other corpuses of images and/or text aren’t going to provide the necessary guidance. If you had a sufficient quantity of data about learning experiences with the characteristics of your own system, you could do it, but if it exists it’s proprietary.

For adaptive learning about tasks (not knowledge; a performance focus means we’re talking about ‘do’, not know), you need to focus on tasks. That isn’t something AI really understands, as it doesn’t really have a way to comprehend context. You can tell it, but it also doesn’t necessarily know learning science either (ChatGPT can still promote learning styles!). And, I don’t think we have enough training data to train a machine learning system to do a good job of adapting learning. I suppose you could use learning science to generate a training set, but why? Why not just embed it in rules, and have the rules work to generate recommendations (part of our algorithm was a way to handle this)? And, as said, once you start running you will eventually have enough data to start tuning the rules.

Look, I can see using generative AI to provide text, or images, but not sequencing, at least not without a rich model. Can AI generate adaptive plans? I’m skeptical. It can do it for knowledge, for sure, generating a semantic tree. However, I don’t yet see how it can decide what application of that knowledge means, systematically. Happy to be wrong, but until I’m presented with a mechanism, I’m sticking to explicit learning rules. So, where am I wrong?

About my books

21 May 2024 by Clark 2 Comments

My booksSo, I’ve written about writing books, what makes a good book, and updated on mine (now a bit out of date). I thought it was maybe time to lay out their gestation and raison d’être. (I was also interviewed for a podcast, vidcast really, recently on the four newest, which brought back memories.) So here’re some brief thoughts on my books.

My first book, Engaging Learning came from the fact that a) I’d designed and developed a lot of learning games, and b) had been an academic and reflected and written on the principles and process. Thus, it made sense to write it. Plus, a) I was an independent and it seemed like a good idea, and b) the publisher wanted one (the time was right). In it, I laid out some principles for learning, engagement, and the intersection. Then I laid out a systematic process, and closed with some thoughts on the future. Like all my books, I tried to focus on the cognitive principles and not the technology (which was then and continues to change rapidly). It went out of print, but I got the rights back and have rereleased it (with a new cover) for cheap on Amazon.

I wanted to write what became my fourth book as the next screed. However, my publisher wanted a book on mobile (market timing). Basically, they said I could do the next one if I did this first. I had been involved in mlearning courtesy of Judy Brown and David Metcalfe, but I thought they should write it. Judy declined, and David reminded me that he had written one. Still I and my publisher thought there was room for a different perspective, and I wrote Designing mLearning. I recognized that the way we use mobile doesn’t mesh well with ‘courses on a phone’, and instead framed several categories of how we could use them. I reckon those categories are still relevant as ways to think about technology!  Again, republished by me.

Before I could get to the next book, I was asked by one of their other brands if I could write a mobile book for higher education. The original promise was that it’d be just a rewrite of the previous, and we allocated a month. Hah! I did deliver a manuscript, but asked them not to publish it. We agreed to try again, and The Mobile Academy was the result. It looks at different ways mobile can augment university actions, with supporting the classroom as only one facet. This too was out of print but I’ve republished.

Finally, I could write the book I thought the industry needed, Revolutionize Learning & Development. Inspired by Marc Rosenberg’s Beyond eLearning and Jay Cross’s Informal Learning, this book synthesizes a performance and technology-enabled push for an ecosystem perspective. It may have been ahead of its time, but it’s still in print. More importantly, I believe it’s still relevant and even more pressing! Other books have complemented the message, but I still think it’s worth a read. Ok, so I’m biased, but I still hear good feedback ;). My editor suggested ATD as a co-publisher, and I was impressed with their work on marketing (long story).

Based upon the successes of those books (I like to believe), and an obvious need in our field, ATD asked for a book on the myths that plague our industry. Here I thought Will Thalheimer, having started the Debunkers Club, would be a better choice. He, however, declined, thinking it probably wasn’t a good business decision (which is likely true; not much call for keynotes or consulting on myths). So, I researched and wrote Millennials, Goldfish & Other Training Misconceptions. In it, I talked about 16 myths (disproved beliefs), 5 superstitions (things folks won’t admit to but emerge anyways) and 16 misconceptions (love/hate things). For each, I tried to lay out the appeal and the reality. I suggest what to do instead, for the bad practices. For the misconceptions, I try to identify when they make sense.  In all cases I didn’t put down exhaustive references, but instead the most indicative. ATD did a great job with the book design, having an artist take my intro comic ideas for each and illustrating them, and making a memorable cover. (They even submitted it to a design competition, where it came close to winning!)

After the success of that tome, ATD came back and wanted a book on learning science. They’d previously asked me to edit the definitive tome, and while it was appealing, I didn’t want to herd cats. Despite their assurances, I declined. This, however, could be my own simple digest, so I agreed. Thus, Learning Science for Instructional Designers emerged. There are other books with different approaches that are good, but I do think I’ve managed to make salient the critical points from learning science that impact our designs. Frankly, I think it goes beyond instructional designers (really, parents, teachers, relatives, mentors and coaches, even yourself are designing instruction), but they convinced me to stick with the title.

Now, I view Learning Experience Design as the elegant integration of learning science with engagement. My learning science book, along with others, does a good job of laying out the first part. But I felt that, other than game design books (including mine!), there wasn’t enough on the engagement side. So, I wanted a complement to that last book (though it can augment others). I wrote Make It Meaningful as that complement. In it, I resurrected the framework from my first book, but use it to go across learning design. (Really, games are just good practice, but there are other elements). I also updated my thinking since then, talking about both the initial hook and maintaining engagement through to the end. I present both principles and practical tips, and talk about the impact on your standard learning elements. In an addition I think is important, I also talk about how to take your usual design process, and incorporate the necessary steps to create experiences, not just instruction. I do want you to create transformational experiences!

So, that’s where I’m at. You can see my recommended readings here (which likely needs an update.) Some times people ask “what’s your next book”, and my true answer at this point is “I don’t know.”  Suggestions? Something that I’m qualified to write about, that there’s not already enough out about, and it’s a pressing need? I welcome your thoughts!

Impactful decisions

2 April 2024 by Clark 1 Comment

I’ve been talking about impact in a variety of ways, and have also posited that decisions are key. I really haven’t put them together, so perhaps it’s time ;). So here’re some thoughts on impactful decisions.

To start with, I’ve suggested that what will make a difference to orgs, going forward (particularly in this age of genAI), is the ability to make better decisions. That is, either ones we’re not making right now, or new ones we need to be able to make.  When we’re moving away from us doing knowledge tasks (e.g. remembering arbitrary bits of information), our value is going to be in pattern-matching and meaning-making. When faced with a customer’s problems, we’ll  need to match it to a solution. We need to look at a market, and discern new products and approaches. As new technologies emerge, we’ll have to discern the possibilities. What makes us special is the ability to apply frameworks or models to situations despite the varying contexts. That’s making decisions.

To do this, there are several steps. What are the situations and decisions that need to be made? We should automate rote decisions. So then we’ll be dealing with recognizing situations, determining models, using them to make predictions of consequences, and choose the right one. We need to figure out what those situations are, the barriers to success, and figuring out what can be in the world, and what needs to be in the head. Or, for that matter, what we can solve in another way!

We also need to determine how we’ll know when we’ve succeeded. That is, what’s the observable measure that says we’re doing it right. It frequently can be triggered by a gap in performance. It’s more than “our sales aren’t up to scratch”, but specifics: time to close? success rate? Similarly for errors, or customer service ratings, etc. It needs to be tangible and concrete.  Or it can be a new performance we need. However, we need some way to know what the level is now and what it should be, so we can work to address it.

I note that it may feel ephemeral: “we need more innovation”, or “we need greater collaboration”, or… Still, these can be broken down. Are people feeling safe? Are they sharing progress? Is constructive feedback being shared? Are they collaborating? There are metrics we can see around these components, and they may not be exhaustive, but they’re indicative.

Then, we need to design to develop those capabilities. We should be designing the complements to our brain, and then developing our learning interventions. Doing it right is important! That means using models (see above) and examples (models in context), and then appropriate practice, with all the nuances: context, challenge, spacing, variation, feedback…  So, first the analysis, then the design. Then…

The final component is evaluation. We first need to see if people are able to make these decisions appropriately, then whether they’re doing so, and whether that’s leading to the needed change. We need to be measuring to see if we’re getting things right after our intervention, it’s translating to the workplace, and leading to the necessary change.

When we put these together, in alignment, we get measurable improvement. That’s what we want, making impactful decisions. Don’t trust to chance, do it by design!

Next Page »

Clark Quinn

The Company

Search

Feedblitz (email) signup

Never miss a post
Your email address:*
Please wait...
Please enter all required fields Click to hide
Correct invalid entries Click to hide

Pages

  • About Learnlets and Quinnovation

The Serious eLearning Manifesto

Manifesto badge

Categories

  • design
  • games
  • meta-learning
  • mindmap
  • mobile
  • social
  • strategy
  • technology
  • Uncategorized
  • virtual worlds

License

Previous Posts

  • May 2025
  • April 2025
  • March 2025
  • February 2025
  • January 2025
  • December 2024
  • November 2024
  • October 2024
  • September 2024
  • August 2024
  • July 2024
  • June 2024
  • May 2024
  • April 2024
  • March 2024
  • February 2024
  • January 2024
  • December 2023
  • November 2023
  • October 2023
  • September 2023
  • August 2023
  • July 2023
  • June 2023
  • May 2023
  • April 2023
  • March 2023
  • February 2023
  • January 2023
  • December 2022
  • November 2022
  • October 2022
  • September 2022
  • August 2022
  • July 2022
  • June 2022
  • May 2022
  • April 2022
  • March 2022
  • February 2022
  • January 2022
  • December 2021
  • November 2021
  • October 2021
  • September 2021
  • August 2021
  • July 2021
  • June 2021
  • May 2021
  • April 2021
  • March 2021
  • February 2021
  • January 2021
  • December 2020
  • November 2020
  • October 2020
  • September 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • April 2020
  • March 2020
  • February 2020
  • January 2020
  • December 2019
  • November 2019
  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • January 2019
  • December 2018
  • November 2018
  • October 2018
  • September 2018
  • August 2018
  • July 2018
  • June 2018
  • May 2018
  • April 2018
  • March 2018
  • February 2018
  • January 2018
  • December 2017
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • July 2017
  • June 2017
  • May 2017
  • April 2017
  • March 2017
  • February 2017
  • January 2017
  • December 2016
  • November 2016
  • October 2016
  • September 2016
  • August 2016
  • July 2016
  • June 2016
  • May 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • December 2015
  • November 2015
  • October 2015
  • September 2015
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • March 2015
  • February 2015
  • January 2015
  • December 2014
  • November 2014
  • October 2014
  • September 2014
  • August 2014
  • July 2014
  • June 2014
  • May 2014
  • April 2014
  • March 2014
  • February 2014
  • January 2014
  • December 2013
  • November 2013
  • October 2013
  • September 2013
  • August 2013
  • July 2013
  • June 2013
  • May 2013
  • April 2013
  • March 2013
  • February 2013
  • January 2013
  • December 2012
  • November 2012
  • October 2012
  • September 2012
  • August 2012
  • July 2012
  • June 2012
  • May 2012
  • April 2012
  • March 2012
  • February 2012
  • January 2012
  • December 2011
  • November 2011
  • October 2011
  • September 2011
  • August 2011
  • July 2011
  • June 2011
  • May 2011
  • April 2011
  • March 2011
  • February 2011
  • January 2011
  • December 2010
  • November 2010
  • October 2010
  • September 2010
  • August 2010
  • July 2010
  • June 2010
  • May 2010
  • April 2010
  • March 2010
  • February 2010
  • January 2010
  • December 2009
  • November 2009
  • October 2009
  • September 2009
  • August 2009
  • July 2009
  • June 2009
  • May 2009
  • April 2009
  • March 2009
  • February 2009
  • January 2009
  • December 2008
  • November 2008
  • October 2008
  • September 2008
  • August 2008
  • July 2008
  • June 2008
  • May 2008
  • April 2008
  • March 2008
  • February 2008
  • January 2008
  • December 2007
  • November 2007
  • October 2007
  • September 2007
  • August 2007
  • July 2007
  • June 2007
  • May 2007
  • April 2007
  • March 2007
  • February 2007
  • January 2007
  • December 2006
  • November 2006
  • October 2006
  • September 2006
  • August 2006
  • July 2006
  • June 2006
  • May 2006
  • April 2006
  • March 2006
  • February 2006
  • January 2006

Amazon Affiliate

Required to announce that, as an Amazon Associate, I earn from qualifying purchases. Mostly book links. Full disclosure.

We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.Ok