Learnlets

Secondary

Clark Quinn’s Learnings about Learning

Engineering solutions

by 1 Comment

Every once in a while, I wonder what I’m doing (ok, not so infrequently ;). And it’s easy to think it’s about applying what’s known about learning to the design of solutions. However, it’s more. It is about applying science results to designing improvements, but, it’s broader than learning, and not just individual. Here are some reflections on engineering solutions.

As I’ve probably regaled you with before, I was designing and programming educational computer games, and asking questions like “should we use spacebar and return, or number keys to navigate through menus?” (This was a long time ago.) I came across an article that argued for ‘cognitive engineering’, applying what we knew about how we think to the design of systems. Innately I understood that this also applied to the design of learning. I ended up studying with the author of the article, getting a grounding in what was, effectively, ‘applied cognitive science’.

Now, my focus on games has been on them as learning solutions, and that includes scenarios and simulation-driven experiences. But, when looking for solutions, I realize that learning isn’t always the answer. Many times, for instance, we are better off with ‘distributed‘ cognition. That is, putting the answer in the world instead of in our heads. This is broader than learning, and invokes cognitive science. Also, quite frankly, many problems are just based in bad interface designs!  Thus, we can’t stop at learning. We truly are more about performance than learning.

In a sense, we’re engineers; applying learning and cognitive science to the design of solutions, (just as chemical engineering is about applying chemistry). Interestingly, the term learning engineering has another definition. This one talks about using the benefits of engineering approaches, such as data, and technology-at-scale, to design solutions. For instance, making adaptive systems requires integrating content management, artificial intelligence, learning design, and more.

Historically, our initial efforts in technology-facilitated learning did take teams. The technology wasn’t advanced enough, and it took learning designers, software engineers, interface designers and more to generate solutions like Plato, intelligent tutoring systems, and the like.  I’ve argued that Web 1.0 took the integration of the tech, content design, and more, which usually was more than one person could handle. Now, we’ve created powerful tools that allow anyone to create content. Which may be a problem! The teams used to ensure quality. Hopefully, the shift back comes with a focus on process.

We can apply cognitive science to our own design processes. We’ve evolved many tools to support not making reliable mistakes: design processes, tools like checklists, etc. I’ll suggest that moving to tools that make it easy to produce content haven’t been scaffolded with support to do the right thing. (In fact, good design makes it hard to do bad things, but our authoring tools have been almost the opposite!)  There’s some hope that the additional complexity will focus us back on quality instead of being a tool for quantity. I’m not completely optimistic in the short term, but eventually we may find that tools that let us focus on knowledge aren’t the answer.

I’m thinking we will start looking at how we can use tools to help us do good design. You know the old engineering mantra: good, fast, and cheap, pick 2. Well, I am always on about ‘good’. How do we make that an ongoing factor? Can we put in constraints so it’s hard to do bad design? Hmm… An interesting premise that I’ve just now resurrected for myself. (One more reason to blog!) What’re your thoughts?

 

Why DEI?

by 1 Comment

At the event I attended a bit ago, one of the discussions was on Diversity, Equity, and Inclusion (DEI). I attended, to hear what was up. There were discussions of how to instigate DEI, but one thing I felt was missing, so of course I chimed in at the end. Actually, I learned something else as well, so that’s worth reciting to. So, why DEI?

There are, of course, lots of good reasons. For one, the privileges I’ve had haven’t been shared. Folks often come from less opportune backgrounds than others have had the advantage of. Moreover, such advantage hasn’t been accounted for before they get to work. Unfortunately, schools and social welfare haven’t adequately addressed this We have racism, and misogyny, and other forms of discrimination to deal with. ‘Us against them’ isn’t a healthy perspective. However, perhaps you wonder, why should organizations be a source of remedy?

My argument it pretty simple, really. Research says that we get better results when we have diversity in looking for solutions. There’s a pretty simple explanation why, too. What we’re doing, when looking for answers (research, design, trouble-shooting) is searching a potential solution space. It’s easy to not explore thoroughly. I’ve talked about brainstorming, for instance, as something we can do badly or well. That’s about process. But there’s more.

Garvin, Edmondson, & Gino wrote about learning organization dimensions, and one of the four aspects of a supportive learning environment was “appreciation of differences”. I want to emphasize it’s not ‘tolerating diversity’, it’s valuing it! In exploring that space of solutions, the more diversity in the group, the more likely we are to cover a big range. (There’re caveats, of course, particularly that all have to share a commitment to finding an answer.) Homogeneity is the enemy here!

Of course, this means equity in treatment, and inclusion. If you’re excluding people, you’re not taking advantage of diversity. If you’re not promoting equity, the injustices perpetuate. The only good way to get people to feel good about diversity if it is equitable and inclusive.

Interestingly, one of the hosts mentioned that there’s separate evidence of value. This was something I hadn’t heard. Apparently, having more diversity in the room makes people more diverse in their thinking. That is, even before getting people to generate ideas, people’s attitudes are more diverse because of the observed variety. I haven’t been able to confirm this, but I have no reason not to believe it, and it’s an interesting (and valuable) result.

Now, as said, there are lots of good reasons. But one that is very pragmatic is that you get better solutions when different viewpoints are incorporated. We should be looking at complementary and varied viewpoints. That involves bringing different people together that have something to offer, and just being different is one! Celebrate that!

So, that’s why DEI in my mind; done right, the outcome is better!  Overall, we fare better when we work in the ways that align with how our brains operate. That’s alone and together. Let’s do the best for us and our organizations.

Domain-independent coaching?

by Leave a Comment

At an event this past week, I sat in on a discussion of coaching. Asking folks what coaching was, there were lots of responses about ‘establishing rapport’, ‘asking questions’, etc. I admit I was a wee bit curious amongst all this, thinking about specifics. Which prompted some reflections. My question is about whether there can be domain-independent coaching.

To start, I was thinking about how to develop people just after a learning ‘event’ or experience. They’ve been developed to a certain level, and then we’d like to continue their development. To do so, I thought feedback would be useful, and specifically tying the learning to any relevant task, and providing feedback to fine-tune their performance. Specifically, this requires knowing the domain they’re learning about, observing their performance (in some way), and identifying ways in which they went right, or wrong. That, in my mind, requires specific knowledge about how the mental models play out in context. This, for example, is what we see in sports coaching.

As context, I remember talking to a very smart individual who runs a business that does coaching as a service, at scale. To do this, they have to have folks who know coaching, but pragmatically can’t necessarily know the domain. I was curious how this could work, but empirically it does. Coupled with the responses of folks around the table, I had to reconcile my specifics with a more general approach.  How can this work?

Of course, I started thinking about the trajectory of learners. They start as novices in any particular domain, then proceed to become practitioners, and can become experts. As they progress, they need less specifics. If you look at situated leadership as a model, you go from providing direction and support, to eventually removing the (domain-specific) direction, then the support, as they become capable. Thus, coaching can move to asking about how they’re feeling about it, and to apply their own knowledge to the situation. That is, you can start asking about the process and their thoughts rather than focusing on specifics.

Of course, to me, if you apply the domain-independent coaching at the wrong time, you can delay (or extinguish) their development. On the other hand, continuing with micromanaging performance can be similarly restricting. So, I reckon you can shift to domain-independent coaching, after you have developed a minimum viable level of capability.  That’s my reconciliation; what’re your thoughts?

We can be logical

by Leave a Comment

So, I’ve been on a bit of a crusade saying we’re not formal logical reasoning beings. And, I do think it’s important to emphasize this in the face of some legacy beliefs. On the other hand, I think there’s evidence that we can be logical. So, how do we reconcile this?

The reason I push against a belief that we’re logical is that too often we are designing as if that’s the case. We see it in way too many policies, practices, and the like. Yet, as has been documented, that’s not our default.

On the other hand, we can be effective reasoners. We have created complex mathematics, advanced science, and generally improved our situation. Something is going on. But what?

Well, Kahneman talks about how we, effectively, have two systems, fast and slow. The slow one takes cognitive effort, so we tend to avoid it. The fast one, then, is default. It’s based upon instinct. Which can be good in two situations: one, where our instincts are likely to be right (e.g. dealing with biologically primary information) or where we have expertise. It can also be bad, where we use it inappropriately.

On the other hand, we can use the slow route. It’s hard, but it works.  This is where we reason things out. (We have to be careful, because being hard, we can depend on it inappropriately.) We can use cognitive support, and complementary skills, but we can document the situation, explore alternatives, trial solutions, and reason our way to good decisions.

And we should! Frankly, I’d rather have in office a policy wonk building coalitions of expertise than a solitary ‘profile’ claiming solutions across the board. I want evidence-based approaches, not simplistic and wrong answers to complex problems!

So, we can be formal logical reasoning beings. Under the right circumstances, with the right support. We should automate what we can so we build the necessary expertise, and provide the conditions for good decisions. That can sometimes be fast, and sometimes be slow, but better to be right than to be expedient. Not perfect, of course, but I’m suggesting we err on the side of likelihood.

That’s my view, at any rate. We can be logical, and that’s a matter of design. We should evaluate and optimize situations so we get the best decisions. That recognizes when training is helpful, when performance support can be used, and when we should support good innovation (problem-solving, research, design, etc). So let’s take a healthy informed look at how we make decisions, and increase the likelihood of good ones. That’s my decision, at any rate. What’s yours?

Do you feel lucky?

by Leave a Comment

roulette wheelOne of the things that I feel is undervalued is the role of luck. We hear about how the successful – the winners in business – get that way by virtue of their intelligence and diligence. Yet, if you think about it, lots of folks are smart and work hard. Yet not all succeed. Which made me wonder just how much of success is luck. I asked Siri (I was on a walk) and got the link to an article where they actually researched this. As to the answer, do you feel lucky?

The article starts with a suite of evidence. I know I’m mighty lucky to have been born as a white male in California, had both parents, was able to secure a really good education, and more. The data says that all these things are boons to the likelihood of success. There were also all sorts of weird variations (including middle initials contributes to success?).

Further, the article reports on how two researchers ran some simulations. They had characters with varying degrees of ‘talent’, and then also some good and bad luck. What happened, of course, is that the folks with a combination of luck and ‘talent’, did best. Talent alone didn’t do it, nor luck. In fact, the most talented didn’t succeed the most. “The most successful agents tended to be those who were only slightly above average in talent but with a lot of luck in their lives.”

The research goes further. It’s typical, in academia, that folks who get grants then are more likely to get subsequent grants. Which, it turns out, isn’t the best option. A different simulation by other researchers suggested random was better!  And, arguably, the best policy was giving everyone the same amount!

When we take this back to the real world, what seems to be important is that luck plays a big role in success. Those folks at the very top appear to have been very lucky. Further, their future success isn’t guaranteed (note that currently there’s a prime example of over-valuing previous success). If you’re smart, and dedicated, you’re more likely to do well, but you can also be subject to the slings and arrows of fortune which can similarly contribute.

I think we should be wary of rewarding past success with greater opportunity. We should also be wary of any assessment of how smart someone must be, just because they are successful. There are a lot of factors that contribute to success (for instance, research suggests, that being taller and having a deeper voice, increases the likelihood of doing well in business). They do say luck favors the prepared mind, so do work hard. But you’re also dependent on the vicissitudes of fate. Do you feel lucky?

For ‘normals’

by 5 Comments

So, I generally advocate for evidence-based practices. And, I realized, I do this with some prejudice. Which isn’t my intent! So, I was reflecting on what affects such decisions, and I realized that perhaps I need a qualification. When I state my prescriptions then, I might have to add “for ‘normals'”.

First, I have to be careful. What do I mean by ‘normal’? I personally believe we’re all on continua on many factors. We may not cross the line to actively qualify as obsessive-compulsive, or attention-deficit, or sensorily-limited. Yet we’re all somewhere on these dimensions. Some of us cross some or more of those lines (if we’re ever even measured; they didn’t have some of these tests when I was growing up). So, for me, ‘normal’ are folks who don’t cross those lines, or cope well enough. Another way to say it is ‘neurotypical’ (thanks, Declan).

What prompted this, amongst other things, is a colleague who insisted that learning styles did matter. In her case, she couldn’t learn unless it was audio, at least at first. Now, the science doesn’t support learning styles. However, if you’re visually-challenged (e.g. legally blind), you really can’t be a visual learner. I had another colleague who insisted she didn’t dream in images, but instead in audio. I do think there are biases to particular media that can be less or more extreme. Of course, I do think you probably can’t learn to ride a bicycle without some kinesthetic elements, just as learning music pretty much requires audio.

Now, Todd Rose, in his book The End of Average, makes the case that no one is average. That is, we all vary. He tells a lovely story about how an airplane cockpit carefully designed to be the exact average actually fit no one! So, making statements about the average may be problematic. While we’ve had it in classrooms, now we also have the ability to work beyond a ‘one-size fits all’ response online. We can adapt based upon the learner.

Still, we need to have a baseline. The more we know about the audience, the better a job we can do. (What they did with cockpits is make them adjustable. Then, some people still won’t fit, at least not without extra accommodation)  That said, we will need to design for the ‘normal’ audience. We should, of course, also do what we can to make the content accessible to all (that covers a wide swath by the way). And, while I assume it’s understood, let me be explicit here that I am talking “for ‘normals'”. We should ensure, however, that we’re accommodating everyone possible.

Facilitating in the dark

by 1 Comment

I recently spoke to the International Association of Facilitators – India, having chosen to focus on transfer. My intent was for them to be thinking about ensuring that the skills they facilitate get applied when useful. My preparation was, apparently, insufficient, leaving me to discover something mid-talk. Which leads me to reflecting on facilitating in the dark.

So, I’m not a trained facilitator (nor designer, nor trainer, nor coach). While I’ve done most of this (with generally good results),I’m guided by the learning science behind whatever. So, in this case, I thought they were facilitating learning by either serving as trainers or coaches. Imagine my surprise when I found out that they largely facilitate without knowing the topic!

In general, to create learning experiences, we need good performance objectives. From there, we design the practice, and then align everything else to succeed on the final practice. We also (should) design the extension of the learning to coaching past any formal instruction, and generally ensuring that the impact isn’t undermined.

How, then, do you get models, examples, and provide feedback on practice if you don’t know the domain? What they said was that they were taking it from the learners themselves. They would get the learners together and facilitate them into helping each other, largely. This included creating an appropriate space.

To me, then, there are some additional things that need to be done. (And I’m not arguing they don’t do this.) You need to get the learners to:

  • articulate the models
  • provide examples
  • ensure that they articulate the underlying thinking
  • think about how to unpack the nuances
  • ensure sufficient coverage of contexts
  • provide feedback on others’ experiences

This is in addition to creating a safe space, opening and closing the experience, etc.

So it caused me to think about when this can happen. I really can’t see this happening for novices. They don’t know the frameworks and don’t have the experience. They need formal instruction. Once learners have had some introduction and practice, however, this sort of facilitation could work. It may be a substitute for a community of practice that might naturally provide this context. You’d just be creating the safe space in the facilitation instead of the community.

The necessary skills to do this well, to be agile enough mentally to balance all these tasks, even with a process, is impressive.  I did ask whether they ended up working in particular verticals, because it does seem like even if you came in facilitating in the dark, you couldn’t help learn while doing the facilitation. There did seem to be some agreement.

Overall, while I prefer people with domain knowledge doing facilitation, I can see this. At least, if the community can’t do it itself. We don’t share enough about learning to learn, and we could. I do think a role for L&D is to spread the abilities to learn, so that more folks can do it more effectively. The late Jay Cross believed this might be the best investment a company could make!

Nonetheless, while facilitating in the dark may not be optimal, it may be useful. And that, of course, is really the litmus test. So it was another learning opportunity for me, and hopefully for them too!

 

Myths are models

by 4 Comments

A recent LinkedIn post talked about how models are good, but myths are bad. Which was a realization for me. I’ve kept myths and models largely separate in my mind, but I realize that’s not the case. Myths are models, just wrong ones. And, I suppose, we need to deal with them as such. (Also, folks hang on to myths and models if they’re tied up with identity, but we should still be able to deal with the logical rationale.)

So, I’m an advocate for mental models. There are a variety of reasons, personal, pragmatic, and principled. Personally, I was gifted a book on mental models by my workmates as I left for graduate school. Pragmatically, they’re useful. On principle, they’re how we reason about the world. Heck, our brains are constantly building them!

The important aspects of models are that they’re predictive (and explanatory). That is, they tell us the outcomes of actions in particular situations. They are models of a small bit of the world, and are used to understand a perturbation of the model. They’re causal, in that they talk about how the world works, and conceptual in that they talk about the elements of the world. They’re incomplete, in that they only need to account for the parts of the world relevant to the particular situation.

Examples include using an analogy of water flowing in pipes for thinking about electric circuits. Or how advertisements use association with valued things or people to induce a positive affect. You can use them to explain what happened, or what will happen. It’s the latter that’s important for the purposes of providing a basis for guiding decisions, and thus their role in learning.  They guide us in deciding how to take actions under different circumstances.

Models can be good or bad. The old ‘planets circling a sun’ model of electrons in orbit around a nucleus of protons and neutrons turned out to be inaccurate as our understanding increased. We then moved to probability clouds as a better model. Many of our mistakes come from using the wrong model, for a variety of reasons. We can mistake the situation, or think a model is accurate and useful.

We should avoid models that aren’t appropriate for the situation. Myths are models that aren’t appropriate for any situation. So, for instance, learning styles, generations, ‘attention span of a goldfish’, and ‘images are processed 60K faster than prose’ are examples of myths. They lead people to make decisions that are erroneous, such as providing different learning prescriptions. They are models, because they do categorize the world and lead to prescriptions about what to do. They’re myths, because their implications will lead to decisions that waste time and money.

As the saying goes, “all models are wrong, but some are useful”. They’re wrong because they’re only part of the world. The good ones give us useful predictions, The bad ones lead us to make bad decisions. The useful ones are to be lauded, shared, and used. Myths, however, should be debunked and avoided. Myths are models, but not all models are good. It’s important that I remember that!

Valuing Diversity

by Leave a Comment

My lass has us engaging us in an activity. Being in it has sparked a recognition that’s not new, but continues to be important, particularly in the global context! I frequently talk about how diversity is important in getting the best ideas. Moreover, it’s not just ‘tolerating’ it, but valuing diversity. Why?

So the activity is choosing music that matches a theme. Everyone (in this case m’lady, and two offspring), submits four songs to a theme, and then when all are in, you vote. Not on yours, of course! For us, it’s not about who ‘wins’ so much as it’s about exposure to different music.

When we’re evaluating them is when I get a particular reaction. I typically realize “Oh, that reminds me of this other song, and I wish I’d thought of it as a candidate.”  What’s happening is that being exposed to other ideas expands my own thinking. Which is, after all, one of the things that helps us find solutions. Finding more solutions is a step on the path to finding good solutions!

Globally, I’ve heard of a country that is cracking down on diversity, trying to get everyone to adhere to the same world view. This includes diverse languages. Now, to be a country, I agree that there have to be some shared values. However, for the best opportunity for a country to succeed, tapping into the diversity of thoughts provides a greater likelihood of finding the best approaches. You risk stifling innovation to achieve stability, and that’s not a necessary tradeoff.

Diversity can be challenging. It means being able to accept other views, making it safe, and negotiating a shared understanding. On the flip side, that negotiated understanding is likely to be richer than what existed before. In the long term, that challenge leads to better outcomes.  Further, we can work together, when we follow what’s known.

So, if you want to get the best from your unit, whether business, organization, or society, you want to find ways to build diversity. And, then, find ways to use it, productively. We need more than acceptance, or tolerance. We need to be valuing diversity, and when we do, we do better.

Lazy thinking?

by 1 Comment

Now, I’m the last who should throw stones. I can be quite guilty of lazy thinking, particularly when there’re commercial decisions to be made. (Providers have done a fabulous job of making sure you can’t compare apples to apples, and when there’re so many such situations…) Yet, there’s one place where I struggle with the consequences. That’s in our professional field, and it seems like there’re too many opportunities to yield.

A trigger was a recent conversation where an individual was talking about generations. Grouping folks by when they’re born is problematic at best. For one, the boundaries used seem to vary by who’s doing the categorizing. Not a solid basis. Moreover, the research suggests that there really aren’t meaningful differences. What do exist are explainable by age differences (which isn’t the same thing, for one it’s a continuum, not discrete chunks). Really, it’s a mild form of age discrimination, differentiating people by when they’re born, not who they are or how they behave. (Also problematic is the notion that events affect certain segments of the population, but that’s a longer conversation).  It’s one of the myths in my book on same.

Other examples include learning styles, hemispheres, gender differences, and more. First, they’re categorizations on things that people can’t control. Second, they don’t get backing from data. I just read that medical science has been excluding women from research based upon an assumption about temperature variability that was exposed as being irrelevant!

Sure, it’s much easier if we can reliably group people into segments that mean we have a reliable basis to do different things. Marketers do this with psychographics, for instance. Demographics can also matter. The problem here is that we’re using unreliable metrics. First, there are assumptions that turn out to be flawed. They frequently use self-report, also problematic. Some also have a flawed theoretical foundation.

Yes, it’s hard to keep on top of all of this. Ideally, you’d have time to investigate them all. In practice, there are other things to do. We all need ways to simplify our lives. Plus, vendors are telling you that they, at least, are immune to the complaints (with self-interest at stake).  On the other hand, there are good sources of insight from reliable translators of research. There are also practices we can follow to make it manageable. More help is on the way (at the LDA we’re working on it; stay tuned).

While lazy thinking is understandable, it’s not acceptable, at least not in our professional field. While we may not be sued for malpractice, we certainly should be responsible. So let’s avoid taking the easy path, at least when it matters. In our professional capacity, it matters when we’re designing for our learners. Let’s do so on evidence, not assumptions.