Learnlets

Secondary

Clark Quinn’s Learnings about Learning

Archives for February 2022

Good and bad advice all in one!

by 2 Comments

I was asked to go to read an article and weigh in. First, please don’t do this if you don’t know me. However, that’s not the topic here, instead, I want to comment on the article. Realize that if you ask me to read an article, you’re opening yourself up to my opinion, good  or bad. This one’s interesting, because it’s both. Then the question is how do you deal with good and bad advice all in one.

This article is about microlearning. If you’ve been paying attention (and there’s no reason you should be), I’ve gone off on the term before. I think it’s used loosely, and that’s a problem because there are separate meanings, which require separate designs, and not distinguishing them means it’s not clear you know what you’re talking about. (If someone uses the term, I’m liable to ask which they mean! You might do the same.).

This article starts out saying that 3-5 minute videos are  not  microlearning. I have to agree with that. However, the author then goes on to document 15 points that are important about microlearning. I’ll give credit for the admission that there’s no claim that this a necessary and complete set. Then, unfortunately, I also have to remove credit for providing no data to  support the claims!  Thus, we have to evaluate each on it’s own merits.  Sorry, but I kinda prefer some sort of evidence, rather than a ‘self-evident’ fallback.

For instance, there’s a claim for brevity. I’ve liked the admonition (e.g. by JD Dillon) that microlearning should be no longer, and no shorter, than necessary. However, there’s also a claim here that it should be “3 – 10 minutes of attention span”. Why? What determines this? Human attention is complex, and we can disappear into novels, or films, or games, for hours. Yes, “Time for learning is a critical derailer”, but…it’s a factor of how important, complex, and costly if wrong the topic is. There’s no one magic guideline.

The advice continues in this frame: there’re calls for simplicity, minimalism, etc. Most of these are good principles,  when appropriately constrained. However, arbitrary calls for “one concept at a time is the golden rule”  isn’t necessarily right, and isn’t based on anything other than “our brains need time for processing”. Yes, that’s what automation is about, but to build chunks for short term memory, we have to activate things in juxtaposition. Is that one concept? It’s too vague.

However, it could be tolerated if some of the advice didn’t fall prey to fallacious reasoning. So, for instance, the call for gamification leans into “Millennials and Gen Z workforce” claims. This is a myth. Gamification itself is already dubious, and using a bad basis as an assumed foundation exacerbates the problem.  There are other problems as well. For one, automatically assuming social is useful is a mistake. Tying competition into the need to compete is a facile suggestion. Using terms like ‘horde’ and ‘herd’ actually feels demeaning to the value of community. A bald statement like “Numbers speak louder than words!” similarly seems to suggest that marketing trumps matter. I don’t agree.

Overall, this article is a mixed bag. So then the question arises, how do you rate it? What do you do? Obviously, I had to take it apart. The desire for a comment isn’t sufficient to address a complex suite of decent principles mixed up with bad advice and justified (if at all) on false premises. I have to say that this isn’t worth your time. There’s better advice to be had, including on microlearning. In general, I’ll suggest that if there’s good and bad advice all in one, it’s overall bad. Caveat emptor!

Generic Thinking Skills?

by 3 Comments

Recently, a colleague asked a few of us about our views on critical thinking skills. This is actually a contentious topic. There are broad claims of the need for them, increasingly, even showing up in job advertisements. On the other hand, researchers and others have weighed in against them, saying that expertise is the only lever. I tend to lump critical thinking skills in with the broader issue of generic thinking skills, so what are the issues?

Upfront, I’ll admit that I like the concept of generic thinking skills. Say, for instance,  learning-to-learn skills. That is, domain independent skills that lead to better approaches. It seems to make sense that, in the absence of specific knowledge, some general approaches are more useful than others. For instance, faced with a new domain, I’d be inclined to expect that systematic experimentation and observation would be better than random trial and error.

On the other hand, prominent psychologists like John Sweller and Paul Kirschner have said that domain-specific skills are the only way to bet. There is significant evidence that expertise matters in successful approaches to problem-solving, and others. While we have some innate skills for domains that are biologically primary, learning in other domains requires expertise.

Is there, then, any evidence for generic skills? Based on Micki Chi’s work on the value of self-explanation, Kate Bielaczyc and others have found that instruction on systematically explaining steps in examples help, across domains. In my own Ph.D. thesis, I trained folks on analogical reasoning skills, and found improvement (for component skills that weren’t a) already ceilinged or b) were perceived to be immutable, across different problem types.

How, then, do we reconcile these conflicting viewpoints? My (self- :) explanation is that it’s a matter of degree, a continuum rather than a dichotomy. The more domain knowledge you possess, the more likely you are to find a good answer. However, what if you’re in a new domain where you don’t have relevant expertise to hand? In that case, I’ll suggest that there are benefits to some approaches over others, and training those general skills is justifiable. That is, general skills are weaker than domain specific skills, but general skills are better than nothing!

We know that there are practices that improve outcomes. For instance, I’ve written about how to, and not to, do brainstorming. Similarly, I believe Harold Jarche’s Seek-Sense-Share model works across domains. Systematic creativity is  not an oxymoron!  That’s the story I’m holding on to about generic thinking skills. What are your thoughts on the topic?

Accreditation?

by 1 Comment

As occasionally happens, I was asked a question on LinkedIn. In this case, it was about my thoughts on accreditation. Also, as occasionally happens, I thought that I’d share my thoughts in this forum, and look for feedback to improve my thinking. So here’re some thoughts on accreditation. I welcome yours!

First, let’s be clear, I am not an expert on accreditation. I haven’t accredited anything, for one ;). I  did look into it, at one point many years ago. I’ve also served on independent board of directors or advisory boards for several entities. In the former case, we have a legal responsibility to provide guidance. In the latter case, we provide the best guidance, but of course the organization isn’t obliged to comply. The former, in particular, serves as a quality check, or a form of accreditation.

When I looked into accreditation for educational institutions, the requirement isn’t about the actual curriculum, but instead that there is a library and that there are processes for review and revision of course offerings. That is, it was about the support for learning and quality processes, not the actual offering. This creates a process support that should ensure quality, yet also the ability to apply this to institutions with a wide variety of offerings.

Institutions can also seek accreditation by organizations in particular areas of curriculum. Offerings in computer science, business, and others for instance, receive review and then can receive approval by bodies that represent the particular field. This depends on the quality of the organization doing the accreditation and their processes, of course.

There’s also accreditation on the quality of the educational process. You can also be reviewed and accredited on the basis of your pedagogy, for instance your online teaching approach. It depends, of course, on what they stipulate as quality, but that’s always going to be the case.

There are, of course, dubious accreditations. It’s not unknown for an organization or collection thereof to establish their own accrediting body that basically rubber stamps the organization(s). Caveat emptor.

In general, I think that having a scrutable external validation is a good check on quality. Whether that makes sense is probably an issue of scope. A small offering of a particular course might benefit from an independent advisory board, which provides some oversight. The larger the organization and the scope of activity, the greater the need for some external validity check.

From the other side, I think a certificate or credentials help the learner signify what they’ve accomplished.  However, without accreditation or at least a scrutable process, how do you know the skill/knowledge is appropriate and accurate? I think accreditation has the potential to be a ‘reality check’ on any offering.

Learning or Performance Strategy

by 1 Comment

Of late, I’m working in a couple of engagements where the issue of learning and performance strategy have come up. It has prompted some thoughts both on my part and the part of my clients. I think it’s worth laying out some of the issues and thinking, and of course I welcome your thoughts. So here are some reflections on whether to use learning or performance strategy as an organizing concept.

In one case, an organization decreed that they needed a learning strategy. Taken with my backwards design diagram  from the learning science book, I was tasked with determining what that means. In this case, the audience can’t be mandated with classes or tutorials. So really, the only options are to support performance in the moment and develop them over time. Thus we focus on job aids and examples. I think of it as a ‘performance strategy’, not a learning one.

In the other case, an organization is executing on a shift from a training philosophy to a performance focus. Which of course I laud, but the powers-that-be expect it to yield less training without much other change. Here I’m pushing for performance support, and the thinking is largely welcome. However, it’s a mindset shift for a group that previous was developing training.

I general, I support thinking that goes beyond the course, and for the optimal execution side of a full ecosystem, you want to look at outcomes and let that drive you. It includes performance consulting, so you’re applying the  right solution to performance gaps, not the convenient one (read: ‘courses’ ;). Thus, I think it makes more sense to talk performance strategy than learning one.

Even then, the question becomes what does such a strategy really entail, whether learning  or performance. Really, it’s about having a plan in place to systematically prioritize needs and address them in effective ways. It’s not  just design processes that reflect evidence-informed principles, though it includes that. It’s also, however, ways to identify and track problems, attach organizational costs and solution costs, and choose where to invest resources. It includes front-end analysis, but also ongoing-monitoring.

It also involves other elements. For one, the technology to hand; what solutions are in use and ensuring a process of ongoing reviews. This includes both formal learning tools including the LMS and LXP, but also informal learning tools such as social media platforms and collaborative documents. Another issue is management: lifecycle monitoring, ownership, and costs.

There’s a lot that goes into it, but being strategic about your approach keeps you from just being tactical and missing the forest for the trees. A lot of L&D is reactive, and I am suggesting that L&D needs to be come proactive. This includes going from courses to performance, as a first step. The next step is to facilitating informal learning and driving innovation in the organization. Associated elements include meaningful measurement  and truly understanding how we learn for a firm basis upon which to ground both formal  and informal learning. Those are my thoughts a learning or performance strategy, what am I missing?