Martin Weller talked about digital scholarship.
Reimagining Learning
On the way to the recent Up To All Of Us unconference (#utaou), I hadn’t planned a personal agenda. However, I was going through the diagrams that I’d created on my iPad, and discovered one that I’d frankly forgotten. Which was nice, because it allowed me to review it with fresh eyes, and it resonated. And I decided to put it out at the event to get feedback. Let me talk you through it, because I welcome your feedback too.
Up front, let me state at least part of the motivation. I’m trying to capture rethinking about education or formal learning. I’m tired of anything that allows folks to think knowledge dump and test is going to lead to meaningful change. I’m also trying to ‘think out loud’ for myself. And start getting more concrete about learning experience design.
Let me start with the second row from the top. I want to start thinking about a learning experience as a series of activities, not a progression of content. These can be a rich suite of things: engagement with a simulation, a group project, a museum visit, an interview, anything you might choose for an individual to engage in to further their learning. And, yes, it can include traditional things: e.g. read this chapter.
This, by the way, has a direct relation to Project Tin Can, a proposal to supersede SCORM, allowing a greater variety of activities: Actor – Verb – Object, or I – did – this. (For all I can recall, the origin of the diagram may have been an attempt to place Tin Can in a broad context!)
Around these activities, there are a couple of things. For one, content is accessed on the basis of the activities, not the other way around. Also, the activities produce products, and also reflections.
For the activities to be maximally valuable, they should produce output. A sim use could produce a track of the learner’s exploration. A group project could provide a documented solution, or a concept-expression video or performance. An interview could produce an audio recording. These products are portfolio items, going forward, and assessable items. The assessment could be self, peer, or mentor.
However, in the context of ‘make your thinking visible’ (aka ‘show your work’), there should also be reflections or cognitive annotations. The underlying thinking needs to be visible for inspection. This is also part of your portfolio, and assessable. This is where, however, the opportunity to really recognize where the learner is, or is not, getting the content, and detect opportunities for assistance.
The learner is driven to content resources (audios, videos, documents, etc) by meaningful activity. This in opposition to the notion that content dump happens before meaningful action. However, prior activities can ensure that learners are prepared to engage in the new activities.
The content could be pre-chosen, or the learners could be scaffolded in choosing appropriate materials. The latter is an opportunity for meta-learning. Similarly, the choice of product could be determined, or up to learner/group choice, and again an opportunity for learning cross-project skills. Helping learners create useful reflections is valuable (I recall guiding honours students to take credit for the work they’d done; they were blind to much of the own hard work they had put in!).
When I presented this to the groups, there were several questions asked via post-its on the picture I hand-drew. Let me address them here:
What scale are you thinking about?
This unpacks. What goes into activity design is a whole separate area. And learning experience design may well play a role beneath this level. However, the granularity of the activities is at issue. I think about this at several scales, from an individual lesson plan to a full curriculum. The choice of evaluation should be competency-based, assessed by rubrics, even jointly designed ones. There is a lot of depth that is linked to this.
How does this differ from a traditional performance-based learning model?
I hadn’t heard of performance-based learning. Looking it up, there seems considerable overlap. Also with outcome-based learning, problem-based learning, or service learning, and similarly Understanding By Design. It may not be more, I haven’t yet done the side-by-side. It’s scaling it up , and arguably a different lens, and maybe more, or not. Still, I’m trying to carry it to more places, and help provide ways to think anew about instruction and formal education.
An interesting aside, for me, is that this does segue to informal learning. That is, you, as an adult, choose certain activities to continue to develop your ability in certain areas. Taking this framework provides a reference for learners to take control of their own learning, and develop their ability to be better learners. Or so I would think, if done right. Imagine the right side of the diagram moving from mentor to learner control.
How much is algorithmic?
That really depends. Let me answer that in conjunction with this other comment:
Make a convert of this type of process out of a non-tech traditional process and tell that story…
I can’t do that now, but one of the attendees suggested this sounded a lot like what she did in traditional design education. The point is that this framework is independent of technology. You could be assigning studio and classroom and community projects, and getting back write-ups, performances, and more. No digital tech involved.
There are definite ways in which technology can assist: providing tools for content search, and product and reflection generation, but this is not about technology. You could be algorithmic in choosing from a suite of activities by a set of rules governing recommendations based upon learner performance, content available, etc. You could also be algorithmic in programming some feedback around tech-traversal. But that’s definitely not where I’m going right now.
Similarly, I’m going to answer two other questions together:
How can I look at the path others take? and How can I see how I am doing?
The portfolio is really the answer. You should be getting feedback on your products, and seeing others’ feedback (within limits). This is definitely not intended to be individual, but instead hopefully it could be in a group, or at least some of the activities would be (e.g. communing on blog posts, participating in a discussion forum, etc). In a tech-mediated environment, you could see others’ (anonymized) paths, access your feedback, and see traces of other’s trajectories.
The real question is: is this formulation useful? Does it give you a new and useful way of thinking about designing learning, and supporting learning?
70:20:10 Tech
At the recent Up To All Of Us event (#utaou), someone asked about the 70:20:10 model. As you might expect, I mentioned that it’s a framework for thinking about supporting people at work, but it also occurred to me that there might be a reason folks have not addressed the 90, because, in the past, there might have been little that they could do. But that’s changed.
In the past, other than courses, there was little at could be done except providing courses on how to coach, and making job aids. The technology wasn’t advanced enough. But that’s changed.
What has changed are several things. One is the rise of social networking tools: blogs, micro-blogs, wikis, and more. The other is the rise of mobile. Together, we can be supporting the 90 in fairly rich ways.
For the 20, coaching and mentoring, we can start delivering that wherever needed, via mobile. Learners can ask for, or even be provided, support more closely tied to their performance situations regardless of location. We can also have a richer suite of coaching and mentoring happening through Communities of Practice, where anyone can be a coach or mentor, and be developed in those roles, too. Learner activity can be tracked, as well, leaving traces for later review.
For the 70, we can first of all start providing rich job aids wherever and whenever, including a suite of troubleshooting information and even interactive wizards. We also can have help on tap freed of barriers of time and distance. We can look up information as well, if our portals are well-designed. And we can find people to help, whether information or collaboration.
The point is that we no longer have limits in the support we can provide, so we should stop having limits in the help we *do* provide.
Yes, other reasons could still also be that folks in the L&D unit know how to do courses, so that’s their hammer making everything look like a nail, or they don’t see it as their responsibility (to which I respond “Who else? Are you going to leave it to IT? Operations?”). That *has* to change. We can, and should, do more. Are you?
MOOC reflections
A recent phenomena is the MOOC, Massively Open Online Courses. I see two major manifestations: the type I have participated in briefly (mea culpa) as run by George Siemens, Stephen Downes, and co-conspirators, and the type being run by places like Stanford. Each share running large numbers of students, and laudable goals. Each also has flaws, in my mind, which illustrate some issues about education.
The Stanford model, as I understand it (and I haven’t taken one), features a rigorous curriculum of content and assessments, in technical fields like AI and programming. The goal is to ensure a high quality learning experience to anyone with sufficient technical ability and access to the Internet. Currently, the experience does support a discussion board, but otherwise the experience is, effectively, solo.
The connectivist MOOCs, on the other hand, are highly social. The learning comes from content presented by a lecturer, and then dialog via social media, where the contributions of the participants are shared. Assessment comes from participation and reflection, without explicit contextualized practice.
The downside of the latter is just that, with little direction, the courses really require effective self-learners. These courses assume that through the process, learners will develop learning skills, and the philosophical underpinning is that learning is about making the connections oneself. As was pointed out by Lisa Chamberlin and Tracy Parish in an article, this can be problematic. As of yet, I don’t think that effective self-learning skills is a safe assumption (and we do need to remedy).
The problem with the former is that learners are largely dependent on the instructors, and will end up with that understanding, that learners aren’t seeing how other learners conceptualize the information and consequently developing a richer understanding. You have to have really high quality materials, and highly targeted assessments. The success will live and die on the quality of the assessments, until the social aspect is engaged.
I was recently chided that the learning theories I subscribe to are somewhat dated, and guilty as charged; my grounding has taken a small hit by my not being solidly in the academic community of late. On the other hand, I have yet to see a theory that is as usefully integrative of cognitive and social learning theory as Cognitive Apprenticeship (and willing to be wrong), so I will continue to use (my somewhat adulterated version of) it until I am otherwise informed.
From the Cognitive Apprenticeship perspective, learners need motivating and meaningful tasks around which to organize their collective learning. I reckon more social interaction will be wrapped around the Stanford environment, and that either I’ve not experienced the formal version of the connectivist MOOCs, or learners will be expected to take on the responsibility to make it meaningful but will be scaffolded in that (if not already).
The upshot is that these are valuable initiatives from both pragmatic and principled perspectives, deepening our understanding while broadening educational reach. I look forward to seeing further developments.
Making it visible and viral
On a recent client engagement, the issue was spreading an important initiative through the organization. The challenges were numerous: getting consistent uptake across management and leadership, aligning across organizational units, and making the initiative seem important and yet also doable in a concrete way. Pockets of success were seen, and these are of interest.
For one, the particular unit had focused on making the initiative viral, and consequently had selected and trained appropriate representatives dispersed through their organization. These individuals were supported and empowered to incite change wherever appropriate. And they were seeing initial signs of success. The lesson here is that top down is not always sufficient, and that benevolent infiltration is a valuable addition.
The other involvement was also social, in that the approach was to make the outcomes of the initiative visible. In addition to mantras, graphs depicting status were placed in prominent places, showing current status. Further, suggestions for improvement were not only solicited, but made visible and their status tracked. Again, indicators were positive on these moves.
The point is that change is hard, and a variety of mechanisms may be appropriate. You need to understand not just what formal mechanisms you have, but also how people actually work. I think that too often, planning fails to anticipate the effects of inertia, ambivalence, and apathy. More emotional emphasis is needed, more direct connection to individual outcomes, and more digestion into manageable chunks. This is true for elearning, learning, and change.
In looking at attitude change, and from experience, I recognize that even if folks are committed to change, it can be easy to fall back into old habits without ongoing support. Confusion in message, lack of emotional appeal, and idiosyncratic leadership only reduce the likelihood. If it’s important, get alignment and sweat the details. If it’s not, why bother?
Social media budget line item?
Where does social media fit in the organization? In talking with a social media entrepreneur over beers the other day, he mentioned that one of his barriers in dealing with organizations was that they didn’t have a budget line for social media software.
That may sound trivial, but it’s actually a real issue in terms of freeing up the organization. In one instance, it had been the R&D organization that undertook the cost. In another case, the cost was attributed to the overhead incurred in dealing with a merger. These are expedient, but wrong.
It’s increasingly obvious that it’s more than just a ‘nice to have’. As I’ve mentioned previously, innovation is the only true differentiator. If that’s the case, then social media is critical. Why? Because the myth of individual innovation is busted, as clearly told by folks like Keith Sawyer and Steven Berlin Johnson. So, if it’s not individual, it’s social, and that means we need to facilitate conversations.
If we want people to be able to work together to create new innovations, we don’t want to leave it to chance. In addition to useful architectural efforts that facilitate in person interactions, we want to put in place the mechanisms to interact without barriers of time or distance. Which means, we need a social media system.
It’s pretty clear that if you align things appropriately: culture, vision, tools, that you get better outcomes. And, of course, culture isn’t a line item, and vision’s a leadership mandate. But tools, well, they are a product/service, and need resources.
Which brings us to the initial point: where does this responsibility lie? Despite my desire for folks who are most likely to understand facilitating learning (though that’s sadly unlikely in too many L& D departments), it could be IT, operations, or as mentioned above, R&D. The point is, this is arguably one of the most important investments in the organization, and typically not one of the most expensive (making it the best deal going!). Yet there’s not a unified obvious home!
There are worries if it’s IT. They are, or should be, great at maintaining network uptime, but don’t really understand learning. Nor do the other groups, and yet facilitating the discussion in the network is the most important external role. But who funds it?
Let’s be real; no one wants to have to own the cost when there’re other things they’re already doing. But I’d argue that it’s the best investment an L&D organization could make, as it will likely have the biggest impact on the organization. Well, if you really are looking to move needles on key business metrics. So, where do you think it could, and should reside?
Sharing Failure
I’ve earlier talked about the importance of failure in learning, and now it’s revealed that Apple’s leadership development program plays that up in a big way. There are risks in sharing, and rewards. And ways to do it better and worse.
In an article in Macrumors (obviously, an Apple info site), they detail part of Adam Lashinsky’s new Inside Apple book that reports on Apple executive development program. Steve Jobs hired a couple of biz school heavyweights to develop the program, and apparently “Wherever possible the cases shine a light on mishaps…”. They use examples from other companies, and importantly, Apple’s own missteps.
Companies that can’t learn from mistakes, their own and others’, are doomed to repeat them. In organizations where it’s not safe to share failures, where anything you say can and will be held against you, the same mistakes will keep getting made. I’ve worked with firms that have very smart people, but their culture is so aggressive that they can’t admit errors. As a consequence, the company continues to make them, and gets in it’s own way. However, you don’t want to celebrate failure, but you do want to tolerate it. What can you do?
I’ve heard a great solution. Many years ago now, at the event that led to Conner’s & Clawson’s Creating a Learning Culture, one small company shared their approach: they ring a bell not when the mistake is made, but when the lesson’s learned. They’re celebrating – and, importantly, sharing – the learning from the event. This is a beautiful idea, and a powerful opportunity to use social media when the message goes beyond a proximal group.
There’s a lot that goes on behind this, particularly in terms of having a culture where it’s safe to make mistakes Culture eats strategy for breakfast, as the saying goes.. What is a problem is making the same mistake, or dumb mistakes. How do you prevent the latter? By sharing your thinking, or thinking out loud, as you develop your planned steps.
Now, just getting people sharing isn’t necessarily sufficient. Just yesterday (as I write), Jane Bozarth pointed me towards an article in the New Yorker (at least the abstract thereof) that argues why brainstorming doesn’t work. I’ve said many times that the old adage “the room is smarter than the smartest person in the room” needs a caveat: if you manage the process right. There are empirical results that guide what works from what doesn’t, such as: having everyone think on their own first; then share; focus initially on divergence before convergence; make a culture where it’s safe, even encouraged, to have a diversity of viewpoints; etc.
No one says getting a collaborating community is easy, but like anything else, there are ways to do it, and do it right. And here too, you can learn from the mistakes of others…
Performance Architecture
I’ve been using the tag ‘learning experience design strategy’ as a way to think about not taking the same old approaches of events über ales. The fact of the matter is that we’ve quite a lot of models and resources to draw upon, and we need to rethink what we’re doing.
The problem is that it goes far beyond just a more enlightened instructional design, which of course we need. We need to think of content architectures, blends between formal and informal, contextual awareness, cross-platform delivery, and more. It involves technology systems, design processes, organizational change, and more. We also need to focus on the bigger picture.
Yet the vision driving this is, to me, truly inspiring: augmenting our performance in the moment and developing us over time in a seamless way, not in an idiosyncratic and unaligned way. And it is strategic, but I’m wondering if architecture doesn’t better capture the need for systems and processes as well as revised design.
This got triggered by an exercise I’m engaging in, thinking how to convey this. It’s something along the lines of:
The curriculum’s wrong:
- it’s not knowledge objectives, it’s skills
- it’s not current needs, it’s adapting to change
- it’s not about being smart, it’s about being wise
The pedagogy’s wrong:
- it’s not a flood, but a drip
- it’s not knowledge dump, it’s decision-making
- it’s not expert-mandated, instead it’s learner-engaging
- it’s not ‘away from work’, it’s in context
The performance model is wrong:
- it’s not all in the head, it’s distributed across tools and systems.
- it’s not all facts and skill, it’s motivation and confidence
- it’s not independent, it’s socially developed
- it’s not about doing things right, it’s about doing the right thing
The evaluation is wrong:
- it’s not seat time, it’s business outcomes
- it’s not efficiency, at least until it’s effective
- it’s not about normative-reference, it’s about criteria
So what does this look like in practice? I think it’s about a support system organized so that it recognizes what you’re trying to do, and provides possible help. On top of that, it’s about showing where the advice comes from, developing understanding as an additional light layer. Finally, on top of that, it’s about making performance visible and looking at the performance across the previous level, facilitating learning to learn. And, the underlying values are also made clear.
It doesn’t have to get all that right away. It can start with just better formal learning design, and a bit of content granularity. It certainly starts with social media involvement. And adapting the culture in the org to start developing meta-learning. But you want to have a vision of where you’re going.
And what does it take to get here? It needs a new design that starts from the performance gap and looks at root causes. The design process then onsiders what sort of experience would both achieve the end goal and the gaps in the performer equation (including both technology aids and knowledge and skill upgrades), and consider how that develops over time recognizing the capabilities of both humans and technology, with a value set that emphasis letting humans do the interesting work. It’ll also take models of content, users, context, and goals, with a content architecture and a flexible delivery model with rich pictures of what a learning experience might look like and what learning resources could be. And an implementation process that is agile, iterative, and reflective, with contextualized evaluation. At least, that sounds right to me.
Now, what sounds right to you: learning experience design strategy, performance system design, performance architecture, <your choice here>?
Further (slow) thoughts on learning #change11
I’ve been monitoring the comments on my #change11 posts, and rather than address them individually, I’m posting responses. So, a couple of questions have recurred about the slow learning concept. One is how the notion of quick small bites reflects a slower learning process. Another is how it might play out in the organization. And a final one is about the overall pedagogy.
To address the first one, the notion is that the learnings are wrapped around the events in your life, not where you’re taken away from the context of your life to have a learning experience. I think of this as embedded learning versus event learning. Yes, it’s quick bits, but they don’t mean as much on their own as in their cumulative effect over time. Whereas the cumulative effect of the event model dissipates quickly, the distributed model builds slowly!
To address the pedagogy, it’s about having little bits of extra information that connect to the events in your life, not separate (unless the events in your life aren’t frequent enough, and then we might create little ‘alternate reality’ events that create plausible and fun scenarios that also provide the desired practice to develop you on the path. It’s not breaking up event-based learning into smaller chunks so much as wrapping around the meaningful events in your life, when possible.
And that pedagogy will very much be our choice. I do hope we can take the opportunity to include a sufficient level of challenge, and the opportunity to personalize it, rather than keep it generic. Consider minimalist approaches, weave in learning-to-learn, connecting people as well as providing additional information. For instance, we should be asking personalization questions afterward (whether via system or person). The algorithms hopefully will have some serendipity as well as relationships to my personal experience. Some elliptical material. This would support discovering new relationships in learning, as well, as we mine the effects of some random juxtapositions across many experiences.
How to make this practical in organizations worried about immediate productivity? In my experience, it’s already happening. Folks are (trying) to take responsibility for their learning. They take the social media cigarette breaks to go out and connect to their networks when the office blocks access through the firewall. They’re discussing work topics in LinkedIn groups, and using Twitter to both track new things and to get questions answered. The question really is whether orgs will ignore or hamper this versus facilitating it. That’s why I’m part of the Internet Time Alliance, where we are working with organizations to help them start supporting learning, not just offering training.
We do see small bits of moves toward slow learning, but I don’t like to assume everyone’s yet capable of taking ownership of it. And, yes, the sad state of the world is that typical schooling and old-style management can squelch the love of learning and not develop the skills that are needed. We have multiple challenges, and I’m just suggesting the concept of slow learning, a drip-irrigation versus flood metaphor, is a wedge to help drive us out of the event-based model and start addressing the issues raised: pedagogy, curricula, infrastructure, technology, politics, and more. The efforts to build such a system, I reckon, will force progress on many fronts. Whether it’s the best approach to do that is a separate question. I welcome your thoughts.
And a thanks to all for their participation this week, it’s been a learning experience for me as well!
Making Slow Learning Concrete #change11
It occurs to me that I’ve probably not conveyed in any concrete terms what I think the ‘slow learning’ experience might be like. And I admit that I’m talking a technology environment in the concrete instance (because I like toys). So here are some instances:
Say you’ve a meeting with a potential client. You’ve been working on how to more clearly articulate the solutions you offer and listening to the customer to establish whether there’s a match or not. You’ve entered the meeting into your calendar, and indicated the topic by the calendar, tags, the client, or some other way. So, shortly before the meeting, your system might send you some reminder that both reiterated the ‘message’ you’d worked out, and reminded you about pulling out the client’s issues. Then, there might be a tool provided during the meeting (whether one you’d created, one you’d customized, or a stock one) to help capture the important elements. Afterwards, the system might provide you with a self-evaluation tool, or even connect you to a person for a chat.
Or, say, you’re walking around a new town. Your system might regularly suggest some topics of interest, depending on your interest showing architecture, history, or socioeconomic indicators. You could ignore them, or follow them up. Ideally, it’d also start connecting some dots: showing a picture from a previous trip and suggesting “Remember we saw an example of <this> architect use here? Well, right here we have the evolution of that form; see how the arches have…” So it’s making connections for you. You can ignore, pursue further, or whatever. It might make a tour for you on the fly, if you wanted. If you were interested in food, it might say: “we’ve been exploring Indian food, you apparently have no plans for dinner and there’s an Indian restaurant near here that would be a way to explore Southern Indian cuisine”.
Another situation might be watching an event, and having extra information laid on top. So instead of just watching a game, you could see additional information that is being used by the coaches to make strategic decisions: strengths and weaknesses of the opposing team in this context, intangible considerations like clock management, or the effects of wind.
And even in formal schooling, if you’re engaged in either an individual or group problem, it might well be available to provide a hint, as well as of course tools to hand.
The notion is that you might have more formal and informal goals, and the system would layer on information, augmenting your reality with extra information aligned to your interests and goals, making the world richer. It could and would help performance in the moment, but also layer on some concepts on top.
I see this as perhaps a mobile app, that has some way of notifying you (e.g. it’s own signature ‘sound’), a way to sense context, and more. It might ask for your agreement to have a link into the task apps you use, so it has more context information, but also knows when and where you are.
This isn’t the only path to slow learning. Ideally, it’d just be a rich offering of community-generated resources and people to connect with in the moment, but to get people ready to take advantage of that it might need some initial scaffolding. Is this making sense?