{"id":8354,"date":"2018-07-04T17:34:09","date_gmt":"2018-07-04T15:34:09","guid":{"rendered":"http:\/\/newinsights.oeb.global\/?p=8354"},"modified":"2019-10-16T15:07:19","modified_gmt":"2019-10-16T13:07:19","slug":"making-learning-evaluation-work-two-new-innovations-worth-your-time","status":"publish","type":"post","link":"https:\/\/oeb.global\/oeb-insights\/making-learning-evaluation-work-two-new-innovations-worth-your-time\/","title":{"rendered":"Making Learning Evaluation work: Two New Innovations Worth Your Time"},"content":{"rendered":"

\"\"<\/a>Learning evaluation is one of the most critical competencies in the workplace learning field. If done well, it enables us to monitor our success, and maximize the benefits of learning. Sadly, too often we do learning measurement poorly, leaving ourselves and our organizations in the dark. In his workshop at the upcoming OEB conference, Dr. Will Thalheimer, one of our industry\u2019s learning-evaluation visionaries, will describe two innovations that may radically alter how learning evaluation gets done. <\/b><\/p>\n

 <\/p>\n

I didn\u2019t start out focusing on evaluation. I started as an instructional designer, project manager, and simulation designer. Later I became a trainer and ran a leadership-development product line. Still later, I started a consulting practice focused on helping organizations utilize scientific research on learning to accelerate their learning-design improvements.<\/p>\n

 <\/p>\n

One day, as I was immersed in the learning research, out of the blue popped an idea\u2014and insight rolling around my working memory\u2014that the learning evaluation we were doing was seriously biased and was likely leading us to overrate our successes. We tended to measure learning when everything people had learned was top-of-mind. We measured in the learning context, not later in the on-the-job performance context. We measured people on low-level knowledge checks, asking our learners only to regurgitate trivial information.<\/p>\n

 <\/p>\n

I knew that as learning professionals we should begin with research-based recommendations and be creative in applying principles in practical ways. But I then realized this wasn\u2019t enough. We needed better evaluation to get feedback on a regular basis\u2014to enable us to improve our techniques, to do our own due diligence, our own research. Creating feedback loops is fundamental to other professions, from lean manufacturing to software engineering, sports, tech startups, investing, medicine, and more. I started to look around for learning-evaluation leverage points.<\/p>\n

 <\/p>\n

The most obvious target was our learner-feedback surveys. Throughout the world, these are the default method for evaluation our learning interventions. The research was scary though. Our learner-feedback questions did not seem related to learning outcomes. And who of us hadn\u2019t quickly circled fives all the way down the page to get home after an arduous day in the training room\u2014illustrating the point that the data might not be so meaningful?<\/p>\n

 <\/p>\n

Learning evaluation is difficult, of course. Human learning is diabolically complex. Evaluation makes it even more so. There are no perfect solutions, and I certainly haven\u2019t discovered any secret formula. Still, my approach, detailed in the book Performance-Focused Smile Sheets<\/em><\/a>, is showing promise in organizations of all types, from huge corporations, to the military, to non-profit and non-government organizations. In the workshop, I\u2019ll describe the research that inspired my quest and describe in-depth the new method\u2014enabling you to begin designing learner surveys for your organization.<\/p>\n

 <\/p>\n

In addition, in the workshop I\u2019ll share with you a new learning-evaluation model, LTEM, the Learning-Transfer Evaluation Model<\/a>, which is designed to help organizations do better learning evaluations. I\u2019ll describe the rationale behind its design and outline two ways that it can be used. The Kirkpatrick-Katzell Four-Level Model of Evaluation was born before the advent of the cognitive revolution in psychology and the stunning advent of this new century\u2019s world-wide consensus on the most potent learning factors. The new model is designed to fill in the gaps with usable but still sophisticated research-inspired guide posts. I\u2019m delighted to have an opportunity to share it at OEB this year.<\/p>\n

 <\/p>\n

Written by Will Thalheimer<\/a><\/em><\/p>\n

 <\/p>\n

Will Thalheimer, PhD, will be leading a workshop<\/a> on Getting Radically Improved Data from Learner Feedback at OEB Berlin on Wednesday the 5th<\/sup> of December 2018.<\/i><\/p>\n","protected":false},"excerpt":{"rendered":"

Learning evaluation is one of the most critical competencies in the workplace learning field. If done well, it enables us to monitor our success, and maximize the benefits of learning. Sadly, too often we do learning measurement poorly, leaving ourselves and our organizations in the dark. In his workshop at the upcoming OEB conference, Dr. […]<\/p>\n

<\/div>
<\/div>
<\/path><\/svg><\/span><\/a><\/svg><\/span><\/a><\/path><\/svg><\/span><\/a><\/path><\/svg><\/span><\/a><\/path><\/path><\/svg><\/span><\/a><\/path><\/svg><\/span><\/a><\/div>
<\/div><\/div>
<\/div>","protected":false},"author":26,"featured_media":8448,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[209],"tags":[],"class_list":["post-8354","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/posts\/8354","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/users\/26"}],"replies":[{"embeddable":true,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/comments?post=8354"}],"version-history":[{"count":15,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/posts\/8354\/revisions"}],"predecessor-version":[{"id":8454,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/posts\/8354\/revisions\/8454"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/media\/8448"}],"wp:attachment":[{"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/media?parent=8354"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/categories?post=8354"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/tags?post=8354"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}