{"id":12946,"date":"2022-11-14T13:48:07","date_gmt":"2022-11-14T11:48:07","guid":{"rendered":"https:\/\/oeb.global\/oeb-insights\/?p=12946"},"modified":"2023-02-16T19:05:27","modified_gmt":"2023-02-16T17:05:27","slug":"flashy-or-effective-we-need-to-be-honest-when-evaluating-new-tools","status":"publish","type":"post","link":"https:\/\/oeb.global\/oeb-insights\/flashy-or-effective-we-need-to-be-honest-when-evaluating-new-tools\/","title":{"rendered":"Flashy or Effective? We Need to be Honest when Evaluating New Tools"},"content":{"rendered":"\n<div class=\"wp-block-image\"><figure class=\"alignleft size-large is-resized\"><a href=\"https:\/\/oeb.global\/oeb-insights\/wp-content\/uploads\/2022\/11\/Engageli-visual.png\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/oeb.global\/oeb-insights\/wp-content\/uploads\/2022\/11\/Engageli-visual-1024x576.png\" alt=\"\" class=\"wp-image-12949\" width=\"392\" height=\"220\" srcset=\"https:\/\/oeb.global\/oeb-insights\/wp-content\/uploads\/2022\/11\/Engageli-visual-1024x576.png 1024w, https:\/\/oeb.global\/oeb-insights\/wp-content\/uploads\/2022\/11\/Engageli-visual-300x169.png 300w, https:\/\/oeb.global\/oeb-insights\/wp-content\/uploads\/2022\/11\/Engageli-visual-768x432.png 768w, https:\/\/oeb.global\/oeb-insights\/wp-content\/uploads\/2022\/11\/Engageli-visual-1536x864.png 1536w, https:\/\/oeb.global\/oeb-insights\/wp-content\/uploads\/2022\/11\/Engageli-visual-2048x1152.png 2048w\" sizes=\"auto, (max-width: 392px) 100vw, 392px\" \/><\/a><\/figure><\/div>\n\n\n\n<p><strong>Think back to your early school days for a moment. Were you overjoyed when your teacher gave you homework? Did you appreciate the instructor that demanded more work or pushed you outside of your comfort zone? How did you feel when you were assigned another group project? At the time, many of us were probably frustrated, but these are exactly the educators that helped us learn better, with a deeper understanding of the material and long-term knowledge retention. When students (appropriately) struggle with an assignment, they are learning. When they are asked to recall information or discuss their ideas and misconceptions with each other, they are learning. They learn, even if they sometimes complain.<\/strong><br><br><br><br><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">True transformation in teaching and learning should be motivated by learning outcomes, not popularity contests<\/h2>\n\n\n\n<p>A painful truth in higher education is that, while some students may perceive lectures to be a more effective method of learning (\u201cI\u2019ll absorb the knowledge directly from the expert professor\u201d), they actually learn better when they are active and engaged. Active learning, such as group work and problem-solving, has many advantages, including a focus on higher-order thinking. It also has the welcome side effect of soft skills development. Skills such as verbal and written communication, empathy, and social skills needed for teamwork. In a meta-analysis of 225 papers, data on student outcomes comparing lectures to active learning show that students are 1.5x more likely to fail with traditional lecturing vs. active learning (Freeman et al. 2014).<br><br><br><\/p>\n\n\n\n<p>Another <a href=\"https:\/\/www.pnas.org\/doi\/full\/10.1073\/pnas.1821936116\" target=\"_blank\" rel=\"noreferrer noopener\">research study<\/a> published in <a href=\"https:\/\/www.pnas.org\/doi\/10.1073\/pnas.1821936116\" target=\"_blank\" rel=\"noreferrer noopener\">Proceedings of the National Academy of Sciences<\/a>, compared two groups of physics students at Harvard University, one learning with lectures, and the other switching to active learning: experimentation and group problem-solving. The findings showed that the active learning cohort\u2019s outcomes in the final exams were 10 points better than their lecture-only counterparts. Ironically, the students still clearly preferred the lower-effort methods of lecturing. In the words of the researchers:<em> \u201cWe find that while students in the active classroom learn more, they feel like they learn less. We show that this negative correlation is caused in part by the increased cognitive effort required during active learning.\u201d<\/em><br><br><br><\/p>\n\n\n\n<p>In other words, students prefer a more passive consumption of content to active, involved learning methods &#8211; but it isn\u2019t what\u2019s best for them. Why is that? Because it\u2019s what they\u2019re used to, it demands very little of them, and they (wrongfully) believe it\u2019s the preferred method of instruction. Simply put, they \u201clike it more,\u201d even though the numbers show that students learn better in active learning situations where likeability is nearly irrelevant.<br><br><br><\/p>\n\n\n\n<p>This trend continues in the digital arena, with teachers and instructors eagerly looking for the \u201clatest and greatest, slick tool\u201d to entice their students. New learning platforms roll out tools and features to capture this expanding interest despite unclear efficacy. Typically, when new learning technologies are introduced, companies and organizations immediately seek user feedback. \u201cDid you like it?\u201d \u201cWas it better than XYZ tool that we are using today?\u201d<br><br><br><\/p>\n\n\n\n<p>But are those the right questions to ask? If not, what are the right questions? Perhaps there is a way to get \u201clearning better\u201d and \u201cliking it more\u201d in one place? I believe this is possible, and it starts with being honest about your goals and asking the right questions about a prospective learning platform.<br><br><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>What are the skills learners should acquire during their learning path?<\/li><li>How will you know they learned these skills?<\/li><li>Were they active and engaged in their learning?<\/li><li>Did they collaborate with peers and share their perspectives?<\/li><li>Did they feel seen and heard?<\/li><li>Were they able to make meaningful connections, both with other humans and between neurons in their brains as part of the learning process<br><br><br><\/li><\/ul>\n\n\n\n<p>Considering what we know about effective learning, evaluations of new learning technologies should be based on objectives rather than whether it\u2019s \u201ccool\u201d, comfortable, or popular. Assessment of hybrid and online pedagogy are already showing us the answer. The real task before us is understanding how to implement these new technologies in a way that is as effective as it is enjoyable. When we start with the \u201cwhy,\u201d that is when the true impact is possible.<br><br><br><br><\/p>\n\n\n\n<p>Written for <strong><a href=\"http:\/\/oeb.global\" target=\"_blank\" rel=\"noreferrer noopener\">OEB Global 2022 by<\/a><\/strong> <strong>Talia Kolodny<\/strong>, Director of Partnerships, EMEA at <a href=\"https:\/\/w3.engageli.com\/3VaRsXh\" target=\"_blank\" rel=\"noreferrer noopener\">Engageli<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Think back to your early school days for a moment. Were you overjoyed when your teacher gave you homework? Did you appreciate the instructor that demanded more work or pushed you outside of your comfort zone? How did you feel when you were assigned another group project? At the time, many of us were probably [&hellip;]<\/p>\n<div class='heateorSssClear'><\/div><div  class='heateor_sss_sharing_container heateor_sss_horizontal_sharing' data-heateor-sss-href='https:\/\/oeb.global\/oeb-insights\/flashy-or-effective-we-need-to-be-honest-when-evaluating-new-tools\/' data-heateor-sss-no-counts=\"1\"><div class='heateor_sss_sharing_title' style=\"font-weight:bold\" ><\/div><div class=\"heateor_sss_sharing_ul\"><a aria-label=\"Linkedin\" class=\"heateor_sss_button_linkedin\" href=\"https:\/\/www.linkedin.com\/sharing\/share-offsite\/?url=https%3A%2F%2Foeb.global%2Foeb-insights%2Fflashy-or-effective-we-need-to-be-honest-when-evaluating-new-tools%2F\" title=\"Linkedin\" rel=\"nofollow noopener\" target=\"_blank\" style=\"font-size:32px!important;box-shadow:none;display:inline-block;vertical-align:middle\"><span class=\"heateor_sss_svg heateor_sss_s__default heateor_sss_s_linkedin\" style=\"background-color:#0077b5;width:20px;height:20px;display:inline-block;opacity:1;float:left;font-size:32px;box-shadow:none;display:inline-block;font-size:16px;padding:0 4px;vertical-align:middle;background-repeat:repeat;overflow:hidden;padding:0;cursor:pointer;box-sizing:content-box\"><svg style=\"display:block;\" focusable=\"false\" aria-hidden=\"true\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"100%\" height=\"100%\" viewBox=\"0 0 32 32\"><path d=\"M6.227 12.61h4.19v13.48h-4.19V12.61zm2.095-6.7a2.43 2.43 0 0 1 0 4.86c-1.344 0-2.428-1.09-2.428-2.43s1.084-2.43 2.428-2.43m4.72 6.7h4.02v1.84h.058c.56-1.058 1.927-2.176 3.965-2.176 4.238 0 5.02 2.792 5.02 6.42v7.395h-4.183v-6.56c0-1.564-.03-3.574-2.178-3.574-2.18 0-2.514 1.7-2.514 3.46v6.668h-4.187V12.61z\" fill=\"#fff\"><\/path><\/svg><\/span><\/a><a aria-label=\"Bluesky\" class=\"heateor_sss_button_bluesky\" href=\"https:\/\/bsky.app\/intent\/compose?text=Flashy%20or%20Effective%3F%20We%20Need%20to%20be%20Honest%20when%20Evaluating%20New%20Tools%20https%3A%2F%2Foeb.global%2Foeb-insights%2Fflashy-or-effective-we-need-to-be-honest-when-evaluating-new-tools%2F\" title=\"Bluesky\" rel=\"nofollow noopener\" target=\"_blank\" style=\"font-size:32px!important;box-shadow:none;display:inline-block;vertical-align:middle\"><span class=\"heateor_sss_svg heateor_sss_s__default heateor_sss_s_bluesky\" style=\"background-color:#0085ff;width:20px;height:20px;display:inline-block;opacity:1;float:left;font-size:32px;box-shadow:none;display:inline-block;font-size:16px;padding:0 4px;vertical-align:middle;background-repeat:repeat;overflow:hidden;padding:0;cursor:pointer;box-sizing:content-box\"><svg width=\"100%\" height=\"100%\" style=\"display:block;\" focusable=\"false\" aria-hidden=\"true\" viewBox=\"-3 -3 38 38\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\"><path d=\"M16 14.903c-.996-1.928-3.709-5.521-6.231-7.293C7.353 5.912 6.43 6.206 5.827 6.478 5.127 6.793 5 7.861 5 8.49s.346 5.155.572 5.91c.747 2.496 3.404 3.34 5.851 3.07.125-.02.252-.036.38-.052-.126.02-.253.037-.38.051-3.586.529-6.771 1.83-2.594 6.457 4.595 4.735 6.297-1.015 7.171-3.93.874 2.915 1.88 8.458 7.089 3.93 3.911-3.93 1.074-5.928-2.512-6.457a8.122 8.122 0 0 1-.38-.051c.128.016.255.033.38.051 2.447.271 5.104-.573 5.85-3.069.227-.755.573-5.281.573-5.91 0-.629-.127-1.697-.827-2.012-.604-.271-1.526-.566-3.942 1.132-2.522 1.772-5.235 5.365-6.231 7.293Z\" fill=\"#fff\"\/><\/svg><\/span><\/a><a aria-label=\"Facebook\" class=\"heateor_sss_facebook\" href=\"https:\/\/www.facebook.com\/sharer\/sharer.php?u=https%3A%2F%2Foeb.global%2Foeb-insights%2Fflashy-or-effective-we-need-to-be-honest-when-evaluating-new-tools%2F\" title=\"Facebook\" rel=\"nofollow noopener\" target=\"_blank\" style=\"font-size:32px!important;box-shadow:none;display:inline-block;vertical-align:middle\"><span class=\"heateor_sss_svg\" style=\"background-color:#0765FE;width:20px;height:20px;display:inline-block;opacity:1;float:left;font-size:32px;box-shadow:none;display:inline-block;font-size:16px;padding:0 4px;vertical-align:middle;background-repeat:repeat;overflow:hidden;padding:0;cursor:pointer;box-sizing:content-box\"><svg style=\"display:block;\" focusable=\"false\" aria-hidden=\"true\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"100%\" height=\"100%\" viewBox=\"0 0 32 32\"><path fill=\"#fff\" d=\"M28 16c0-6.627-5.373-12-12-12S4 9.373 4 16c0 5.628 3.875 10.35 9.101 11.647v-7.98h-2.474V16H13.1v-1.58c0-4.085 1.849-5.978 5.859-5.978.76 0 2.072.15 2.608.298v3.325c-.283-.03-.775-.045-1.386-.045-1.967 0-2.728.745-2.728 2.683V16h3.92l-.673 3.667h-3.247v8.245C23.395 27.195 28 22.135 28 16Z\"><\/path><\/svg><\/span><\/a><a aria-label=\"Email\" class=\"heateor_sss_email\" href=\"https:\/\/oeb.global\/oeb-insights\/flashy-or-effective-we-need-to-be-honest-when-evaluating-new-tools\/\" onclick=\"event.preventDefault();window.open('mailto:?subject=' + decodeURIComponent('Flashy%20or%20Effective%3F%20We%20Need%20to%20be%20Honest%20when%20Evaluating%20New%20Tools').replace('&', '%26') + '&body=https%3A%2F%2Foeb.global%2Foeb-insights%2Fflashy-or-effective-we-need-to-be-honest-when-evaluating-new-tools%2F', '_blank')\" title=\"Email\" rel=\"noopener\" style=\"font-size:32px!important;box-shadow:none;display:inline-block;vertical-align:middle\"><span class=\"heateor_sss_svg\" style=\"background-color:#649a3f;width:20px;height:20px;display:inline-block;opacity:1;float:left;font-size:32px;box-shadow:none;display:inline-block;font-size:16px;padding:0 4px;vertical-align:middle;background-repeat:repeat;overflow:hidden;padding:0;cursor:pointer;box-sizing:content-box\"><svg style=\"display:block;\" focusable=\"false\" aria-hidden=\"true\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"100%\" height=\"100%\" viewBox=\"-.75 -.5 36 36\"><path d=\"M 5.5 11 h 23 v 1 l -11 6 l -11 -6 v -1 m 0 2 l 11 6 l 11 -6 v 11 h -22 v -11\" stroke-width=\"1\" fill=\"#fff\"><\/path><\/svg><\/span><\/a><a aria-label=\"Teams\" class=\"heateor_sss_button_teams\" href=\"https:\/\/teams.microsoft.com\/share?href=https%3A%2F%2Foeb.global%2Foeb-insights%2Fflashy-or-effective-we-need-to-be-honest-when-evaluating-new-tools%2F&msgText=Flashy%20or%20Effective%3F%20We%20Need%20to%20be%20Honest%20when%20Evaluating%20New%20Tools\" title=\"Teams\" rel=\"nofollow noopener\" target=\"_blank\" style=\"font-size:32px!important;box-shadow:none;display:inline-block;vertical-align:middle\"><span class=\"heateor_sss_svg heateor_sss_s__default heateor_sss_s_teams\" style=\"background-color:#5059c9;width:20px;height:20px;display:inline-block;opacity:1;float:left;font-size:32px;box-shadow:none;display:inline-block;font-size:16px;padding:0 4px;vertical-align:middle;background-repeat:repeat;overflow:hidden;padding:0;cursor:pointer;box-sizing:content-box\"><svg width=\"100%\" height=\"100%\" style=\"display:block;\" focusable=\"false\" aria-hidden=\"true\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 32 32\"><path fill=\"#fff\" d=\"M24.63 12.14a2.63 2.63 0 1 0 0-5.26 2.63 2.63 0 0 0 0 5.26Zm2.25.74h-3.29c.18.34.32.72.32 1.12v7.13c0 .74-.11 1.47-.34 2.14 2.01.36 3.94-.93 4.34-2.93.04-.25.09-.52.09-.76V14c0-.63-.52-1.12-1.12-1.12ZM16.75 4.87a3.515 3.515 0 0 0-3.49 3.87h1.73c1.19 0 2.14.97 2.14 2.14v.97c1.75-.2 3.1-1.69 3.1-3.49a3.48 3.48 0 0 0-3.49-3.49h.01Zm4.86 8.01h-4.48v8.01c0 1.19-.97 2.14-2.14 2.14h-3.94c.04.11.07.25.11.36.11.26.22.52.38.74a6.004 6.004 0 0 0 5.2 2.99c3.31 0 5.98-2.68 5.98-6.01v-7.14c0-.61-.49-1.09-1.12-1.09h.01Z\"><\/path><path fill=\"#fff\" d=\"M15 9.86H4.99c-.56 0-.99.45-.99.99v10.02c0 .56.45.99.99.99h10.02c.56 0 .99-.45.99-.99v-9.99c-.01-.56-.44-1.02-1-1.02Zm-2.02 3.74h-2.23v6.01H9.28V13.6H7.03v-1.49h5.96v1.49h-.02.01Z\"><\/path><\/svg><\/span><\/a><a aria-label=\"X\" class=\"heateor_sss_button_x\" href=\"https:\/\/twitter.com\/intent\/tweet?text=Flashy%20or%20Effective%3F%20We%20Need%20to%20be%20Honest%20when%20Evaluating%20New%20Tools&url=https%3A%2F%2Foeb.global%2Foeb-insights%2Fflashy-or-effective-we-need-to-be-honest-when-evaluating-new-tools%2F\" title=\"X\" rel=\"nofollow noopener\" target=\"_blank\" style=\"font-size:32px!important;box-shadow:none;display:inline-block;vertical-align:middle\"><span class=\"heateor_sss_svg heateor_sss_s__default heateor_sss_s_x\" style=\"background-color:#2a2a2a;width:20px;height:20px;display:inline-block;opacity:1;float:left;font-size:32px;box-shadow:none;display:inline-block;font-size:16px;padding:0 4px;vertical-align:middle;background-repeat:repeat;overflow:hidden;padding:0;cursor:pointer;box-sizing:content-box\"><svg width=\"100%\" height=\"100%\" style=\"display:block;\" focusable=\"false\" aria-hidden=\"true\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 32 32\"><path fill=\"#fff\" d=\"M21.751 7h3.067l-6.7 7.658L26 25.078h-6.172l-4.833-6.32-5.531 6.32h-3.07l7.167-8.19L6 7h6.328l4.37 5.777L21.75 7Zm-1.076 16.242h1.7L11.404 8.74H9.58l11.094 14.503Z\"><\/path><\/svg><\/span><\/a><\/div><div class=\"heateorSssClear\"><\/div><\/div><div class='heateorSssClear'><\/div>","protected":false},"author":26,"featured_media":12949,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[752,209],"tags":[170,575,487,768,765,523,696,764,33,152],"class_list":["post-12946","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-industry-insights","category-news","tag-conference","tag-digital-learning","tag-edtech","tag-events","tag-ld","tag-learning-tools","tag-oeb-insights","tag-oeb22","tag-online-learning","tag-tech"],"_links":{"self":[{"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/posts\/12946","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/users\/26"}],"replies":[{"embeddable":true,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/comments?post=12946"}],"version-history":[{"count":6,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/posts\/12946\/revisions"}],"predecessor-version":[{"id":12995,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/posts\/12946\/revisions\/12995"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/media\/12949"}],"wp:attachment":[{"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/media?parent=12946"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/categories?post=12946"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/oeb.global\/oeb-insights\/wp-json\/wp\/v2\/tags?post=12946"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}