{"id":5404,"date":"2022-05-12T10:33:20","date_gmt":"2022-05-12T10:33:20","guid":{"rendered":"https:\/\/maestrolearning.com\/?p=5404"},"modified":"2023-03-09T14:49:24","modified_gmt":"2023-03-09T14:49:24","slug":"are-you-skipping-the-validation-step-2","status":"publish","type":"post","link":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/","title":{"rendered":"Are You Skipping the Validation Step? Why Piloting Your Learning Matters"},"content":{"rendered":"

We need to talk about the validation step. It\u2019s incredibly valuable to the solutioning process, yet it\u2019s one of the most frequently skipped steps in learning design.<\/p>\n

As a learning strategist, I see it all the time\u2014despite the best of intentions, tight budgets and even tighter timelines squeeze the validation step out of the solutioning process. When validation is undervalued, it chips away at the end result. Small oversights that could\u2019ve been adjusted during validation add up over time and can negatively impact anything from learner performance to L&D\u2019s budget. It\u2019s a small aspect of the learning design process, but it can have a big impact.<\/p>\n

Here\u2019s how I think about the validation step, why it matters, and a few best practices to consider when validating learning solutions.<\/p>\n

What is the validation step and why is it important?<\/h2>\n

In learning design, validation is the step between wrapping up production and delivering the solution to the learner audience. As the name implies, this step is all about validating that the solution works for our intended audience and we are solving our initial problem statement. It could also be called the pilot or test phase.<\/p>\n

No matter what you call it, the idea is to test and learn before the solution is out in the world, when it becomes much more difficult, costly, and time-consuming to make adjustments. If your learning solution misses the mark after delivery, those are significant amounts of time, money, and resources you can\u2019t get back\u2014and because the learning problem still isn\u2019t solved, you\u2019re likely going to have to invest even more.<\/p>\n

At Maestro, we follow a Double Diamond framework for learning design that separates the problem-finding process from problem solving. In the problem-finding stage, we focus on learner research and discovering as much information as possible about the audience and the problems they face. A lot goes into the discovery phase and by the end of it, we have a clear, well-defined understanding of the learner, the problem at hand, and the change we want to create.<\/p>\n

\n
<\/div><\/div>\n
\n
How to conduct a learning environment analysis (LEA)<\/h5>\n

In this guide, you\u2019ll find an in-depth overview of an LEA, a powerful framework for accurately diagnosing and defining learners\u2019 problems, constraints, and needs to prescribe the right learning solution. Plus, get worksheets and templates for each stage of the process.<\/p>\n\nDownload your copy\u2192<\/i><\/a>\n<\/div>\n<\/div>\n

We use these findings to inform the problem-solving stage, which involves developing and testing a solution (that\u2019s the validation step!) and then delivering it and evaluating effectiveness. Despite all of the research we do to understand the learner and develop the best possible solution, we still believe in piloting what we\u2019ve created to ensure the experience is fine-tuned to perfection and will resonate with learners to achieve the intended outcomes.<\/p>\n

Think of it this way: once your learning solution is out there, you can’t take it back. Take the time to test it out with a small group of learners instead of putting the perceptions of your entire learner audience at stake.<\/p>\n

What you learn during validation<\/em><\/h3>\n

If you\u2019ve done your homework through learner research, think of validation as going back to check your work. There likely won\u2019t be any huge surprises during validation. Piloting will help uncover the small details you might not expect, allowing you to tweak and make adjustments before delivery. Validation ensures the learning solution\u2014and the time and money spent on it\u2014is truly going to result in the behavior change you designed it for.<\/p>\n

What might you learn during validation? Here\u2019s an example. Let\u2019s say you\u2019re developing a learning experience for an audience of surgeons and nurses. During validation, you might pilot the course to a sample group of four to six learners from the target audience. Several of them tell you that the imagery you\u2019ve used during scenarios isn\u2019t realistic\u2014for example, why aren\u2019t the nurses wearing gloves? It\u2019s a small detail that could be easily overlooked by a SME who is more focused on the core content. But to learners, it\u2019s distracting and erodes credibility. Taking their feedback into account, you update the imagery, continue on to have a great launch, and achieve strong results that help you prove value to stakeholders.<\/p>\n

Learning validation best practices<\/h2>\n

Validation is an important step, but it doesn\u2019t have to be complicated. Whether it\u2019s a survey, a focus group, or observing a test pilot, here are a few best practices for validating learning solutions.<\/p>\n

Pinpoint your target audience<\/em><\/h3>\n

Make sure those participating in validation truly represent your target audience. Watch out for bias in your selection pool\u2014top performers are often the first to raise their hands as volunteers, but they may not represent the entire learner audience.<\/p>\n

This process is meant to uncover small details that those outside of the learner profile may overlook. For example, does the language used ring true? Does the structure of the program fit with their day-to-day lives? These insights should come from a representative sample of your exact audience\u2014not a proxy, like a manager or L&D leader.<\/p>\n

Keep it small<\/em><\/h3>\n

Less is more. You don\u2019t need a large sample size to get valuable insights and feedback on the experience. A focus group of five to ten people, depending on the nature of the content, roles, and what you want to learn, is enough to get representative feedback without too much variance.<\/p>\n

You don\u2019t need to survey a large group of learners during validation\u2014what\u2019s more important is to ensure you\u2019re reaching representative groups for all of your target audiences. For example, if your solution is distributed to different geographical locations, validate with a small sample in each market.<\/p>\n

Think forward<\/em><\/h3>\n

A little planning goes a long way. Before piloting, think about what you want to learn. Plan your questions in advance to avoid bias or leading questions. It\u2019s also important to consider your learning objectives and KPIs\u2014you\u2019ll want to compare the insights that come out of validation against your objectives so you can optimize accordingly.<\/p>\n

After validation, compile your notes and extract key themes. What comes up again and again? Evaluate feedback themes and think about how to create something actionable out of them. What needs to change? Insights are just insights until you have actionable optimization.<\/p>\n

Validation leads to more effective learning experiences<\/h2>\n

Bottom line: don\u2019t skip the validation step! Taking the extra time to test and get feedback on your learning solution will save you time and money in the long run, all while ensuring you\u2019re delivering a solution that will drive real behavior change for learners.<\/p>\n","protected":false},"excerpt":{"rendered":"

We need to talk about the validation step. It\u2019s incredibly valuable to the solutioning process, yet it\u2019s one of the most frequently skipped steps in learning design. As a learning strategist, I see it all the time\u2014despite the best of intentions, tight budgets and even tighter timelines squeeze the validation step out of the solutioning […]<\/p>\n","protected":false},"author":31,"featured_media":5483,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[3869,3868],"tags":[],"role":[3891,3890],"class_list":["post-5404","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-learning-experience-design","category-strategy","role-instructional-designer","role-learning-leader"],"acf":[],"yoast_head":"\nAre You Skipping the Validation Step? Why Piloting Your Learning Matters | Maestro<\/title>\n<meta name=\"description\" content=\"What is the validation step and why is it important in learning design? Here\u2019s why you should never skip piloting your learning solution.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Are You Skipping the Validation Step? Why Piloting Your Learning Matters | Maestro\" \/>\n<meta property=\"og:description\" content=\"What is the validation step and why is it important in learning design? Here\u2019s why you should never skip piloting your learning solution.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/\" \/>\n<meta property=\"og:site_name\" content=\"Maestro\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/MeetMaestro\/\" \/>\n<meta property=\"article:published_time\" content=\"2022-05-12T10:33:20+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-03-09T14:49:24+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/maestrolearning.com\/wp-content\/uploads\/2022\/05\/Blog-Website-scaled-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1920\" \/>\n\t<meta property=\"og:image:height\" content=\"1120\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"katie@maestrolearning.com\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@TeamMaestro\" \/>\n<meta name=\"twitter:site\" content=\"@TeamMaestro\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"katie@maestrolearning.com\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/blogs\\\/are-you-skipping-the-validation-step-2\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/blogs\\\/are-you-skipping-the-validation-step-2\\\/\"},\"author\":{\"name\":\"katie@maestrolearning.com\",\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/#\\\/schema\\\/person\\\/1d5b7785570f15c2b839170be74bcae5\"},\"headline\":\"Are You Skipping the Validation Step? Why Piloting Your Learning Matters\",\"datePublished\":\"2022-05-12T10:33:20+00:00\",\"dateModified\":\"2023-03-09T14:49:24+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/blogs\\\/are-you-skipping-the-validation-step-2\\\/\"},\"wordCount\":1093,\"image\":{\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/blogs\\\/are-you-skipping-the-validation-step-2\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/maestrolearning.com\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/Blog-Website-scaled-1.jpg\",\"articleSection\":[\"Learning-experience design\",\"Strategy\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/blogs\\\/are-you-skipping-the-validation-step-2\\\/\",\"url\":\"https:\\\/\\\/maestrolearning.com\\\/blogs\\\/are-you-skipping-the-validation-step-2\\\/\",\"name\":\"Are You Skipping the Validation Step? Why Piloting Your Learning Matters | Maestro\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/blogs\\\/are-you-skipping-the-validation-step-2\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/blogs\\\/are-you-skipping-the-validation-step-2\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/maestrolearning.com\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/Blog-Website-scaled-1.jpg\",\"datePublished\":\"2022-05-12T10:33:20+00:00\",\"dateModified\":\"2023-03-09T14:49:24+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/#\\\/schema\\\/person\\\/1d5b7785570f15c2b839170be74bcae5\"},\"description\":\"What is the validation step and why is it important in learning design? Here\u2019s why you should never skip piloting your learning solution.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/blogs\\\/are-you-skipping-the-validation-step-2\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/maestrolearning.com\\\/blogs\\\/are-you-skipping-the-validation-step-2\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/blogs\\\/are-you-skipping-the-validation-step-2\\\/#primaryimage\",\"url\":\"https:\\\/\\\/maestrolearning.com\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/Blog-Website-scaled-1.jpg\",\"contentUrl\":\"https:\\\/\\\/maestrolearning.com\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/Blog-Website-scaled-1.jpg\",\"width\":1920,\"height\":1120},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/blogs\\\/are-you-skipping-the-validation-step-2\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/maestrolearning.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Are You Skipping the Validation Step? Why Piloting Your Learning Matters\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/#website\",\"url\":\"https:\\\/\\\/maestrolearning.com\\\/\",\"name\":\"Maestro\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/maestrolearning.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/maestrolearning.com\\\/#\\\/schema\\\/person\\\/1d5b7785570f15c2b839170be74bcae5\",\"name\":\"katie@maestrolearning.com\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Are You Skipping the Validation Step? Why Piloting Your Learning Matters | Maestro","description":"What is the validation step and why is it important in learning design? Here\u2019s why you should never skip piloting your learning solution.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/","og_locale":"en_US","og_type":"article","og_title":"Are You Skipping the Validation Step? Why Piloting Your Learning Matters | Maestro","og_description":"What is the validation step and why is it important in learning design? Here\u2019s why you should never skip piloting your learning solution.","og_url":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/","og_site_name":"Maestro","article_publisher":"https:\/\/www.facebook.com\/MeetMaestro\/","article_published_time":"2022-05-12T10:33:20+00:00","article_modified_time":"2023-03-09T14:49:24+00:00","og_image":[{"width":1920,"height":1120,"url":"https:\/\/maestrolearning.com\/wp-content\/uploads\/2022\/05\/Blog-Website-scaled-1.jpg","type":"image\/jpeg"}],"author":"katie@maestrolearning.com","twitter_card":"summary_large_image","twitter_creator":"@TeamMaestro","twitter_site":"@TeamMaestro","twitter_misc":{"Written by":"katie@maestrolearning.com","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/#article","isPartOf":{"@id":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/"},"author":{"name":"katie@maestrolearning.com","@id":"https:\/\/maestrolearning.com\/#\/schema\/person\/1d5b7785570f15c2b839170be74bcae5"},"headline":"Are You Skipping the Validation Step? Why Piloting Your Learning Matters","datePublished":"2022-05-12T10:33:20+00:00","dateModified":"2023-03-09T14:49:24+00:00","mainEntityOfPage":{"@id":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/"},"wordCount":1093,"image":{"@id":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/#primaryimage"},"thumbnailUrl":"https:\/\/maestrolearning.com\/wp-content\/uploads\/2022\/05\/Blog-Website-scaled-1.jpg","articleSection":["Learning-experience design","Strategy"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/","url":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/","name":"Are You Skipping the Validation Step? Why Piloting Your Learning Matters | Maestro","isPartOf":{"@id":"https:\/\/maestrolearning.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/#primaryimage"},"image":{"@id":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/#primaryimage"},"thumbnailUrl":"https:\/\/maestrolearning.com\/wp-content\/uploads\/2022\/05\/Blog-Website-scaled-1.jpg","datePublished":"2022-05-12T10:33:20+00:00","dateModified":"2023-03-09T14:49:24+00:00","author":{"@id":"https:\/\/maestrolearning.com\/#\/schema\/person\/1d5b7785570f15c2b839170be74bcae5"},"description":"What is the validation step and why is it important in learning design? Here\u2019s why you should never skip piloting your learning solution.","breadcrumb":{"@id":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/#primaryimage","url":"https:\/\/maestrolearning.com\/wp-content\/uploads\/2022\/05\/Blog-Website-scaled-1.jpg","contentUrl":"https:\/\/maestrolearning.com\/wp-content\/uploads\/2022\/05\/Blog-Website-scaled-1.jpg","width":1920,"height":1120},{"@type":"BreadcrumbList","@id":"https:\/\/maestrolearning.com\/blogs\/are-you-skipping-the-validation-step-2\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/maestrolearning.com\/"},{"@type":"ListItem","position":2,"name":"Are You Skipping the Validation Step? Why Piloting Your Learning Matters"}]},{"@type":"WebSite","@id":"https:\/\/maestrolearning.com\/#website","url":"https:\/\/maestrolearning.com\/","name":"Maestro","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/maestrolearning.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/maestrolearning.com\/#\/schema\/person\/1d5b7785570f15c2b839170be74bcae5","name":"katie@maestrolearning.com"}]}},"_links":{"self":[{"href":"https:\/\/maestrolearning.com\/wp-json\/wp\/v2\/posts\/5404","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/maestrolearning.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/maestrolearning.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/maestrolearning.com\/wp-json\/wp\/v2\/users\/31"}],"replies":[{"embeddable":true,"href":"https:\/\/maestrolearning.com\/wp-json\/wp\/v2\/comments?post=5404"}],"version-history":[{"count":0,"href":"https:\/\/maestrolearning.com\/wp-json\/wp\/v2\/posts\/5404\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/maestrolearning.com\/wp-json\/wp\/v2\/media\/5483"}],"wp:attachment":[{"href":"https:\/\/maestrolearning.com\/wp-json\/wp\/v2\/media?parent=5404"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/maestrolearning.com\/wp-json\/wp\/v2\/categories?post=5404"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/maestrolearning.com\/wp-json\/wp\/v2\/tags?post=5404"},{"taxonomy":"role","embeddable":true,"href":"https:\/\/maestrolearning.com\/wp-json\/wp\/v2\/role?post=5404"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}