Training Industry Magazine - July/August 2019 - 31

ENGAGEMENT, EXPERIENCE, EFFECT
Richardson

Analytics are more than a way to verify outcomes at the end
of training. Effective measurement guides the training
process as it unfolds. Participants discover where they
need to focus their attention and where their blind spots
reside. Measurement is for the learner as much as it is for
the leadership.
Despite these benefits, many organizations fail to generate
and measure data. Often, the data sits in disparate systems,
making it difficult to connect the data to business impacts.
Moreover, the available data represents different levels of
accuracy, forcing the user to qualify the analytics first. Even
after meeting these challenges, it is difficult to know what
to measure.
Simplify the process by segmenting measurement into three
key parts:
1. Engagement: How are learners progressing through training?
2. Experience: How memorable is training, and how excited
are learners to participate?
3. Effect: How has training improved business outcomes and
skill adoption?

MORE THAN TECHNOLOGY ALONE
Explorance

The top performing corporate training organizations recognize
that learning analytics require more than technology alone;
it's a transformation process rooted in human cooperation
and geared toward business objectives. L&D leaders first
align with strategic business goals. Then, establishing a
common language is crucial when agreeing upon leading
indicators that describe how training results lead to
improved business outcomes. For a proven and accelerated
process, L&D professionals derive KPIs from a validated
learning impact model.
The right technology optimizes the transformation by
automating data collection and reporting processes,
allowing personnel to focus on analysis and actions. Internal
and external benchmarks enhance the credibility of measures
and shape performance expectations. These benchmarks
further reinforce business executives' confidence that L&D
programs function adequately and maximize impact.
Finally, this process results in building practical data
literacy skills at all levels in the learning organization,
so all stakeholder groups can effectively leverage rolebased reports, dashboards and data exploration tools to

monitor progress and transparently recognize the value of
training programs.

VALID & RELIABLE ASSESSMENTS

Kristin Bernor, Marketing Manager, Questionmark
With the growing demand to leverage learning data to
improve business outcomes, training organizations can
develop better measurement practices to prove the value
of training by implementing valid and reliable assessments.
Assessments are a valuable tool before, during and after
training that define learning success. Organizations can
gain a better understanding of the effectiveness of the
learning and make the appropriate adjustments to meet goals
and objectives.
Key drivers for measuring learning include improving
the effectiveness of learning and deliberately linking
learning programs with organizational performance,
individual performance and employee engagement. By
utilizing assessments and the analysis of those data points,
organizations can prove learning impacts these areas.
Observational assessments can also be used to check onthe-job performance. Valid and reliable assessments result
in meaningful measurement outcomes that prove the value
of training.

TURN AWAY FROM
EVENT-DRIVEN METRICS

Sam Shriver, Executive Vice President, The Center for
Leadership Studies
Old habits die hard, and learning professionals have long
been identified as event-driven creatures. As such, much
of our collective design and development energy remains
focused on the experience and the Level I reactions that
experience produces.
Developing better measurement practices begins with putting
those habits in the rearview mirror. The primary stewards of
your organization simply do not care what learners think or
feel about company sponsored training experiences. They
seek evidence of change tethered to training that positively
impacts the results they have responsibility to deliver.
The implications of that reality suggest that the target of
your measurement practices should be pretty much anybody
but the trainees themselves. What are those trainees doing
differently that is attributable to the experience, and what
impact is it having on the outcomes key executives have
invested interest in achieving?
Ken Taylor is president and editor in chief of Training Industry, Inc.
Email Ken.

T R A I N I N G I N DUSTR Y MAGAZ INE -LEARNING ANALYTICS 20 19 I WWW. T RAININGINDU S T RY . C OM/ MAGAZ I NE

| 31


https://www.trainingindustry.com/magazine

Training Industry Magazine - July/August 2019

Table of Contents for the Digital Edition of Training Industry Magazine - July/August 2019

Learning Analytics: Table Stakes for Business Success
Table of Contents
Let's Build a Measurement Practice for L&D
Brain-Based Learning Analytics and Evaluation Practices
Who [Else] Cares About Learning Impact Data
Justifying the Investment in Leadership Training
Is Training Analytics Smoke and Mirrors?
Leveraging Analytical Tools to Transform L&D
Levearging Learning Analytics to Improve Business Outcomes: Where to Start
Was It Worth It? Measuring the Impact and ROI of Leadership Training
How to Make the Transition to a Data-Driven Learning Culture
How Personal Skills AI Assistants Might Disrupt Corporate Training
Machines Are the Future of Training: How Data-Driven Feedback Is Fostering Improvement and Enhancing Human Relationships
Improving Instructor Impact on Learning with Analytics
A Year in the Life: Evolving L&D Metrics From a Reporting Managed Service to Business Insight Partner
Localizing E-Learning Programs for an International Audience
Learning Analytics Is More Than Data Collection
Using Business Data to Drive Training Objectives
Quality versus Quantity: How Analytics Can Improve Training Effectiveness
Coursera Reaches Unicorn Status and Accelerates Enterprise Product Innovation
Company News
Training Industry Magazine - July/August 2019 - Cover1
Training Industry Magazine - July/August 2019 - 2
Training Industry Magazine - July/August 2019 - 3
Training Industry Magazine - July/August 2019 - 4
Training Industry Magazine - July/August 2019 - Learning Analytics: Table Stakes for Business Success
Training Industry Magazine - July/August 2019 - Table of Contents
Training Industry Magazine - July/August 2019 - 7
Training Industry Magazine - July/August 2019 - 8
Training Industry Magazine - July/August 2019 - 9
Training Industry Magazine - July/August 2019 - 10
Training Industry Magazine - July/August 2019 - Let's Build a Measurement Practice for L&D
Training Industry Magazine - July/August 2019 - 12
Training Industry Magazine - July/August 2019 - Brain-Based Learning Analytics and Evaluation Practices
Training Industry Magazine - July/August 2019 - 14
Training Industry Magazine - July/August 2019 - Who [Else] Cares About Learning Impact Data
Training Industry Magazine - July/August 2019 - 16
Training Industry Magazine - July/August 2019 - Justifying the Investment in Leadership Training
Training Industry Magazine - July/August 2019 - Is Training Analytics Smoke and Mirrors?
Training Industry Magazine - July/August 2019 - 19
Training Industry Magazine - July/August 2019 - 20
Training Industry Magazine - July/August 2019 - 21
Training Industry Magazine - July/August 2019 - Leveraging Analytical Tools to Transform L&D
Training Industry Magazine - July/August 2019 - 23
Training Industry Magazine - July/August 2019 - 24
Training Industry Magazine - July/August 2019 - 25
Training Industry Magazine - July/August 2019 - Levearging Learning Analytics to Improve Business Outcomes: Where to Start
Training Industry Magazine - July/August 2019 - 27
Training Industry Magazine - July/August 2019 - 28
Training Industry Magazine - July/August 2019 - 29
Training Industry Magazine - July/August 2019 - 30
Training Industry Magazine - July/August 2019 - 31
Training Industry Magazine - July/August 2019 - 32
Training Industry Magazine - July/August 2019 - Was It Worth It? Measuring the Impact and ROI of Leadership Training
Training Industry Magazine - July/August 2019 - 34
Training Industry Magazine - July/August 2019 - 35
Training Industry Magazine - July/August 2019 - How to Make the Transition to a Data-Driven Learning Culture
Training Industry Magazine - July/August 2019 - 37
Training Industry Magazine - July/August 2019 - How Personal Skills AI Assistants Might Disrupt Corporate Training
Training Industry Magazine - July/August 2019 - 39
Training Industry Magazine - July/August 2019 - 40
Training Industry Magazine - July/August 2019 - 41
Training Industry Magazine - July/August 2019 - Machines Are the Future of Training: How Data-Driven Feedback Is Fostering Improvement and Enhancing Human Relationships
Training Industry Magazine - July/August 2019 - 43
Training Industry Magazine - July/August 2019 - 44
Training Industry Magazine - July/August 2019 - 45
Training Industry Magazine - July/August 2019 - 46
Training Industry Magazine - July/August 2019 - Improving Instructor Impact on Learning with Analytics
Training Industry Magazine - July/August 2019 - 48
Training Industry Magazine - July/August 2019 - 49
Training Industry Magazine - July/August 2019 - A Year in the Life: Evolving L&D Metrics From a Reporting Managed Service to Business Insight Partner
Training Industry Magazine - July/August 2019 - 51
Training Industry Magazine - July/August 2019 - Localizing E-Learning Programs for an International Audience
Training Industry Magazine - July/August 2019 - 53
Training Industry Magazine - July/August 2019 - 54
Training Industry Magazine - July/August 2019 - Learning Analytics Is More Than Data Collection
Training Industry Magazine - July/August 2019 - 56
Training Industry Magazine - July/August 2019 - Using Business Data to Drive Training Objectives
Training Industry Magazine - July/August 2019 - 58
Training Industry Magazine - July/August 2019 - Quality versus Quantity: How Analytics Can Improve Training Effectiveness
Training Industry Magazine - July/August 2019 - Coursera Reaches Unicorn Status and Accelerates Enterprise Product Innovation
Training Industry Magazine - July/August 2019 - Company News
Training Industry Magazine - July/August 2019 - Cover4
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_fall2024
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_summer2024
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_spring2024
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_winter2024
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_fall2023
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_summer2023
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_spring2023
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_winter2023
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_fall2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_summer2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_spring2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_winter2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20201112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20191112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20181112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20171112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20171112_se
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20161112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016sales
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015outsourcing
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015leadership
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008spring
https://www.nxtbookmedia.com