Training Industry Magazine - Spring 2024 - 34
BY PAUL LEONE, PH.D.
You did it. You designed great training.
You delivered an amazing training
experience. Then, to your delight and
credit, in the months that followed your
training, the key business metrics that
are most important to your stakeholders
actually showed a positive
increase.
Success! Your training worked! You're a
star! Right?
Not so fast. What about all the other
possible factors that could influence
employee performance and boost the
health metrics of your organization
during
those same months? Maybe
the market opened up. Maybe a new
technology came along. Maybe the
same employees who took your training
also took another training the same
month. The bad news is, whatever the
post-training increase was, we'll never
be able to take credit for all of it. But
the good news is we can take credit for
some of it.
So, your next question has to be, how
do we calculate that " some " ? How do
we credibly and confidently attribute a
certain percentage of that overall increase
34
in performance to our specific training
and grab our slice of the credit? How can
we finally step up and boldly shout, " We
did that! Our training caused those great
business results! " ? The answer is that you
have to gather the right data to isolate the
impact of your training.
Isolating the impact of your training
always happens at Level 4 (see Figure
1). In essence, it cuts away the noise of
other possible factors and carves out
a percentage of the overall business
performance that you can confidently
attribute directly to your training. We call
it " isolating " because it collects and uses
specific data to parse out the effects of
other influencers, attempting to leave
your training all alone as the one and
only influencer of at least a portion of
any business improvement.
3 WAYS TO ISOLATE
There are three primary techniques
you can use to do this. Below is a highlevel
summary of each approach, some
guidance on when to apply each one and
finally an example of how it was used in a
real-life case study within an organization.
1. The Control Group Technique
The control group (trained vs. untrained)
technique compares the improvement of
a trained group to the improvement of an
untrained " control " group on a particular
performance metric over the same time
period. Here, it's critical that these two
samples of employees are working
under the same market conditions,
come from the same business functions,
have the same tenure, etc. - with the
YOU HAVE TO
GATHER THE RIGHT
DATA TO ISOLATE
THE IMPACT OF
YOUR TRAINING.
https://trainingindustry.com/wiki/measurement-and-analytics/the-kirkpatrick-model/
Training Industry Magazine - Spring 2024
Table of Contents for the Digital Edition of Training Industry Magazine - Spring 2024
FROM THE EDITOR
LEARNING LEADER SPOTLIGHT
L&D CAREERS
SCIENCE OF LEARNING
CAREER DEVELOPMENT
REFRAMING THE L&D MINDSET: EMBRACING THE POTENTIAL OF AI
CUT THROUGH THE LEARNING TECH CLUTTER: HOW TO FIND SOLUTIONS THAT ADD VALUE
THE NONLINEAR TRAINING CAREER
TRAINING DID THAT: HOW TO ATTRIBUTE BUSINESS RESULTS DIRECTLY TO TRAINING
MASTERING L&D SOLO: STRATEGIES FOR A ONE-PERSON LEARNING TEAM
HOW TO ESTABLISH A TRAINING BUDGET
TRAINING INDUSTRY’S L&D CAREER AND SALARY STUDY
DIVERSITY AND INCLUSION
BUILDING LEADERS
WHAT’S NEXT IN TECH?
Training Industry Magazine - Spring 2024 - Intro
Training Industry Magazine - Spring 2024 - Cover1
Training Industry Magazine - Spring 2024 - Cover2
Training Industry Magazine - Spring 2024 - CT1
Training Industry Magazine - Spring 2024 - CT2
Training Industry Magazine - Spring 2024 - FROM THE EDITOR
Training Industry Magazine - Spring 2024 - 4
Training Industry Magazine - Spring 2024 - 5
Training Industry Magazine - Spring 2024 - 6
Training Industry Magazine - Spring 2024 - 7
Training Industry Magazine - Spring 2024 - 8
Training Industry Magazine - Spring 2024 - LEARNING LEADER SPOTLIGHT
Training Industry Magazine - Spring 2024 - 10
Training Industry Magazine - Spring 2024 - L&D CAREERS
Training Industry Magazine - Spring 2024 - 12
Training Industry Magazine - Spring 2024 - SCIENCE OF LEARNING
Training Industry Magazine - Spring 2024 - 14
Training Industry Magazine - Spring 2024 - CAREER DEVELOPMENT
Training Industry Magazine - Spring 2024 - 16
Training Industry Magazine - Spring 2024 - 17
Training Industry Magazine - Spring 2024 - 18
Training Industry Magazine - Spring 2024 - 19
Training Industry Magazine - Spring 2024 - 20
Training Industry Magazine - Spring 2024 - 21
Training Industry Magazine - Spring 2024 - REFRAMING THE L&D MINDSET: EMBRACING THE POTENTIAL OF AI
Training Industry Magazine - Spring 2024 - 23
Training Industry Magazine - Spring 2024 - 24
Training Industry Magazine - Spring 2024 - 25
Training Industry Magazine - Spring 2024 - CUT THROUGH THE LEARNING TECH CLUTTER: HOW TO FIND SOLUTIONS THAT ADD VALUE
Training Industry Magazine - Spring 2024 - 27
Training Industry Magazine - Spring 2024 - 28
Training Industry Magazine - Spring 2024 - 29
Training Industry Magazine - Spring 2024 - THE NONLINEAR TRAINING CAREER
Training Industry Magazine - Spring 2024 - 31
Training Industry Magazine - Spring 2024 - 32
Training Industry Magazine - Spring 2024 - 33
Training Industry Magazine - Spring 2024 - TRAINING DID THAT: HOW TO ATTRIBUTE BUSINESS RESULTS DIRECTLY TO TRAINING
Training Industry Magazine - Spring 2024 - 35
Training Industry Magazine - Spring 2024 - 36
Training Industry Magazine - Spring 2024 - 37
Training Industry Magazine - Spring 2024 - MASTERING L&D SOLO: STRATEGIES FOR A ONE-PERSON LEARNING TEAM
Training Industry Magazine - Spring 2024 - 39
Training Industry Magazine - Spring 2024 - 40
Training Industry Magazine - Spring 2024 - 41
Training Industry Magazine - Spring 2024 - HOW TO ESTABLISH A TRAINING BUDGET
Training Industry Magazine - Spring 2024 - 43
Training Industry Magazine - Spring 2024 - 44
Training Industry Magazine - Spring 2024 - 45
Training Industry Magazine - Spring 2024 - TRAINING INDUSTRY’S L&D CAREER AND SALARY STUDY
Training Industry Magazine - Spring 2024 - 47
Training Industry Magazine - Spring 2024 - 48
Training Industry Magazine - Spring 2024 - 49
Training Industry Magazine - Spring 2024 - 50
Training Industry Magazine - Spring 2024 - 51
Training Industry Magazine - Spring 2024 - 52
Training Industry Magazine - Spring 2024 - 53
Training Industry Magazine - Spring 2024 - 54
Training Industry Magazine - Spring 2024 - 55
Training Industry Magazine - Spring 2024 - 56
Training Industry Magazine - Spring 2024 - 57
Training Industry Magazine - Spring 2024 - 58
Training Industry Magazine - Spring 2024 - DIVERSITY AND INCLUSION
Training Industry Magazine - Spring 2024 - 60
Training Industry Magazine - Spring 2024 - BUILDING LEADERS
Training Industry Magazine - Spring 2024 - 62
Training Industry Magazine - Spring 2024 - WHAT’S NEXT IN TECH?
Training Industry Magazine - Spring 2024 - 64
Training Industry Magazine - Spring 2024 - 65
Training Industry Magazine - Spring 2024 - 66
Training Industry Magazine - Spring 2024 - 67
Training Industry Magazine - Spring 2024 - 68
Training Industry Magazine - Spring 2024 - Cover3
Training Industry Magazine - Spring 2024 - Cover4
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_winter2025
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_fall2024
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_summer2024
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_spring2024
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_winter2024
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_fall2023
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_summer2023
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_spring2023
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_winter2023
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_fall2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_summer2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_spring2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_winter2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20201112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20191112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20181112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20171112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20171112_se
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20161112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016sales
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015outsourcing
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015leadership
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008spring
https://www.nxtbookmedia.com