The Data and Measurement Issue - 3
MESSAGE FROM TiER1
We often hear leaders asking for data to help them determine the return on investment (ROI) or impact of a specific program, practice, or initiative on key behaviors
and metrics. " How can we figure out whether our leadership program is having the intended impact on our culture? " " How do we know if we're 'moving the needle'
on employee experience? " " How is productivity being impacted by our hybrid working model? "
While calculating ROI of financial investments is fairly straightforward, it's much less simple in these other contexts. How exactly do we determine the ROI of learning
when the causal chain between, say, a classroom learning experience and on-the-job performance is long and complicated? How do we quantify a shift in culture?
Is it fewer people quitting over a period of time, higher engagement at work, or something else altogether? It's not that ROI can't be measured. Rather, these examples
demonstrate how any attempt to measure performance within an organization-whether the ROI of an initiative or another aspect of the employee or customer
experience-entails much more than numerical calculations.
Ultimately, this is a people matter, not solely a data issue. Ethical measurement will involve a series of conversations with different stakeholders to determine
what we are measuring (and why); how we will conduct measurement; how we will present and interpret the results; and what we will do once we see the results
(including, perhaps, a trip back to the drawing board to identify a better measure). Unlike Botticelli's Venus, measures never arrive fully formed-a useful
measurement is a process, not a given.
There's still a deeper implication to consider. We know that attempts to measure human performance can affect that performance1
; the same effect bears out with
how the measurement process is facilitated-every step of the process can have surprising or unintended impacts on the people under study and more broadly
across an organization. For example, announcing new key metrics can induce competition between teams and anxiety within individuals. Uncertainty about the intent
of a new measurement, or worse, the discovery of an unannounced measure, can erode trust in an organization. Similarly, the use of poor or inaccurate measures can
promote cynicism. In short, we must intentionally design the process that underpins a measure with care for how that process impacts the people at the center of it.
In this magazine, we gathered insights and stories that will help leaders understand the human dimensions of measurement
and evaluation. Healthy, high-performing organizations need leaders with access to the best data they can get; they also
need to ensure that good data doesn't come at the expense of employee well-being. We hope this magazine
supports you in crafting a people-centered data and measurement approach.
1 Per the Hawthorne effect, which continues to be studied to understand all the ways that research participation affects behavior.
&
Anna Grome
Industrial-Organizational Psychologist,
Data & Measurement Capability Co-Lead
Walter Warwick, PhD
Principal Scientist, Director of
Applied Performance Research,
Data & Measurement Capability Co-Lead
Click or scan for more Performance
Matters magazines in print or online.
PERFORMANCE MATTERS / PG 3
https://tier1performance.com/author/w-warwick/
https://tier1performance.com/author/a-grome/
https://tier1performance.com/performance-matters-magazine/?utm_campaign=Data%20and%20Measurement%20Magazine&utm_source=Performance%20Matters&utm_medium=PR&utm_content=Data%20and%20Measurement%20Issues
The Data and Measurement Issue
Table of Contents for the Digital Edition of The Data and Measurement Issue
The Data and Measurement Issue - 1
The Data and Measurement Issue - 2
The Data and Measurement Issue - 3
The Data and Measurement Issue - 4
The Data and Measurement Issue - 5
The Data and Measurement Issue - 6
The Data and Measurement Issue - 7
The Data and Measurement Issue - 8
The Data and Measurement Issue - 9
The Data and Measurement Issue - 10
The Data and Measurement Issue - 11
The Data and Measurement Issue - 12
The Data and Measurement Issue - 13
The Data and Measurement Issue - 14
The Data and Measurement Issue - 15
The Data and Measurement Issue - 16
The Data and Measurement Issue - 17
The Data and Measurement Issue - 18
The Data and Measurement Issue - 19
The Data and Measurement Issue - 20
The Data and Measurement Issue - 21
The Data and Measurement Issue - 22
The Data and Measurement Issue - 23
The Data and Measurement Issue - 24
The Data and Measurement Issue - 25
The Data and Measurement Issue - 26
The Data and Measurement Issue - 27
The Data and Measurement Issue - 28
The Data and Measurement Issue - 29
The Data and Measurement Issue - 30
The Data and Measurement Issue - 31
The Data and Measurement Issue - 32
https://www.nxtbook.com/TiER1_Performance/PerformanceMatters/data-and-measurement
https://www.nxtbook.com/TiER1_Performance/PerformanceMatters/modern-leadership
https://www.nxtbook.com/TiER1_Performance/PerformanceMatters/performance-matters-learning-and-performance
https://www.nxtbook.com/TiER1_Performance/PerformanceMatters/performance-matters-healthy-cultures
https://www.nxtbook.com/TiER1_Performance/PerformanceMatters/performance-matters-digital-experiences
https://www.nxtbookmedia.com