IEEE Spectrum August, 2015 - 29

TEChnICaLLY SPEaKInG_bY PaUL McfEdRIES

OPInIOn

We're All DAtA Geeks NoW
Data science is going to be as foundational to
education as English... [It] doesn't belong in the
business school. Everybody should take data
science. -Jennifer Priestly, Kennesaw State University
W h en Ga rt n er r el e a sed i ts a n n ua l Hype Cycle for Emerging

Technologies for 2014, it was interesting to note that big data was now
located on the downslope from the "Peak of Inflated Expectations," while
the Internet of Things (often shortened to IoT ) was right at the peak,
and data science was on the upslope. This felt intuitively right. First, although big
data-those massive amounts of information that require special techniques to store,
search, and analyze-remains a thriving and much-discussed area, it's no longer the
new kid on the data block. Second, everyone expects that the data sets generated by
the Internet of Things will be even more impressive than today's big-data collections.
And third, collecting data is one significant challenge, but analyzing and extracting
knowledge from it is quite another, and the purview of data science. Just how much
information are we talking about here? Estimates vary widely, but big-data buffs sometimes speak of storage in units of brontobytes, a term that appears to be based on
brontosaurus, one of the largest creatures ever to rattle the Earth. That tells you we're
dealing with a big number, but just how much data could reside in a brontobyte?
I could tell you that it's 1,000 yottabytes, but that likely won't help. Instead, think of
a terabyte, which these days represents an average-size hard drive. Well, you would
need 1,000,000,000,000,000 (a thousand trillion) of them to fill a brontobyte. Oh,
and for the record, yes, there's an even larger unit tossed around by big-data mavens:
the geopbyte, which is 1,000 brontobytes. Whatever the term, we're really dealing
in hellabytes, that is, a helluva lot of data.
Wrangling even petabyte-size data

*

*

IllustratIon by

Greg Mably

sets (a petabyte is 1,000 terabytes) and
data lakes (data stored and readily accessible in its pure, unprocessed state) are
tasks for professionals, so not only are listings for big-data-related jobs thick on the
ground but the job titles themselves now
display a pleasing variety: companies are
looking for data architects (specialists in
building data models), data custodians
and data stewards (who manage data
sources), data visualizers (who can
translate data into visual form), data
change agents and data explorers
(who change how a company does business based on analyzing company data),
and even data frackers (who use enhanced or hidden measures to extract or
obtain data).
But it's not just data professionals who
are taking advantage of Brobdingnagian
data sets to get ahead. Nowhere is that
more evident than in the news, where a
new type of journalism has emerged that
uses statistics, programming, and other
digital data and tools to produce or shape
news stories. This data journalism
(or data-driven journalism) is exemplified by Nate Silver's FiveThirtyEight site,
a wildly popular exercise in precision
journalism and computer- assisted
reporting (or CAR).
And everyone, professional and amateur alike, no longer has the luxury of dealing with just "big" data. Now there is also
thick data (which combines both quantitative and qualitative analysis), long data
(which extends back in time hundreds or
thousands of years), hot data (which is
used constantly, meaning it must be easily and quickly accessible), and cold data
(which is used relatively infrequently, so
it can be less readily available).
In the 1980s we were told we needed
cultural literacy. Perhaps now we need
big-data literacy, not necessarily to
become proficient in analyzing large
data sets but to become aware of how
our everyday actions-our small data-
contribute to many different big-data sets
and what impact that might have on our
privacy and security. Let's learn how to
become custodians of our own data. n

SPECTRUM.IEEE.ORG

|

nORTh aMERICan

|

aUG 2015

|

29


http://SPECTRUM.IEEE.ORG

Table of Contents for the Digital Edition of IEEE Spectrum August, 2015

IEEE Spectrum August, 2015 - Cover1
IEEE Spectrum August, 2015 - Cover2
IEEE Spectrum August, 2015 - 1
IEEE Spectrum August, 2015 - 2
IEEE Spectrum August, 2015 - 3
IEEE Spectrum August, 2015 - 4
IEEE Spectrum August, 2015 - 5
IEEE Spectrum August, 2015 - 6
IEEE Spectrum August, 2015 - 7
IEEE Spectrum August, 2015 - 8
IEEE Spectrum August, 2015 - 9
IEEE Spectrum August, 2015 - 10
IEEE Spectrum August, 2015 - 11
IEEE Spectrum August, 2015 - 12
IEEE Spectrum August, 2015 - 13
IEEE Spectrum August, 2015 - 14
IEEE Spectrum August, 2015 - 15
IEEE Spectrum August, 2015 - 16
IEEE Spectrum August, 2015 - 17
IEEE Spectrum August, 2015 - 18
IEEE Spectrum August, 2015 - 19
IEEE Spectrum August, 2015 - 20
IEEE Spectrum August, 2015 - 21
IEEE Spectrum August, 2015 - 22
IEEE Spectrum August, 2015 - 23
IEEE Spectrum August, 2015 - 24
IEEE Spectrum August, 2015 - 25
IEEE Spectrum August, 2015 - 26
IEEE Spectrum August, 2015 - 27
IEEE Spectrum August, 2015 - 28
IEEE Spectrum August, 2015 - 29
IEEE Spectrum August, 2015 - 30
IEEE Spectrum August, 2015 - 31
IEEE Spectrum August, 2015 - 32
IEEE Spectrum August, 2015 - 33
IEEE Spectrum August, 2015 - 34
IEEE Spectrum August, 2015 - 35
IEEE Spectrum August, 2015 - 36
IEEE Spectrum August, 2015 - 37
IEEE Spectrum August, 2015 - 38
IEEE Spectrum August, 2015 - 39
IEEE Spectrum August, 2015 - 40
IEEE Spectrum August, 2015 - 41
IEEE Spectrum August, 2015 - 42
IEEE Spectrum August, 2015 - 43
IEEE Spectrum August, 2015 - 44
IEEE Spectrum August, 2015 - 45
IEEE Spectrum August, 2015 - 46
IEEE Spectrum August, 2015 - 47
IEEE Spectrum August, 2015 - 48
IEEE Spectrum August, 2015 - 49
IEEE Spectrum August, 2015 - 50
IEEE Spectrum August, 2015 - 51
IEEE Spectrum August, 2015 - 52
IEEE Spectrum August, 2015 - 53
IEEE Spectrum August, 2015 - 54
IEEE Spectrum August, 2015 - 55
IEEE Spectrum August, 2015 - 56
IEEE Spectrum August, 2015 - 57
IEEE Spectrum August, 2015 - 58
IEEE Spectrum August, 2015 - 59
IEEE Spectrum August, 2015 - 60
IEEE Spectrum August, 2015 - 61
IEEE Spectrum August, 2015 - 62
IEEE Spectrum August, 2015 - 63
IEEE Spectrum August, 2015 - 64
IEEE Spectrum August, 2015 - Cover3
IEEE Spectrum August, 2015 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1217
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1117
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1017
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0917
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0817
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0717
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0617
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0517
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0417
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0317
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0217
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0117
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1216
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1116
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1016
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0916
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0816
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0716
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0616
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0516
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0416
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0316
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0216
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0116
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1215
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1115
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1015
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0915
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0815
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0715
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0615
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0515
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0415
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0315
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0215
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0115
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1214
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1114
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1014
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0914
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0814
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0714
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0614
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0514
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0414
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0314
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0214
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0114
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1213
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1113
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1013
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0913
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0813
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0713
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0613
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0513
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0413
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0313
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0213
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0113
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1212
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1112
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1012
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0912
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0812
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0712
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0612
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0512
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0412
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0312
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0212
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0112
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1211
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1111
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1011
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0911
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0811
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0711
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0611
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0511
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0411
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0311
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0211
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0111
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1210
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1110
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1010
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0910
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0810
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0710
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0610
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0510
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0410
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0310
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0210
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0110
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1209
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1109
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1009
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0909
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0809
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0709
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0609
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0509
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0409
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0309
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0209
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0109
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1208
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1108
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1008
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0908
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0808
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0708
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0608
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0508
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0408
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0308
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0208
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0108
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1207
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1107
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1007
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0907
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0807
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0707
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0607
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0507
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0407
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0307
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0207
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0107
https://www.nxtbookmedia.com