IEEE Spectrum July, 2013 - 33

IdentIfyIng mutatIons
Using the MapReduce software framework, the raw data from a sequencing machine is divided up and distributed
among many computers. In the "map" step, these computers try to match strings of nucleotides to locations in the
reference genome. Then they compare results in the "reduce" step to either confirm that a string perfectly corresponds
to the reference genome or to identify a mismatch-a mutation.

moving the code to the data rather than having to access data in a
comparatively slow file server. This structure also brings a reliability bonus, even on off-the-shelf servers and disks. Google created
MapReduce to run in data centers packed with cheap commodity computers, some of which were expected to fail every day, so
fault tolerance was built into the system. When a data set is loaded
into the program, it's split up into manageable chunks, and each
chunk is replicated and sent to several computer nodes. If one fails,
the others go on. This model also works well in a flexible setting
such as the Amazon Elastic Compute Cloud, where nodes can be
provisioned for an application as needed, on the fly, and leased
on a per-hour basis.
illustration by

L-Dopa

We're still a long way from having anything as powerful as a Web
search engine for sequencing data,
but our research groups are trying to
exploit what we already know about
cloud computing and text indexing to
make vast sequencing data archives
more usable. Right now, agencies
like the National Institutes of Health
maintain public archives containing
petabytes of genetic data. But without
easy search methods, such databases
are significantly underused, and all
that valuable data is essentially dead.
We need to develop tools that make
each archive a useful living entity the
way that Google makes the Web a useful living entity. If we can make these
archives more searchable, we will empower researchers to pose scientific
questions over much larger collections of data, enabling greater insights.

This year, genomics researchers
may reach a remarkable milestone:
theĀ US $1000 genome. Experts have
long said that when the cost of sequencing a human genome falls to that
level, the technology can be used routinely in biological research and medical care. The high-capacity Illumina
systems are nearing this price point,
as is the Ion Proton machine from San
Diego-based Life Technologies.
Such sequencing capacity is already enabling projects that can reinvent major sectors of technology,
science, and medicine. For example, the U.S. Department of Energy
recently launched KBase, a knowledge base for biofuel research that
integrates hundreds of terabytes of
genomic and other biological data
inside its own compute cloud. KBase will use state-of-the-art machine learning and data-mining techniques to build predictive
models of how genome variations influence the growth of plants
and microbes in different environments. Researchers can then
select which plants and microbes should be bred or genetically engineered to become more robust, or to produce more usable oils.
This scenario is just a hint of what is to come if we can figure
out how to channel the data deluge in genomics. As sequencing
machines spew out floods of As, Ts, Cs, and Gs, software and hardware will determine how much we all benefit. n
Post your comments at http://spectrum.ieee.org/dnadata0713
SPectrum.ieee.orG

|

north american

|

jul 2013

|

33


http://spectrum.ieee.org/dnadata0713 http://SPectrum.ieee.orG

Table of Contents for the Digital Edition of IEEE Spectrum July, 2013

IEEE Spectrum July, 2013 - Cover1
IEEE Spectrum July, 2013 - Cover2
IEEE Spectrum July, 2013 - 1
IEEE Spectrum July, 2013 - 2
IEEE Spectrum July, 2013 - 3
IEEE Spectrum July, 2013 - 4
IEEE Spectrum July, 2013 - 5
IEEE Spectrum July, 2013 - 6
IEEE Spectrum July, 2013 - 7
IEEE Spectrum July, 2013 - 8
IEEE Spectrum July, 2013 - 9
IEEE Spectrum July, 2013 - 10
IEEE Spectrum July, 2013 - 11
IEEE Spectrum July, 2013 - 12
IEEE Spectrum July, 2013 - 13
IEEE Spectrum July, 2013 - 14
IEEE Spectrum July, 2013 - 15
IEEE Spectrum July, 2013 - 16
IEEE Spectrum July, 2013 - 17
IEEE Spectrum July, 2013 - 18
IEEE Spectrum July, 2013 - 19
IEEE Spectrum July, 2013 - 20
IEEE Spectrum July, 2013 - 21
IEEE Spectrum July, 2013 - 22
IEEE Spectrum July, 2013 - 23
IEEE Spectrum July, 2013 - 24
IEEE Spectrum July, 2013 - 25
IEEE Spectrum July, 2013 - 26
IEEE Spectrum July, 2013 - 27
IEEE Spectrum July, 2013 - 28
IEEE Spectrum July, 2013 - 29
IEEE Spectrum July, 2013 - 30
IEEE Spectrum July, 2013 - 31
IEEE Spectrum July, 2013 - 32
IEEE Spectrum July, 2013 - 33
IEEE Spectrum July, 2013 - 34
IEEE Spectrum July, 2013 - 35
IEEE Spectrum July, 2013 - 36
IEEE Spectrum July, 2013 - 37
IEEE Spectrum July, 2013 - 38
IEEE Spectrum July, 2013 - 39
IEEE Spectrum July, 2013 - 40
IEEE Spectrum July, 2013 - 41
IEEE Spectrum July, 2013 - 42
IEEE Spectrum July, 2013 - 43
IEEE Spectrum July, 2013 - 44
IEEE Spectrum July, 2013 - 45
IEEE Spectrum July, 2013 - 46
IEEE Spectrum July, 2013 - 47
IEEE Spectrum July, 2013 - 48
IEEE Spectrum July, 2013 - 49
IEEE Spectrum July, 2013 - 50
IEEE Spectrum July, 2013 - 51
IEEE Spectrum July, 2013 - 52
IEEE Spectrum July, 2013 - 53
IEEE Spectrum July, 2013 - 54
IEEE Spectrum July, 2013 - 55
IEEE Spectrum July, 2013 - 56
IEEE Spectrum July, 2013 - 57
IEEE Spectrum July, 2013 - 58
IEEE Spectrum July, 2013 - 59
IEEE Spectrum July, 2013 - 60
IEEE Spectrum July, 2013 - Cover3
IEEE Spectrum July, 2013 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1217
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1117
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1017
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0917
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0817
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0717
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0617
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0517
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0417
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0317
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0217
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0117
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1216
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1116
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1016
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0916
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0816
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0716
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0616
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0516
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0416
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0316
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0216
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0116
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1215
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1115
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1015
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0915
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0815
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0715
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0615
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0515
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0415
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0315
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0215
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0115
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1214
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1114
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1014
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0914
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0814
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0714
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0614
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0514
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0414
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0314
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0214
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0114
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1213
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1113
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1013
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0913
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0813
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0713
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0613
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0513
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0413
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0313
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0213
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0113
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1212
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1112
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1012
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0912
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0812
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0712
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0612
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0512
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0412
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0312
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0212
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0112
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1211
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1111
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1011
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0911
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0811
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0711
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0611
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0511
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0411
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0311
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0211
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0111
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1210
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1110
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1010
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0910
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0810
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0710
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0610
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0510
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0410
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0310
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0210
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0110
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1209
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1109
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1009
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0909
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0809
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0709
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0609
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0509
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0409
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0309
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0209
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0109
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1208
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1108
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1008
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0908
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0808
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0708
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0608
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0508
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0408
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0308
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0208
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0108
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1207
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1107
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1007
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0907
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0807
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0707
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0607
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0507
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0407
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0307
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0207
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0107
https://www.nxtbookmedia.com