IEEE Solid-State Circuits Magazine - Summer 2016 - 54
(a)
(b)
(c)
FIGURE 1: (a) The Stanford multiple camera array configured for high-resolution video, (b) Wilburn and Horowitz with the array when
configured for wide area capture, and (c) an array tightly packed with overlapping fields of view for high-speed video capture and synthetic
aperture photography.
Wilburn, along with other members of the Stanford Graphics Lab,
took advantage of the flexibility and
control of the camera array to explore
several high-performance imaging
applications. (See Figure 1.) For example, by packing the cameras densely,
overlapping their fields of view, and
staggering their trigger times, they
turned 52 inexpensive 30 frame-persecond (f/s) cameras into a virtual
1,560 f/s camera. (See Figure 2.) In
another configuration, 96 cameras
with partially overlapping fields of
view, varying exposure times, and
simultaneous trigger times created a
high-resolution, high-dynamic range
video camera [3].
A more complex high-performance
imaging application for the camera
array was synthetic aperture photography. (See Figure 3.) The team spread
the cameras over a 1- or 2-m-wide aperture and digitally simulated the very
shallow depth of field that a camera
with such a large aperture would have.
For example, partially occluding foliage could be blurred away to reveal
what was in the background. This application drove the creation of new
calibration methods for large camera
arrays [2]. The team also demonstrated
a real-time system for synthetic aperture video that could follow individuals in a crowd even when most of the
cameras were occluded [4]. This synthetic aperture photography work inspired Ren Ng to invent the handheld
light field camera, described later.
One original goal for the camera
array was view interpolation. Motivated by the "bullet-time" effects in
the movie The Matrix, the team aimed
to record a sequence once and then
(a)
FIGURE 2: Three frames of a 1,560 f/s video of a popping balloon.
54
s u m m e r 2 0 16
IEEE SOLID-STATE CIRCUITS MAGAZINE
(b)
replay it later with camera paths
through the scene, either at normal
speed or perhaps in slow motion.
Prior multiview capture systems synchronized cameras to trigger all at
the same time. Following the camera
array's high-speed work, Mark and his
students realized that by triggering
all of the cameras at slightly different
times, they could use a simple imagebased algorithm to render different
virtual camera trajectories, especially
ones involving slow motion, resulting
in a significantly higher frame rate
than the cameras in the base array.
During this effort, Mark was mentoring his students in what was
largely a new field for all of them.
After spending time to understand the
optical physics in a particularly dense
paper, he and his students jokingly
referred to his office as the "circle of
(c)
Table of Contents for the Digital Edition of IEEE Solid-State Circuits Magazine - Summer 2016
IEEE Solid-State Circuits Magazine - Summer 2016 - Cover1
IEEE Solid-State Circuits Magazine - Summer 2016 - Cover2
IEEE Solid-State Circuits Magazine - Summer 2016 - 1
IEEE Solid-State Circuits Magazine - Summer 2016 - 2
IEEE Solid-State Circuits Magazine - Summer 2016 - 3
IEEE Solid-State Circuits Magazine - Summer 2016 - 4
IEEE Solid-State Circuits Magazine - Summer 2016 - 5
IEEE Solid-State Circuits Magazine - Summer 2016 - 6
IEEE Solid-State Circuits Magazine - Summer 2016 - 7
IEEE Solid-State Circuits Magazine - Summer 2016 - 8
IEEE Solid-State Circuits Magazine - Summer 2016 - 9
IEEE Solid-State Circuits Magazine - Summer 2016 - 10
IEEE Solid-State Circuits Magazine - Summer 2016 - 11
IEEE Solid-State Circuits Magazine - Summer 2016 - 12
IEEE Solid-State Circuits Magazine - Summer 2016 - 13
IEEE Solid-State Circuits Magazine - Summer 2016 - 14
IEEE Solid-State Circuits Magazine - Summer 2016 - 15
IEEE Solid-State Circuits Magazine - Summer 2016 - 16
IEEE Solid-State Circuits Magazine - Summer 2016 - 17
IEEE Solid-State Circuits Magazine - Summer 2016 - 18
IEEE Solid-State Circuits Magazine - Summer 2016 - 19
IEEE Solid-State Circuits Magazine - Summer 2016 - 20
IEEE Solid-State Circuits Magazine - Summer 2016 - 21
IEEE Solid-State Circuits Magazine - Summer 2016 - 22
IEEE Solid-State Circuits Magazine - Summer 2016 - 23
IEEE Solid-State Circuits Magazine - Summer 2016 - 24
IEEE Solid-State Circuits Magazine - Summer 2016 - 25
IEEE Solid-State Circuits Magazine - Summer 2016 - 26
IEEE Solid-State Circuits Magazine - Summer 2016 - 27
IEEE Solid-State Circuits Magazine - Summer 2016 - 28
IEEE Solid-State Circuits Magazine - Summer 2016 - 29
IEEE Solid-State Circuits Magazine - Summer 2016 - 30
IEEE Solid-State Circuits Magazine - Summer 2016 - 31
IEEE Solid-State Circuits Magazine - Summer 2016 - 32
IEEE Solid-State Circuits Magazine - Summer 2016 - 33
IEEE Solid-State Circuits Magazine - Summer 2016 - 34
IEEE Solid-State Circuits Magazine - Summer 2016 - 35
IEEE Solid-State Circuits Magazine - Summer 2016 - 36
IEEE Solid-State Circuits Magazine - Summer 2016 - 37
IEEE Solid-State Circuits Magazine - Summer 2016 - 38
IEEE Solid-State Circuits Magazine - Summer 2016 - 39
IEEE Solid-State Circuits Magazine - Summer 2016 - 40
IEEE Solid-State Circuits Magazine - Summer 2016 - 41
IEEE Solid-State Circuits Magazine - Summer 2016 - 42
IEEE Solid-State Circuits Magazine - Summer 2016 - 43
IEEE Solid-State Circuits Magazine - Summer 2016 - 44
IEEE Solid-State Circuits Magazine - Summer 2016 - 45
IEEE Solid-State Circuits Magazine - Summer 2016 - 46
IEEE Solid-State Circuits Magazine - Summer 2016 - 47
IEEE Solid-State Circuits Magazine - Summer 2016 - 48
IEEE Solid-State Circuits Magazine - Summer 2016 - 49
IEEE Solid-State Circuits Magazine - Summer 2016 - 50
IEEE Solid-State Circuits Magazine - Summer 2016 - 51
IEEE Solid-State Circuits Magazine - Summer 2016 - 52
IEEE Solid-State Circuits Magazine - Summer 2016 - 53
IEEE Solid-State Circuits Magazine - Summer 2016 - 54
IEEE Solid-State Circuits Magazine - Summer 2016 - 55
IEEE Solid-State Circuits Magazine - Summer 2016 - 56
IEEE Solid-State Circuits Magazine - Summer 2016 - 57
IEEE Solid-State Circuits Magazine - Summer 2016 - 58
IEEE Solid-State Circuits Magazine - Summer 2016 - 59
IEEE Solid-State Circuits Magazine - Summer 2016 - 60
IEEE Solid-State Circuits Magazine - Summer 2016 - 61
IEEE Solid-State Circuits Magazine - Summer 2016 - 62
IEEE Solid-State Circuits Magazine - Summer 2016 - 63
IEEE Solid-State Circuits Magazine - Summer 2016 - 64
IEEE Solid-State Circuits Magazine - Summer 2016 - 65
IEEE Solid-State Circuits Magazine - Summer 2016 - 66
IEEE Solid-State Circuits Magazine - Summer 2016 - 67
IEEE Solid-State Circuits Magazine - Summer 2016 - 68
IEEE Solid-State Circuits Magazine - Summer 2016 - 69
IEEE Solid-State Circuits Magazine - Summer 2016 - 70
IEEE Solid-State Circuits Magazine - Summer 2016 - 71
IEEE Solid-State Circuits Magazine - Summer 2016 - 72
IEEE Solid-State Circuits Magazine - Summer 2016 - 73
IEEE Solid-State Circuits Magazine - Summer 2016 - 74
IEEE Solid-State Circuits Magazine - Summer 2016 - 75
IEEE Solid-State Circuits Magazine - Summer 2016 - 76
IEEE Solid-State Circuits Magazine - Summer 2016 - 77
IEEE Solid-State Circuits Magazine - Summer 2016 - 78
IEEE Solid-State Circuits Magazine - Summer 2016 - 79
IEEE Solid-State Circuits Magazine - Summer 2016 - 80
IEEE Solid-State Circuits Magazine - Summer 2016 - 81
IEEE Solid-State Circuits Magazine - Summer 2016 - 82
IEEE Solid-State Circuits Magazine - Summer 2016 - 83
IEEE Solid-State Circuits Magazine - Summer 2016 - 84
IEEE Solid-State Circuits Magazine - Summer 2016 - 85
IEEE Solid-State Circuits Magazine - Summer 2016 - 86
IEEE Solid-State Circuits Magazine - Summer 2016 - 87
IEEE Solid-State Circuits Magazine - Summer 2016 - 88
IEEE Solid-State Circuits Magazine - Summer 2016 - 89
IEEE Solid-State Circuits Magazine - Summer 2016 - 90
IEEE Solid-State Circuits Magazine - Summer 2016 - 91
IEEE Solid-State Circuits Magazine - Summer 2016 - 92
IEEE Solid-State Circuits Magazine - Summer 2016 - 93
IEEE Solid-State Circuits Magazine - Summer 2016 - 94
IEEE Solid-State Circuits Magazine - Summer 2016 - 95
IEEE Solid-State Circuits Magazine - Summer 2016 - 96
IEEE Solid-State Circuits Magazine - Summer 2016 - Cover3
IEEE Solid-State Circuits Magazine - Summer 2016 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2019
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2019
https://www.nxtbook.com/nxtbooks/ieee/mssc_2019summer
https://www.nxtbook.com/nxtbooks/ieee/mssc_2019winter
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018fall
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018summer
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018spring
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018winter
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2014
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2014
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2014
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2014
https://www.nxtbookmedia.com