Signal Processing - September 2016 - 58
pathway to scattered imaging. Such examples motivate the
necessity of hardware or computational imaging solutions
that can over come the current technological limits.
Acknowledgments
Ayush Bhandari thanks Prof. T. Blu for a first-hand introduction to the topic of sparse sampling as well as mathematical
advice over the years. In fact, a more general result linked with
the problem of lifetime imaging was devised with the help of
Prof. Blu's advice. We thank Chris Barsi, Refael Whyte, Jamie
Schiel, Achuta Kadambi, and Shahram Izadi for their collaboration and various discussions centered on the experimental
aspects of ToF imaging.
Authors
Ayush Bhandari (ayush@mit.edu) is a researcher at the
Massachusetts Institute of Technology (MIT). Prior to working at
MIT, he held various research positions starting with INRIA-
Rennes, France, followed by Nanyang Technological University,
Singapore, and the Chinese University of Hong Kong, with the
most recent appointment at École Polytechnique Fédérale de
Lausanne, Switzerland. His research interests include sampling
and approximation theory and inverse problems linked with computational imaging. He was recipient of the Best Student Paper
Award at the IEEE International Symposium on Signal Processing
and Its Applications (2007) and the Best Paper Award at the IEEE
Systems and Information Engineering Design Symposium (2007).
Ramesh Raskar (raskar@mit.edu) heads the Camera
Culture Research Group at the Massachusetts Institute of
Technology Media Lab. His research interests span the fields of
computational photography, inverse problems in imaging, and
human-computer interaction. He has been the recipient of
numerous awards including the TR100 Award from Technology
Review, the Global Indus Technovator Award, Sloan Research
Fellowship (2009), and the DARPA Young Faculty Award
(2010). Other awards include Marr Prize honorable mention
(2009), LAUNCH Health Innovation Award, and the 2011
Vodafone Wireless Innovation Project Award (first place).
He holds more than 40 U.S. patents and is currently coauthoring a book on computational photography.
References
[1] O. Cossairt, M. Gupta, and S. K. Nayar, "When does computational imaging improve
performance?" IEEE Trans. Image Processing, vol. 22, no. 2, pp. 447-458, 2013.
[8] G. Zheng, R. Horstmeyer, and C. Yang, "Wide-field, high-resolution Fourier
ptychographic microscopy," Nat. Photon., vol. 7, no. 9, pp. 739-745, 2013.
[9] R. I. Hartley and P. Sturm, "Triangulation," Comp. Vis. Image Understand.,
vol. 68, no. 2, pp. 146-157, 1997.
[10] A. Velten, T. Willwacher, O. Gupta, A. Veeraraghavan, M. Bawendi, and R.
Raskar, "Recovering three-dimensional shape around a corner using ultrafast timeof-flight imaging," Nat. Commun, vol. 3, pp. 745, Mar. 2012.
[11] O. Katz, P. Heidmann, M. Fink, and S. Gigan, "Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations," Nat.
Photon., vol. 8, no. 10, pp. 784-790, 2014.
[12] M. Laurenzis, J. Klein, E. Bacher, and N. Metzger, Multiple-return single-photon counting of light in flight and sensing of non-line-of-sight objects at shortwave
infrared wavelengths," Opt. Lett., vol. 40, no. 20, pp. 4815-4818, 2015.
[13] G. Gariepy, N. Krstajic´, R. Henderson, C. Li, R. R. Thomson, G. S. Buller, B.
Heshmat, R. Raskar, J. Leach, and D. Faccio, Single-photon sensitive light-in-flight
imaging," Nat. Commun., vol. 6, Jan. 2015.
[14] A. Kirmani, D. Venkatraman, D. Shin, A. Colaço, F. N. Wong, J. H. Shapiro,
and V. K. Goyal, "First-photon imaging," Science, vol. 343, no. 6166, pp. 58-61, 2014.
[15] F. Heide, M. B. Hullin, J. Gregson, and W. Heidrich, "Low-budget transient
imaging using photonic mixer devices," ACM Trans. Graph., vol. 32, no. 4, pp.
45:1-45:10, 2013.
[16] A. Kadambi, R. Whyte, A. Bhandari, L. Streeter, C. Barsi, A. Dorrington, and
R. Raskar, "Coded time of flight cameras: Sparse deconvolution to address multipath
interference and recover time profiles," ACM Trans. Graph., vol. 32, no. 6, pp. 167, 2013.
[17] F. Heide, L. Xiao, W. Heidrich, and M. B. Hullin, "Diffuse mirrors: 3-D reconstruction from diffuse indirect illumination using inexpensive time-of-flight sensors,"
in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Columbus, OH,
2014, pp. 3222-3229.
[18] F. Heide, L. Xiao, A. Kolb, M. B. Hullin, and W. Heidrich, "Imaging in scattering media using correlation image sensors and sparse convolutional coding," Opt.
Express, vol. 22, no. 21, pp. 26338-26350, Oct. 2014.
[19] A. Kadambi, A. Bhandari, R. Whyte, A. Dorrington, and R. Raskar,
"Demultiplexing illumination via low cost sensing and nanosecond coding," in Proc.
IEEE Int. Conf. Computational Photography, Santa Clara, CA, 2014, pp. 1-10.
[20] N. Kitsunezaki, E. Adachi, T. Masuda, and J. I. Mizusawa, "KINECT applications for the physical rehabilitation," in Proc. IEEE Int. Symp. Medical
Measurements and Applications, Gatineau, Quebec, Canada, 2013, pp. 294-299.
[21] A. Bhandari, C. Barsi, and R. Raskar, "Blind and reference-free fluorescence
lifetime estimation via consumer time-of-flight sensors," Optica, vol. 2, no. 11, pp.
965-973, Nov. 2015.
[22] S. Foix, G. Alenya, and C. Torras, "Lock-in time-of-flight (ToF) cameras: A
survey," IEEE Sensors J., vol. 11, no. 9, pp. 1917-1926, 2011.
[23] B. Büttgen, E. Mechat, M. Hamed-Ali, F. Lustenberger, and P. Seitz,
"Pseudonoise optical modulation for real-time 3-d imaging with minimum interference," IEEE Trans. Circuits Syst. I, vol. 54, no. 10, pp. 2109-2119, 2007.
[24] A. Bhandari, A. Kadambi, and R. Raskar, "Sparse linear operator identification without sparse regularization? Applications to mixed pixel problem in TOF/
range imaging," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal
Processing, Florence, Italy, 2014, pp. 365-369.
[25] A. Bhandari, A. Kadambi, R. Whyte, C. Barsi, M. Feigin, A. Dorrington, and
R. Raskar, "Resolving multipath interference in time-of-flight imaging via modulation frequency diversity and sparse regularization," Opt. Lett., vol. 39, no. 7, 2014.
[26] Y. Hua, A. Gershman, and Q. Cheng, High-Resolution and Robust Signal
Processing. Boca Raton, FL: CRC Press, 2003.
[27] T. Blu, P. L. Dragotti, M. Vetterli, P. Marziliano, and L. Coulot, "Sparse sampling of
signal innovations," IEEE Signal Processing Mag., vol. 25, no. 2, pp. 31-40, 2008.
[28] L. Ljung, System Identification. New York: Springer, 1998.
[2] R. Raskar, A. Agrawal, and J. Tumblin, "Coded exposure photography: Motion
deblurring using fluttered shutter," ACM Trans. Graph., vol. 25, no. 3, pp. 795-804,
2006.
[29] R. Tur, Y. C. Eldar, and Z. Friedman, "Innovation rate sampling of pulse
streams with application to ultrasound imaging," IEEE Trans. Signal Processing,
vol. 59, no. 4, pp. 1827-1842, 2011.
[3] S. S. Gorthi, D. Schaak, and E. Schonbrun, "Fluorescence imaging of flowing
cells using a temporally coded excitation," Opt. Express, vol. 21, no. 4, pp. 5164-5170,
2013.
[30] S. Hernandez-Marin, A. M. Wallace, and G. J. Gibson, "Bayesian analysis of
lidar signals with multiple returns," IEEE Trans. Patt. Anal. Machine Intell., vol.
29, no. 12, pp. 2170-2180, 2007.
[4] P. E. Debevec and J. Malik, "Recovering high dynamic range radiance maps
from photographs," in Proc. 24th Annu. Conf. Computer Graphics and Interactive
Techniques (ACM SIGGRAPH), New York, 2008, p. 369-378.
[31] D. Shin, F. Xu, F. N. Wong, J. H. Shapiro, and V. K. Goyal, "Computational multidepth single-photon imaging," Optics Express, vol. 24, no. 3, pp. 1873-1888, 2016.
[5] R. Ng, "Fourier slice photography," ACM Trans. Graph., vol. 24, no. 3, pp. 735-
744, 2005.
[32] A. Bhandari, A. M. Wallace, and R. Raskar, "Super-resolved time-of-flight
sensing via FRI sampling theory," in Proc. IEEE Int. Conf. Acoustics, Speech, and
Signal Processing (ICASSP), 2016, pp. 4009-4013.
[6] A. Veeraraghavan, R. Raskar, A. Agrawal, A. Mohan, and J. Tumblin,
"Dappled photography: Mask enhanced cameras for heterodyned light fields and
coded aperture refocusing," ACM Trans. Graph., vol. 26, no. 3, pp. 69, 2007.
[33] A. P. P. Jongenelen, D. G. Bailey, A. D. Payne, A. A. Dorrington, and D. A
Carnegie, "Analysis of errors in ToF imaging with dual-frequency modulation,"
IEEE Trans. Instrum. Meas., vol. 60, no. 5, pp. 1861-1868, 2011.
[7] M. F. Duarte, M. A. Davenport, D. Takhar, J. N. Laska, T. Sun, K. E. Kelly, and
R. G. Baraniuk, "Single-pixel imaging via compressive sampling," IEEE Signal
Processing Mag., vol. 25, no. 2, pp. 83-91, 2008.
[34] G. Tang, N. Bhaskar, and B. Recht, "Near minmax line spectral estimation,"
IEEE Trans. Inform. Theory, vol. 61, no. 1, pp. 499-512, 2015.
58
IEEE SIgnal ProcESSIng MagazInE
SP
|
September 2016
|
Table of Contents for the Digital Edition of Signal Processing - September 2016
Signal Processing - September 2016 - Cover1
Signal Processing - September 2016 - Cover2
Signal Processing - September 2016 - 1
Signal Processing - September 2016 - 2
Signal Processing - September 2016 - 3
Signal Processing - September 2016 - 4
Signal Processing - September 2016 - 5
Signal Processing - September 2016 - 6
Signal Processing - September 2016 - 7
Signal Processing - September 2016 - 8
Signal Processing - September 2016 - 9
Signal Processing - September 2016 - 10
Signal Processing - September 2016 - 11
Signal Processing - September 2016 - 12
Signal Processing - September 2016 - 13
Signal Processing - September 2016 - 14
Signal Processing - September 2016 - 15
Signal Processing - September 2016 - 16
Signal Processing - September 2016 - 17
Signal Processing - September 2016 - 18
Signal Processing - September 2016 - 19
Signal Processing - September 2016 - 20
Signal Processing - September 2016 - 21
Signal Processing - September 2016 - 22
Signal Processing - September 2016 - 23
Signal Processing - September 2016 - 24
Signal Processing - September 2016 - 25
Signal Processing - September 2016 - 26
Signal Processing - September 2016 - 27
Signal Processing - September 2016 - 28
Signal Processing - September 2016 - 29
Signal Processing - September 2016 - 30
Signal Processing - September 2016 - 31
Signal Processing - September 2016 - 32
Signal Processing - September 2016 - 33
Signal Processing - September 2016 - 34
Signal Processing - September 2016 - 35
Signal Processing - September 2016 - 36
Signal Processing - September 2016 - 37
Signal Processing - September 2016 - 38
Signal Processing - September 2016 - 39
Signal Processing - September 2016 - 40
Signal Processing - September 2016 - 41
Signal Processing - September 2016 - 42
Signal Processing - September 2016 - 43
Signal Processing - September 2016 - 44
Signal Processing - September 2016 - 45
Signal Processing - September 2016 - 46
Signal Processing - September 2016 - 47
Signal Processing - September 2016 - 48
Signal Processing - September 2016 - 49
Signal Processing - September 2016 - 50
Signal Processing - September 2016 - 51
Signal Processing - September 2016 - 52
Signal Processing - September 2016 - 53
Signal Processing - September 2016 - 54
Signal Processing - September 2016 - 55
Signal Processing - September 2016 - 56
Signal Processing - September 2016 - 57
Signal Processing - September 2016 - 58
Signal Processing - September 2016 - 59
Signal Processing - September 2016 - 60
Signal Processing - September 2016 - 61
Signal Processing - September 2016 - 62
Signal Processing - September 2016 - 63
Signal Processing - September 2016 - 64
Signal Processing - September 2016 - 65
Signal Processing - September 2016 - 66
Signal Processing - September 2016 - 67
Signal Processing - September 2016 - 68
Signal Processing - September 2016 - 69
Signal Processing - September 2016 - 70
Signal Processing - September 2016 - 71
Signal Processing - September 2016 - 72
Signal Processing - September 2016 - 73
Signal Processing - September 2016 - 74
Signal Processing - September 2016 - 75
Signal Processing - September 2016 - 76
Signal Processing - September 2016 - 77
Signal Processing - September 2016 - 78
Signal Processing - September 2016 - 79
Signal Processing - September 2016 - 80
Signal Processing - September 2016 - 81
Signal Processing - September 2016 - 82
Signal Processing - September 2016 - 83
Signal Processing - September 2016 - 84
Signal Processing - September 2016 - 85
Signal Processing - September 2016 - 86
Signal Processing - September 2016 - 87
Signal Processing - September 2016 - 88
Signal Processing - September 2016 - 89
Signal Processing - September 2016 - 90
Signal Processing - September 2016 - 91
Signal Processing - September 2016 - 92
Signal Processing - September 2016 - 93
Signal Processing - September 2016 - 94
Signal Processing - September 2016 - 95
Signal Processing - September 2016 - 96
Signal Processing - September 2016 - 97
Signal Processing - September 2016 - 98
Signal Processing - September 2016 - 99
Signal Processing - September 2016 - 100
Signal Processing - September 2016 - 101
Signal Processing - September 2016 - 102
Signal Processing - September 2016 - 103
Signal Processing - September 2016 - 104
Signal Processing - September 2016 - 105
Signal Processing - September 2016 - 106
Signal Processing - September 2016 - 107
Signal Processing - September 2016 - 108
Signal Processing - September 2016 - 109
Signal Processing - September 2016 - 110
Signal Processing - September 2016 - 111
Signal Processing - September 2016 - 112
Signal Processing - September 2016 - 113
Signal Processing - September 2016 - 114
Signal Processing - September 2016 - 115
Signal Processing - September 2016 - 116
Signal Processing - September 2016 - 117
Signal Processing - September 2016 - 118
Signal Processing - September 2016 - 119
Signal Processing - September 2016 - 120
Signal Processing - September 2016 - 121
Signal Processing - September 2016 - 122
Signal Processing - September 2016 - 123
Signal Processing - September 2016 - 124
Signal Processing - September 2016 - 125
Signal Processing - September 2016 - 126
Signal Processing - September 2016 - 127
Signal Processing - September 2016 - 128
Signal Processing - September 2016 - 129
Signal Processing - September 2016 - 130
Signal Processing - September 2016 - 131
Signal Processing - September 2016 - 132
Signal Processing - September 2016 - 133
Signal Processing - September 2016 - 134
Signal Processing - September 2016 - 135
Signal Processing - September 2016 - 136
Signal Processing - September 2016 - 137
Signal Processing - September 2016 - 138
Signal Processing - September 2016 - 139
Signal Processing - September 2016 - 140
Signal Processing - September 2016 - 141
Signal Processing - September 2016 - 142
Signal Processing - September 2016 - 143
Signal Processing - September 2016 - 144
Signal Processing - September 2016 - 145
Signal Processing - September 2016 - 146
Signal Processing - September 2016 - 147
Signal Processing - September 2016 - 148
Signal Processing - September 2016 - 149
Signal Processing - September 2016 - 150
Signal Processing - September 2016 - 151
Signal Processing - September 2016 - 152
Signal Processing - September 2016 - 153
Signal Processing - September 2016 - 154
Signal Processing - September 2016 - 155
Signal Processing - September 2016 - 156
Signal Processing - September 2016 - 157
Signal Processing - September 2016 - 158
Signal Processing - September 2016 - 159
Signal Processing - September 2016 - 160
Signal Processing - September 2016 - 161
Signal Processing - September 2016 - 162
Signal Processing - September 2016 - 163
Signal Processing - September 2016 - 164
Signal Processing - September 2016 - 165
Signal Processing - September 2016 - 166
Signal Processing - September 2016 - 167
Signal Processing - September 2016 - 168
Signal Processing - September 2016 - 169
Signal Processing - September 2016 - 170
Signal Processing - September 2016 - 171
Signal Processing - September 2016 - 172
Signal Processing - September 2016 - 173
Signal Processing - September 2016 - 174
Signal Processing - September 2016 - 175
Signal Processing - September 2016 - 176
Signal Processing - September 2016 - Cover3
Signal Processing - September 2016 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201809
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201807
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201805
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201803
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201801
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1117
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0917
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0717
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0517
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0317
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0117
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1116
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0916
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0716
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0516
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0316
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0116
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1115
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0915
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0715
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0515
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0315
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0115
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1114
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0914
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0714
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0514
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0314
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0114
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1113
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0913
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0713
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0513
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0313
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0113
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1112
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0912
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0712
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0512
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0312
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0112
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1111
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0911
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0711
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0511
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0311
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0111
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1110
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0910
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0710
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0510
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0310
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0110
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1109
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0909
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0709
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0509
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0309
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0109
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1108
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0908
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0708
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0508
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0308
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0108
https://www.nxtbookmedia.com