Signal Processing - September 2016 - 22

miniature cameras may be discretely placed where their presence is unwanted. Blunt legal and societal restrictions to these
types of small sensors may unintentionally harm the huge
potential upside in terms of new applications and new platforms. Computational photography can provide answers to
some of these challenges. For example, [23] proposes a new
layer of optical privacy for small sensors, where optics filter
or block sensitive information directly from the incident lightfield before sensor measurements are made.
To conclude, we have shown that there is a confluence
of technologies over the past few decades that has made the
tools for enabling miniature computational photography possible. This has resulted in a recent surge of activity to build
computational cameras, displays, and sensors that push the
limits of size, power, weight, and mass. Miniature computational photography has great potential for applications in
a variety of fields where small, networked platforms are
already making an appearance, such as agriculture, security,
health, and the Internet of Things. There are dangers regarding social acceptance of a trillion networked eyes around us,
which can and should also be solved by computational photography research.

Author
Sanjeev J. Koppal (sjkoppal@ece.ufl.edu) received his B.S.
degree from the University of Southern California in 2003. He
obtained his master's and Ph.D. degrees from the Robotics
Institute at Carnegie Mellon University (CMU). After CMU,
he was a postdoctoral research associate in the School of
Engineering and Applied Sciences at Harvard University. He
is an assistant professor in the Electrical and Computer
Engineering Department at the University of Florida (UF).
Prior to joining UF, he was a researcher at Texas Instruments'
Imaging R&D lab. His interests span computer vision, computational photography, and optics and include novel cameras
and sensors, three-dimensional reconstruction, physics-based
vision, and active illumination.

[8] E. T. Enikov, M. T. Gibson, and S. J. Ritty, "Novel extrusion system for the
encapsulation of drug releasing bio-medical micro-robots," in Proc. ICME Int.
Conf. Complex Medical Engineering, 2009, pp. 1-6.
[9] C. Farabet, C. Poulet, and Y. LeCun, "An FPGA-based stream processor for
embedded real-time vision with convolutional networks," in Proc. IEEE 12th Int.
Conf. Computer Vision Workshop, Kyoto, Japan, 2009, pp. 878-885.
[10] P. R. Gill and D. G. Stork, "Lensless ultra-miniature imagers using odd-symmetry
spiral phase gratings," in Proc. Computational Optical Sensing and Imaging,
Optical Society of America, Arlington, VA, 2013, pp. CW4C.3.
[11] C. Gimkiewicz, C. Urban, E. Innerhofer, P. Ferrat, S. Neukom, G.
Vanstraelen, and P. Seitz, "Ultra-miniature catadioptrical system for an omnidirectional camera," in Proc. Photonics Europe, Int. Soc. Optics and Photonics, 2008,
pp. 69920J-69920J.
[12] J. W. Goodman, Introduction to Fourier Optics. New York: McGraw-Hill,
1968.
[13] V. Gruev, R. Perkins, and T. York, "CCD polarization imaging sensor with aluminum nanowire optical filters," Opt. Express, vol. 18, no. 18, pp. 19087-19094,
2010.
[14] B. Gyselinckx, C. Van Hoof, J. Ryckaert, R. F. Yazicioglu, P. Fiorini, and V.
Leonov, "Human++: Autonomous wireless sensors for body area networks," in
Proc. IEEE Custom Integrated Circuits Conf., 2006, pp. 13-19.
[15] M. Hirsch, S. Sivaramakrishnan, S. Jayasuriya, A. Wang, A. Molnar, R.
Raskar, and G. Wetzstein, "A switchable light field camera architecture with angle
sensitive pixels and dictionary-based sparse coding," in Proc. IEEE Int. Conf.
Computational Photography, 2014, pp. 1-10.
[16] K. Jeong, J. Kim, and L. Lee, "Biologically inspired artificial compound eyes,"
Science, vol. 312, no. 5773, pp. 557-561, Apr. 2006.
[17] S. J. Koppal, I. Gkioulekas, T. Young, H. Park, K. B. Crozier, G. L. Barrows,
and T. Zickler, "Toward wide-angle microvision sensors," IEEE Trans. Pattern
Anal. Machine Intell., vol. 25, no. 12, pp. 2982-2996, Jan. 2013.
[18] A. Levin, R. Fergus, and B. Freeman. "Image and depth from a conventional
camera with a coded aperture," ACM Trans. Graph., vol. 26, no. 3, pp. 70, July
2007.
[19] S. K. Nayar, V. Branzoi, and T. E. Boult, "Programmable imaging: Towards a
flexible camera," Int. J. Comp. Vision, vol. 70, no. 1, pp. 7-22, 2006.
[20] R. Ng, "Fourier slice photography," ACM Trans. Graph., vol. 24, no. 3, pp.
735-744, July 2005.
[21] M. O'Toole, S. Achar, S. G. Narasimhan, and K. N. Kutulakos,
"Homogeneous codes for energy-efficient illumination and imaging," ACM Trans.
Graph., vol. 34, no. 4, pp. 35, 2015.
[22] H. Park and K. B. Crozier, "Multispectral imaging with vertical silicon nanowires," Scientific Rep, vol. 3, pp. 2460, Aug. 2013.
[23] F. Pittaluga and S. J. Koppal, "Privacy preserving optics for miniature vision
sensors," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2015, pp.
314-324.
[24] S. Shen, N. Michael, and V. Kumar, "Autonomous multi-floor indoor navigation with a computationally constrained mav," in Proc. IEEE Int. Conf. Robotics
and Automation, 2011, pp. 20-25.

References

[1] Agrihouse. [Online]. Available: www.agrihouse.com

[25] A. Velten, T. Willwacher, O. Gupta, A. Veeraraghavan, M. G. Bawendi, and
R. Raskar, "Recovering three-dimensional shape around a corner using ultrafast
time-of-flight imaging," Nat. Commun., vol. 3, pp. 745, Mar. 2012.

[2] M. Salman Asif, A. Ayremlou, A. Sankaranarayanan, A. Veeraraghavan, and
R. Baraniuk. (2015). Flatcam: Thin, bare-sensor cameras using coded aperture and
computation. [Online]. Available: arXiv preprint arXiv:1509.00116

[26] K. Venkataraman, D. Lelescu, J. Duparré, A. McMahon, G. Molina, P.
Chatterjee, R. Mullis, and S. Nayar, "Picam: An ultra-thin high performance monolithic camera array," ACM Trans. Graph., vol. 32, no. 6, pp. 166, 2013.

[3] N. Borrelli, Microoptics Technology: Fabrication and Applications of Lens
Arrays and Devices. Boca Raton, FL: CRC Press, 1999.
[4] V. Brajovic and T. Kanade, "Computational sensor for visual tracking with attention," IEEE J. Solid State Circuits, vol. 33, no. 8, pp. 1199-1207, 1998.
[5] G. Chen, H. Ghaed, R. Haque, M. Wieckowski, Y. Kim, G. Kim, D. Fick,
D. Kim, M. Seok, K. Wise, D. Blaauw, and D. Sylvester., "A cubic-millimeter energy-autonomous wireless intraocular pressure monitor," in Proc. IEEE
Int. Solid-State Circuits Conf. Dig. Tech. Papers, San Francisco, CA, 2011,
pp. 310-312.
[6] Y. Dan, K. Chen, and K. B. Crozier, "Self-aligned process for forming microlenses at the tips of vertical silicon nanowires by atomic layer deposition," J.
Vacuum Sci. Tech. A, vol. 33, no. 1, pp. 01A109, 2015.
[7] T. Delbruck and C. A. Mead. "Adaptive photoreceptor with wide dynamic range," in Proc. IEEE Int. Symp. Circuits and Systems, 1994, vol. 4, pp.
339-342.

22

[27] M. Wakin, J. Laska, M. Duarte, D. Baron, S. Sarbotham, D. Takhar, K. Kelly,
and R. Baranuik, "An architecture for compressive imaging," in Proc. Int. Conf.
Image Processing, Atlanta, GA, 2006, pp. 1273-1276.
[28] J. Wang, Y. Matsushita, B. Shi, and A. C. Sankaranarayanan, "Photometric
stereo with small angular variations," in Proc. IEEE Int. Conf. Computer Vision,
2015, pp. 3478-3486.
[29] R. J. Wood, "The first takeoff of a biologically inspired at-scale robotic insect,"
IEEE Trans. Robotics, vol. 24, no. 2, pp. 341-347, 2008.
[30] X. Zhang, R. Zhang, S. Koppal, L. Butler, X. Cheng, and H. Xie, "Mems
mirrors submerged in liquid for wide-angle scanning," in Proc. 18th Int. Conf.
Solid-State Sensors, Actuators and Microsystems (TRANSDUCERS), 2015, pp.
847-850.

IEEE SIgnal ProcESSIng MagazInE

SP

|

September 2016

|
http://www.agrihouse.com
Table of Contents for the Digital Edition of Signal Processing - September 2016
