Tech Briefs Magazine - May 2023 - PIT-3
Circuit Filter Image sensor
Board
Filter
3 cm
5 μm
(a)
small portion of the incoming light split
by dispersive optics; roughly speaking, the
sensitivity is inversely proportional to the
number of spectral bands (colors). Such
limited performance results in poor usability
and may be the reason why HS imaging
is not yet widespread.
Concept of Compressed SensingBased
HS Imaging
To break through the physical limits of
sensitivity, compressed sensing (CS) is
applied to HS imaging. CS is a technique
to efficiently acquire and reconstruct signals
from under-sampled measurements
and has been applied in several fields
such as medical inspection and deep
space exploration. An example application
in the field of optics includes a miniaturized
spectroscopic device, overcoming
the physical limitations of device size
with CS. Here, CS is used to efficiently
acquire the spatial and spectral 3D information
of HS image using a 2D image
sensor, enabling high sensitivity HS imaging.
Compared with the conventional HS
imaging approaches that detect one color
per pixel, the developed method detects
multiple colors per pixel. Furthermore,
by randomly modulating the light
intensity for each wavelength at each pixel,
thereby spectrally and spatially encoding
light, the spatial and spectral 3D information
can be reconstructed from the
captured 2D image. The effective sensitivity
is then determined by the average
transmittance resulting from the random
modulation. The effective sensitivity ideally
becomes 50 percent regardless of the
number of spectral bands, as the average
of 0-100 percent random modulation.
To correctly reconstruct the HS image
from the captured 2D image, the incomPhotonics
& Imaging Technology, May 2023
(b)
ing light must be randomly modulated
in the spatial and spectral dimensions,
i.e., spatially and spectrally random sampling.
Spatial randomness can be evaluated
from the histogram of transmission
patterns at each wavelength, and spectral
randomness can be evaluated by calculating
the 2D correlation coefficient
between transmission patterns (rij) at
different wavelengths. Quantitatively,
the reconstruction error due to the spatial
randomness is less than 2 percent,
same level as shot-noise, when the standard
deviation (σ) divided by the average
transmittance (μ) is higher than 0.1.
For reconstruction errors due to spectral
image
sensor
(Spatial)
Scanning
Type
(c)
(a) A photograph of an image sensor with a special filter. (b) An optical microscope image of the special filter. (c) A schematic image of light detection with
thinning out using the special filter. (Image: Panasonic)
randomness, rij should be less than 0.9
to keep the reconstruction error below 2
percent.
Even if our CS-based approach is theoretically
possible, the challenge is how to
achieve both spatially and spectrally random
light transmission in the system. In
the present case, it was achieved by a
coded mask designed as a random array
of Fabry-Pérot filters. By optimizing the
structure of the Fabry-Pérot filter at each
pixel, the light transmission can be properly
designed to obtain the required randomness.
Considering the complexity of
the fabrication process and the randomness
of the light transmission, 64 differImage
sensor
convolution
image
sensor
Snapshot
Type
optical
component
bandpass
filter
shooting
area
shooting area
y
λ
x
×
object
measurement matrix
capture
reconstruction
compressed image
CS-Based Type
A comparison of conventional methods and compressed sensing-based methods for hyperspectral
imaging. (Image: Panasonic)
3
HS image
T
λ
scan
Tech Briefs Magazine - May 2023
Table of Contents for the Digital Edition of Tech Briefs Magazine - May 2023
Tech Briefs Magazine - May 2023 - Intro
Tech Briefs Magazine - May 2023 - Sponsor
Tech Briefs Magazine - May 2023 - Cov1
Tech Briefs Magazine - May 2023 - Cov2
Tech Briefs Magazine - May 2023 - 1
Tech Briefs Magazine - May 2023 - 2
Tech Briefs Magazine - May 2023 - 3
Tech Briefs Magazine - May 2023 - 4
Tech Briefs Magazine - May 2023 - 5
Tech Briefs Magazine - May 2023 - 6
Tech Briefs Magazine - May 2023 - 7
Tech Briefs Magazine - May 2023 - 8
Tech Briefs Magazine - May 2023 - 9
Tech Briefs Magazine - May 2023 - 10
Tech Briefs Magazine - May 2023 - 11
Tech Briefs Magazine - May 2023 - 12
Tech Briefs Magazine - May 2023 - 13
Tech Briefs Magazine - May 2023 - 14
Tech Briefs Magazine - May 2023 - 15
Tech Briefs Magazine - May 2023 - 16
Tech Briefs Magazine - May 2023 - 17
Tech Briefs Magazine - May 2023 - 18
Tech Briefs Magazine - May 2023 - 19
Tech Briefs Magazine - May 2023 - 20
Tech Briefs Magazine - May 2023 - 21
Tech Briefs Magazine - May 2023 - 22
Tech Briefs Magazine - May 2023 - 23
Tech Briefs Magazine - May 2023 - 24
Tech Briefs Magazine - May 2023 - 24A
Tech Briefs Magazine - May 2023 - 24B
Tech Briefs Magazine - May 2023 - 24C
Tech Briefs Magazine - May 2023 - 24D
Tech Briefs Magazine - May 2023 - 25
Tech Briefs Magazine - May 2023 - 26
Tech Briefs Magazine - May 2023 - 27
Tech Briefs Magazine - May 2023 - 28
Tech Briefs Magazine - May 2023 - 29
Tech Briefs Magazine - May 2023 - 30
Tech Briefs Magazine - May 2023 - 31
Tech Briefs Magazine - May 2023 - 32
Tech Briefs Magazine - May 2023 - 33
Tech Briefs Magazine - May 2023 - 34
Tech Briefs Magazine - May 2023 - 35
Tech Briefs Magazine - May 2023 - 36
Tech Briefs Magazine - May 2023 - 37
Tech Briefs Magazine - May 2023 - 38
Tech Briefs Magazine - May 2023 - 39
Tech Briefs Magazine - May 2023 - 40
Tech Briefs Magazine - May 2023 - 41
Tech Briefs Magazine - May 2023 - 42
Tech Briefs Magazine - May 2023 - 43
Tech Briefs Magazine - May 2023 - 44
Tech Briefs Magazine - May 2023 - 45
Tech Briefs Magazine - May 2023 - 46
Tech Briefs Magazine - May 2023 - 47
Tech Briefs Magazine - May 2023 - 48
Tech Briefs Magazine - May 2023 - 49
Tech Briefs Magazine - May 2023 - 50
Tech Briefs Magazine - May 2023 - 51
Tech Briefs Magazine - May 2023 - 52
Tech Briefs Magazine - May 2023 - 53
Tech Briefs Magazine - May 2023 - 54
Tech Briefs Magazine - May 2023 - 55
Tech Briefs Magazine - May 2023 - 56
Tech Briefs Magazine - May 2023 - Cov3
Tech Briefs Magazine - May 2023 - Cov4
Tech Briefs Magazine - May 2023 - PIT-Cov1
Tech Briefs Magazine - May 2023 - PIT-Cov2
Tech Briefs Magazine - May 2023 - PIT-1
Tech Briefs Magazine - May 2023 - PIT-2
Tech Briefs Magazine - May 2023 - PIT-3
Tech Briefs Magazine - May 2023 - PIT-4
Tech Briefs Magazine - May 2023 - PIT-5
Tech Briefs Magazine - May 2023 - PIT-6
Tech Briefs Magazine - May 2023 - PIT-7
Tech Briefs Magazine - May 2023 - PIT-8
Tech Briefs Magazine - May 2023 - PIT-9
Tech Briefs Magazine - May 2023 - PIT-10
Tech Briefs Magazine - May 2023 - PIT-11
Tech Briefs Magazine - May 2023 - PIT-12
Tech Briefs Magazine - May 2023 - PIT-13
Tech Briefs Magazine - May 2023 - PIT-14
Tech Briefs Magazine - May 2023 - PIT-15
Tech Briefs Magazine - May 2023 - PIT-16
Tech Briefs Magazine - May 2023 - PIT-17
Tech Briefs Magazine - May 2023 - PIT-18
Tech Briefs Magazine - May 2023 - PIT-19
Tech Briefs Magazine - May 2023 - PIT-20
Tech Briefs Magazine - May 2023 - PIT-Cov3
Tech Briefs Magazine - May 2023 - PIT-Cov4
Tech Briefs Magazine - May 2023 - Sensor-Cov1
Tech Briefs Magazine - May 2023 - Sensor-Cov2
Tech Briefs Magazine - May 2023 - Sensor-1
Tech Briefs Magazine - May 2023 - Sensor-2
Tech Briefs Magazine - May 2023 - Sensor-3
Tech Briefs Magazine - May 2023 - Sensor-4
Tech Briefs Magazine - May 2023 - Sensor-5
Tech Briefs Magazine - May 2023 - Sensor-6
Tech Briefs Magazine - May 2023 - Sensor-7
Tech Briefs Magazine - May 2023 - Sensor-8
Tech Briefs Magazine - May 2023 - Sensor-9
Tech Briefs Magazine - May 2023 - Sensor-10
Tech Briefs Magazine - May 2023 - Sensor-11
Tech Briefs Magazine - May 2023 - Sensor-12
Tech Briefs Magazine - May 2023 - Sensor-13
Tech Briefs Magazine - May 2023 - Sensor-14
Tech Briefs Magazine - May 2023 - Sensor-15
Tech Briefs Magazine - May 2023 - Sensor-16
Tech Briefs Magazine - May 2023 - Sensor-17
Tech Briefs Magazine - May 2023 - Sensor-18
Tech Briefs Magazine - May 2023 - Sensor-19
Tech Briefs Magazine - May 2023 - Sensor-20
Tech Briefs Magazine - May 2023 - Sensor-21
Tech Briefs Magazine - May 2023 - Sensor-22
Tech Briefs Magazine - May 2023 - Sensor-23
Tech Briefs Magazine - May 2023 - Sensor-24
Tech Briefs Magazine - May 2023 - Sensor-25
Tech Briefs Magazine - May 2023 - Sensor-26
Tech Briefs Magazine - May 2023 - Sensor-27
Tech Briefs Magazine - May 2023 - Sensor-28
Tech Briefs Magazine - May 2023 - Sensor-Cov3
Tech Briefs Magazine - May 2023 - Sensor-Cov4
https://www.nxtbook.com/smg/techbriefs/24TB08
https://www.nxtbook.com/smg/techbriefs/24TB07
https://www.nxtbook.com/smg/techbriefs/24TB06
https://www.nxtbook.com/smg/techbriefs/24TB05B
https://www.nxtbook.com/smg/techbriefs/24TB05
https://www.nxtbook.com/smg/techbriefs/24TB04
https://www.nxtbook.com/smg/techbriefs/24TB03
https://www.nxtbook.com/smg/techbriefs/24TB02
https://www.nxtbook.com/smg/techbriefs/24TB01
https://www.nxtbook.com/smg/techbriefs/23TB12
https://www.nxtbook.com/smg/techbriefs/23TB11
https://www.nxtbook.com/smg/techbriefs/23TB10
https://www.nxtbook.com/smg/techbriefs/23TB09
https://www.nxtbook.com/smg/techbriefs/23TB08
https://www.nxtbook.com/smg/techbriefs/23TB07
https://www.nxtbook.com/smg/techbriefs/23TB06
https://www.nxtbook.com/smg/techbriefs/23TB05
https://www.nxtbook.com/smg/techbriefs/23TB04
https://www.nxtbook.com/smg/techbriefs/23TB03
https://www.nxtbook.com/smg/techbriefs/23TB02
https://www.nxtbook.com/smg/techbriefs/23TB01
https://www.nxtbook.com/smg/Testing/22TB12
https://www.nxtbook.com/smg/techbriefs/22TB12
https://www.nxtbook.com/smg/techbriefs/22TB11
https://www.nxtbook.com/smg/techbriefs/22TB10
https://www.nxtbook.com/smg/techbriefs/22TB09
https://www.nxtbook.com/smg/techbriefs/22TB08
https://www.nxtbook.com/smg/techbriefs/22TB07
https://www.nxtbook.com/smg/techbriefs/22TB06
https://www.nxtbook.com/smg/techbriefs/22TB05-P
https://www.nxtbook.com/smg/techbriefs/22TB05-D
https://www.nxtbook.com/smg/techbriefs/22TB04
https://www.nxtbook.com/smg/techbriefs/22TB03
https://www.nxtbook.com/smg/techbriefs/22TB02
https://www.nxtbook.com/smg/techbriefs/22TB01
https://www.nxtbook.com/smg/techbriefs/21TB12
https://www.nxtbook.com/smg/techbriefs/21TB11
https://www.nxtbook.com/smg/techbriefs/21TB10
https://www.nxtbook.com/smg/techbriefs/21TB09
https://www.nxtbook.com/smg/techbriefs/21TB08
https://www.nxtbook.com/smg/techbriefs/21TB07
https://www.nxtbook.com/smg/techbriefs/21TB06
https://www.nxtbook.com/smg/techbriefs/21TB05
https://www.nxtbook.com/smg/techbriefs/21TB04
https://www.nxtbook.com/smg/techbriefs/21BT03
https://www.nxtbook.com/smg/techbriefs/21TB02
https://www.nxtbookmedia.com