Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Non-uniformity correction algorithm for DoFP adapted to integration time variations

Open Access Open Access

Abstract

Division of the focal plane (DoFP) polarization detector is a pivotal technology in real-time polarization detection. This technology integrates a micropolarization array (MPA) onto the conventional focal plane, introducing a more intricate non-uniformity than traditional focal plane detectors. Current non-uniformity correction algorithms for DoFP are difficult to adapt to changes in integration time and perform poorly in low-polarization scenarios. Analyzing the characteristics of DoFP, formulating a pixel response model, and introducing an adaptive non-uniformity correction algorithm tailored for varying integration time. The DoFP analysis vectors are decomposed into average polarization response and unit analysis vectors for correction separately to improve the performance of the correction algorithm in different polarization scenarios. The performance of modern correction algorithms was tested and evaluated using standard uniform images, and the proposed method outperformed existing algorithms in terms of polarization measurement accuracy under the root mean square error (RMSE) metric. Moreover, in natural scene images, our proposed algorithm shows favorable visual effects and distinguishes itself from its superior stability amid changes in the integration time.

© 2024 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

1. Introduction

Electromagnetic waves exhibit three fundamental properties: intensity, wavelength, and polarization. While certain animals, such as reptiles and birds, can perceive polarization information, humans, like other mammals, are limited in their ability to perceive the intensity and wavelength of electromagnetic waves. Polarization imaging systems are essential for acquiring polarization information [1]. Polarimetric imaging involves polarization analysis of electromagnetic waves from a scene. The extracted polarization information offers valuable features, including object surface smoothness [2], three-dimensional information [3], and material composition [4]. Polarization information is typically conveyed through metrics such as polarization degree and angle [5]. Polarization imaging has diverse applications, including anti-jamming target detection [6], 3D reconstruction [7], and image defogging [8], highlighting its broad utility in various fields.

The DoFP polarization imaging detection technology is progressively emerging as the mainstream method for polarization detection, primarily owing to its real-time imaging capabilities. In this technology, sensors utilize micropolarization arrays, as illustrated in Fig. 1. Four linear polarizers oriented at 0°, 45°, 90°, and 135°were organized into groups of four pixels, forming a superpixel structure. While this structure effectively addresses the kinematic artifacts inherent in time-split scanning devices, it introduces field-of-view errors [9]. Modern DoFP cameras employ advanced demosaicing methods to mitigate these errors, resulting in a successful compensation for field-of-view errors and commendable results [1014].

 figure: Fig. 1.

Fig. 1. Schematic diagram of a micropolarization array sensor.

Download Full Size | PDF

The infrared DoFP detector employs a linear polarizer to capture the first three Stokes vectors of incoming electromagnetic waves. This crucial step facilitates the reconstruction of the degree of line polarization and angle information within the scene. However, like traditional detectors, infrared DoFP detectors are susceptible to factors such as manufacturing material defects and unstable production process control. This results in inhomogeneity across infrared focal plane arrays (FPA), were signals from different pixels under identical radiant illumination exhibit variations. To address this inhomogeneity, researchers have proposed several correction algorithms to mitigate the associated noise in infrared focal planes, resulting in practical improvements in overall performance [1518].

Polarization detectors integrate linear polarizers onto FPA, such as the short-wave polarization detector from the Shanghai Institute of Technology and Physics of the Chinese Academy of Sciences (SITP), an MPA comprising a superpixel-structured sub-wavelength aluminum grating [19] is integrated into the InGaAs focal plane array. While this structure achieves a high extinction ratio, the DoFP's non-uniformity is more intricate than that of conventional infrared focal planes, owing to factors such as grating transmittance and extinction ratio [20].

Researchers have developed several non-uniformity correction algorithms to mitigate the non-uniformity of DoFP polarization detectors and enhance the accuracy of scene polarization detection. These include calibration-based and scene-based correction methods. Calibration-based correction methods include the single-pixel correction algorithm and the superpixel correction algorithm proposed by Powell et al. [21]. The single-pixel correction method employs the analytical vectors of a single pixel for correction, whereas the superpixel correction method utilizes the ideal analytical matrix to derive the correction matrix. Building upon the superpixel correction method, Chen et al. [22] introduced the neighboring superpixel correction method, which corrects each pixel based on four overlapping superpixels at that specific location. In departure from the ideal analysis matrix, Zhang et al. [23] proposed an average analysis matrix correction method. Zheng et al. [24] presented a matrix correction method that achieved direct mapping from the image pixels to the polarization degrees. Feng et al. [25] introduced a model that characterizes the response of polarized image elements along with a corresponding correction method. Hathan et al. [26] proposed a straightforward polarization camera correction method that is independent of the light intensity of the input, relying on measurements at four different angles to calculate the features for each pixel. Ding et al. [27] proposed a calibration method that uses a standard light source. Yin et al. [28] considered the depolarization characteristics of optical systems and proposed a method for response and polarization corrections. Lane et al. [29] defined quantization errors in the quality of polarization measurements using a superpixel correction method. Chi et al. [30] proposed a calibration method for multispectral DoFP detectors.

Wang et al. [31] introduced a nonuniformity correction algorithm based on scene polarization redundancy estimation. This method involves calculating the polarization redundancy estimation from the scene image, analyzing differences in pixel statistical characteristics, and deriving updated gain correction coefficients.

In a study by Giménez et al. [32], it was found that the relatively straightforward superpixel correction method exhibited an effective performance within calibration-based correction methods. In contrast, other derived methods do not offer significant advantages.

The goal of polarization correction consists of two aspects: first, to ensure a uniform response of uniformly incident unpolarized light; and second, for incident light with the same polarization state, the calculated polarization state should be at the same level. Many existing correction methods primarily focus on high-polarization scenarios, often neglecting the influence of integration time changes on correction effectiveness. This study addresses these challenges by establishing radiometric and polarization calibration models for the DoFP pixels. The pixel response model analyzed the impact of different integration time on the polarization detector. The proposed calibration method caters to short-wave infrared polarization detectors and accommodates changes in the integration time. This method decomposes the analytical vector of the DoFP detector into the average polarization responsivity and unit analytical vector, enabling separate corrections. It diminishes reliance on polarization channel constraints, accommodating unpolarized and highly polarized scenarios, while demonstrating robustness across different integration times.

2. Principle of non-uniformity generation in DoFP detectors

2.1 DoFP detector imaging principle

The short-wave infrared polarization detector [19] is a polarization-sensitive pixel imaging sensor. Its superpixel structure facilitates the capture of incident polarized light, which is represented by the Stokes vector S.

$$S = \left[ {\begin{array}{{c}} {{S_0}}\\ {{S_1}}\\ {{S_2}}\\ {{S_3}} \end{array}} \right] = \left[ {\begin{array}{{c}} {({I_0} + {I_{45}} + {I_{90}} + {I_{135}})/2}\\ {{I_0} - {I_{90}}}\\ {{I_{45}} - {I_{135}}}\\ {{I_R} - {I_L}} \end{array}} \right],$$
where ${S_0}$, ${S_1}$, ${S_2}$, and ${S_3}$ represent the four components of the Stokes vector and ${S_0}$ represents the total intensity of the incident light. ${S_1}$ and ${S_2}$ describe the amount of linearly polarized light. ${S_3}$ describes the amount of circularly polarized light. ${I_i}$ represents the intensity of the light at $i(i = 0^\circ ,45^\circ ,90^\circ ,135^\circ )$ after passing through a linear polarizer. ${I_R}$ and ${I_L}$ represent the light intensities of the left- and right- handed polarized light, respectively.

A DoFP detector arranged in a superpixel structure cannot obtain circularly polarized light and, therefore, cannot obtain ${S_3}$. However, a DoFP detector arranged with a superpixel structure is optimal for system signal-to-noise ratio maximization and system error minimization [33].

The degree of linear polarization (DoLP) and angle of linear polarization (AoLP) of the incident light can be reconstructed from the Stokes vector, as shown in Eqs. (2) and (3), respectively:

$$DoLP = \frac{{\sqrt {S_1^2 + S_2^2} }}{{{S_0}}},$$
$$AoLP = \frac{1}{2}\arctan \left( {\frac{{{S_2}}}{{{S_1}}}} \right),$$

2.2 DoFP imaging mathematical model

The scene incident light ${S_{in}}$ was modulated by the MPA and then irradiated onto the FPA to obtain ${S_{out}}$, as shown in Fig. 2. MPA is a non-ideal linear polarizer, also known as a diattenuator [26], and a Mueller matrix ${M_f}$ can represent the optical properties of a diattenuator device:

$${M_f} = A \cdot \left[ {\begin{array}{{cccc}} 1&{D\cos (2\alpha )}&{D\sin (2\alpha )}&0\\ {D\cos (2\alpha )}&{1 - D{{\sin }^2}(2\alpha )}&{D\sin (4\alpha )/(4A)}&0\\ {D\sin (2\alpha )}&{D\sin (4\alpha )/(4A)}&{1 - D{{\cos }^2}(2\alpha )}&0\\ 0&0&0&{1 - D} \end{array}} \right],$$
where
$$A = \frac{1}{2}({q + r} ),D = \frac{{q - r}}{{q + r}}.$$

 figure: Fig. 2.

Fig. 2. DoFP camera imaging schematic.

Download Full Size | PDF

In Eq. (5), q is the maximum transmittance of the micropolarizer and r is the minimum transmittance of the micropolarizer. Hence, A is the average transmittance and D is the diattenuation coefficient. In Eq. (4), $\alpha$ is the direction of the polarization transmission of the micropolarizer.

When the polarizer was ideal, the maximum transmittance of the diattenuation device was $q = 1$ and the minimum transmittance was $r = 0$. Therefore, the ideal polarizers are $A = 1/2$ and $D = 1$. The Mueller matrix of the ideal polarizer is ${M_{ideal}}$:

$${M_{ideal}} = \frac{1}{2}\left[ {\begin{array}{{cccc}} 1&{\cos (2\alpha )}&{\sin (2\alpha )}&0\\ {\cos (2\alpha )}&{1 - {{\sin }^2}(2\alpha )}&{\sin (4\alpha )/2}&0\\ {\sin (2\alpha )}&{\sin (4\alpha )/2}&{1 - {{\cos }^2}(2\alpha )}&0\\ 0&0&0&0 \end{array}} \right].$$

Therefore, the final stokes vector incident on the FPA in DoFP is ${S_{out}}$,

$${S_{out}} = {M_f} \cdot {S_{in}}.$$

However, the FPA of the DoFP detector responds only to light intensity; therefore, the actual amount of radiation projected onto the focal plane is L,

$$L = \left[ {\begin{array}{{cccc}} 1&0&0&0 \end{array}} \right] \cdot {S_{out}} = \left[ {\begin{array}{{cccc}} 1&0&0&0 \end{array}} \right] \cdot {M_f} \cdot {S_{in}}.$$

Assuming a linear relationship between the pixel value of the shortwave image element and the amount of radiation, the pixel value I of the actual image element is:

$$I = g \cdot L + d,$$
where g is the gain coefficient of the focal plane for radiance conversion into an electrical signal, and d is the dark offset. Combining Eq. (4), Eq. (8), and Eq. (9) yields the pixel value of a single pixel concerning the incident light, that is, ${S_{in}}$.
$$\begin{aligned} I &= g \cdot \left[ {\begin{array}{{cccc}} 1&0&0&0 \end{array}} \right] \cdot {M_f} \cdot {S_{in}} + d\\ &= g \cdot A \cdot \left[ {\begin{array}{{cccc}} 1&{D\cos (2\alpha )}&{D\sin (2\alpha )}&0 \end{array}} \right] \cdot {S_{in}} + d\\ &= {A_f} \cdot {S_{in}} + d, \end{aligned}.$$

${A_f} = \left[ {\begin{array}{{cccc}} {{A_0}}&{{A_1}}&{{A_2}}&{{A_3}} \end{array}} \right]$ is an analytical vector that was described by Powell et al. [21]. ${A_0} = g \cdot A$ is the product of the focal plane gain coefficient, the average transmittance, and the average polarization responsivity of the polarized image element. ${A_1} = {A_0} \cdot D\cos (2\alpha )$, ${A_2} = {A_0} \cdot D\sin (2\alpha )$ and ${A_3} = 0$. Equation (10) shows that if the incident light ${S_{in}}$ of the scene is homogeneous, there are four primary sources of non-uniformity in the image I, which are ${A_0}$, D, $\alpha$, and d. The non-uniformity of ${A_0}$ is MPA and FPA coupling. D and $\alpha$ are the results of defects in the manufacturing process of miniature polarization arrays.

To analyze the non-uniformity of the DoFP detector, it is essential to develop both a radiative calibration model and a polarization calibration model for DoFP, as illustrated in Fig. 3. An ideal polarizer and blackbody are placed in front of the DoFP detector so that the incident light of the DoFP camera is polarized. The ${S_{in}}$ produced by the blackbody is uniform, unpolarized light, and thus, ${S_{in}} = {\left[ {\begin{array}{{cccc}} {{S_0}}&0&0&0 \end{array}} \right]^T}$. ${S_0}$ is the uniform radiation L emitted by a blackbody. At this point, the pixel value ${I_p}$ of the polarization pixel should be

$$\begin{aligned} {I_p} &= g \cdot \left[ {\begin{array}{{cccc}} 1&0&0&0 \end{array}} \right] \cdot {M_f} \cdot {M_{ideal}} \cdot {S_{in}} + d\\ &= \frac{1}{2}L \cdot [{A_0} + {A_1}\cos (2\theta ) + {A_2}\sin (2\theta )] + d, \end{aligned}$$
where $\theta$ is the angle of the ideal polarizer relative to the direction of polarized transmission of the 0° channel in the micropolarization array.

 figure: Fig. 3.

Fig. 3. DoFP detector calibration model, (a) polarization calibration model, (b) radiometric calibration model.

Download Full Size | PDF

$L$ can be calculated from the Planck’s law and Stephen-Boltzmann’s law:

$$L = \int_{{\lambda _2}}^{{\lambda _1}} {\frac{{{c_1}}}{{{\lambda ^5}[exp (\frac{{{c_2}}}{{\lambda T}}) - 1]}}d\lambda } ,$$
where ${\lambda _1}$ and ${\lambda _2}$ are the upper and lower limits of the detector response band, ${c_1} = 3.7415 \times {10^4}\textrm{W} \cdot \textrm{c}{\textrm{m}^{ - 2}} \cdot \mu {\textrm{m}^4}$ is the first radiation constant, ${c_2} = 1.43879 \times {10^4}\mu \textrm{m} \cdot \textrm{K}$ is the second radiation constant, and T denotes the temperature of the blackbody setup.

When the incident light of the DoFP detector was unpolarized, as shown in Fig. 3(b), Eq. (11) is degraded because the incident light loses the modulation of the ideal polarizer, and the pixel value ${I_f}$ of the polarized pixel is

$$\begin{aligned} {I_f} &= g \cdot \left[ {\begin{array}{{cccc}} 1&0&0&0 \end{array}} \right] \cdot {M_f} \cdot {S_{in}} + d\\ &= {A_0} \cdot L + d, \end{aligned}.$$

According to Eqs. (10), (11), and (13), ${A_0}$ the D, $\alpha$, and d of the DoFP detector image element can be calculated based on the blackbody temperature and the rotation angle of the ideal polarizer.

Figure 4 shows the four primary sources that affect the non-uniformity of the DoFP detector. Figure 4(d) shows the relative angle of $\alpha$ with pixel (127,127) as a reference.

 figure: Fig. 4.

Fig. 4. DoFP detector non-uniformity diagram, (a) average polarization responsivity ${A_0}$, (b) dark offset d, (c) diattenuation coefficient D, (d) the direction of polarization transmission of the micropolarizer $\alpha$.

Download Full Size | PDF

2.3 Effect of integration time on DoFP response

Integration time is an essential parameter of the infrared DoFP detector, which can directly affect the gain coefficient g and dark offset d of the infrared focal plane converted from radiation to an electrical signal, which then affects ${A_0}$, which also affects the polarization response of the DoFP detector ${I_p}$ and the radiation response ${I_f}$. By the structure shown in Fig. 3(a), change the integration time t of the DoFP camera and the angle $\theta$ of the ideal polarizer, and set the temperature of the blackbody as ${{\rm T}_d}$ so that the radiation outgoing degree is ${L_d}$ to obtain Eq. (14):

$${I_p}(\theta ,t) = \frac{1}{2}{A_0}(t) \cdot {L_d} \cdot [{1 + D\cos (2\alpha )\cos (2\theta ) + D\sin (2\alpha )\sin (2\theta )} ]+ d(t).$$

${I_p}(\theta ,t)$ is the pixel value of the polarization response, ${A_0}(t)$ is the ${A_0}$ that changes with the integration time, and $d(t)$ is the d that changes with the integration time. According to the structure shown in Fig. 3(b), the DoFP camera integration time t and blackbody temperature T to get ${I_f}(T,t)$

$${I_f}(T,t) = {A_0}(t) \cdot L(T) + d(t),$$
where ${I_f}(T,t)$ is the pixel value of the radiant response of the pixel and $L(T)$ is the blackbody radiant emissivity that varies with the blackbody temperature.

Figures 5(a) and (b) show the detector image-element response curves plotted using Eqs. (14) and (15), and four integration time (1, 2, 3, and 4 ms) were selected to set the DoFP camera to collect data. From Fig. 5(a) and (b), the variation in the integration time can significantly affect the radiance response and polarization response of the DoFP detector. The variation in the integration time almost does not change the phase of the polarization response curve; therefore, it does not change the diattenuation coefficient of the DoFP and the transmission angle of the MPA.

 figure: Fig. 5.

Fig. 5. Image response curves of the DoFP detector, (a) the polarization response ${I_p}(\theta ,t)$, (b) the radiant response ${I_f}(T,t)$, (c) the polarization response divided by the integration time ${I^{\prime}_p}(\theta ,t)$, (d) the radiant response divided by the integration time ${I^{\prime}_f}(T,t)$.

Download Full Size | PDF

As shown in Fig. 5, when the integration time increases by 1 ms, the polarization response increases by ${d_p}$ and the radiation response increases by ${d_f}$; this observation suggesting that when the integration time changes by t, the pixel value changes by $k \cdot t$, therefore, we assume that ${A_0}(t)$ changes linearly:

$${A_0}(t) = k \cdot t,$$
where k is the polarization responsivity per unit integration time.

We divide ${I_p}(\theta ,t)$ and ${I_f}(\theta ,t)$ by the integration time t, eliminating the effect of the integration time t on ${A_0}(t)$, and obtain ${I^{\prime}_p}(\theta ,t)$ and ${I^{\prime}_f}(T,t)$:

$${I^{\prime}_f}(T,t) = k \cdot L(T) + d^{\prime}(t),$$
$${I^{\prime}_p}(\theta ,t) = \frac{1}{2}k \cdot {L_d} \cdot [{1 + D\cos (2\alpha )\cos (2\theta ) + D\sin (2\alpha )\sin (2\theta )} ]+ d^{\prime}(t),$$
where $d^{\prime}(t) = d(t)/t$.

Plots of ${I^{\prime}_p}(\theta ,t)$ and ${I^{\prime}_f}(T,t)$ are shown in Fig. 5(c) and (d). In Fig. 5(c) and (d), the radiance and polarization response curves with different integration time are significantly different only for $d^{\prime}(t)$ on the y-axis. In summary, integration time affects the ${A_0}$ and d of the DoFP detector. In contrast, D and $\alpha$ are unaffected by integration time, which is also consistent with the physical meaning of these four parameters. After dividing the DoFP pixel response by the integration time t, ${A_0}(t)$ transforms into k, causing the pixel to be exclusively influenced by $d^{\prime}(t)$. Consequently, accurate estimation of $d^{\prime}(t)$ is imperative for effectively mitigating non-uniformity noise in the DoFP detector.

The DoFP integration time was set from 1 ms to 6 ms at 0.2 ms intervals. As shown in Fig. 6(a), the $d^{\prime}(t)$ is a distinct monotonic curve. Figure 6(b) illustrates $\ln [d^{\prime}(t)]$, which shows a clear linear relationship:

$$\ln [d^{\prime}(t)] = a \cdot \ln (t) + b,$$
then,
$$d^{\prime}(t) = {e^b} \cdot {t^a}.$$

 figure: Fig. 6.

Fig. 6. Four images A, B, C, and D are randomly selected at the DoFP detector Curve, (a) $d^{\prime}(t)$, (b) $\ln [d^{\prime}(t)]$.

Download Full Size | PDF

Using Eq. (20), $d^{\prime}(t)$ can be estimated; consequently, the influence of the dark offset on the DoFP detector can be mitigated based on the integration time.

3. Non-uniformity correction method

Conventional DoFP detectors are usually corrected for non-uniformity using the superpixel correction method [21], which uses an analytical matrix to solve the correction matrix. The traditional superpixel correction method relies on mutual constraints among the four channels of the DoFP. In the case of high polarization, the superpixels can be well constrained to each other (e.g., the polarization of the incident light is one, as shown in Fig. 3(a)); however, in the case of very low scene polarization (e.g., the polarization of the incident light is 0 in Fig. 3(b)), the superpixel correction method tends not to achieve a relatively good correction effect.

This study introduces a two-stage nonuniformity correction approach for DoFP. Initially, the analysis vector ${A_f}$ in the DoFP imaging model is decomposed into k and ${A^{\prime}_f}$ for specific corrections. In the first stage, by leveraging the radiometric calibration model, the detector's response to the integration time and dark migration is rectified. The correction of k for each pixel was performed based solely on the radiation response of that individual pixel. In the second stage, according to the polarization calibration model, D and $\alpha$ were unaffected by the integral time change. Consequently, the unit analysis vector of DoFP is employed for polarization correction, effectively eliminating non-uniformities in D and $\alpha$ contingent upon the mutual constraints of the superpixels.

3.1 Radiometric correction model

For the DoFP detector, the radiative correction removes the dark offset of the pixel while making the k of each pixel consistent per unit integration time, which ultimately results in the DoFP responding to the same grayscale for each pixel for incident uniform unpolarized light.

$$\mathop {\min }\limits_{ca{l_f}} ||Ca{l_f}({I_f}) - {I_{f,ideal}}|{|^2},$$
where $Ca{l_f}$ is the radiometric correction procedure, ${I_f}$ is a real pixel, and ${I_{f,ideal}}$ is an ideal pixel. Assuming that ${I_f}$ is linear, then $Ca{l_f}$ is also linear; therefore,
$$Ca{l_f}({I_f}) = {g_c}({I_f} - {d_c}).$$
${g_c}$ is the radiometric correction factor and ${d_c}$ is the dark offset. ${I_{f,ideal}}$ should be the product of the ideal unit mean polarization responsivity ${k_{ideal}}$ and the incident radiation L.
$${I_{f,ideal}} = {k_{ideal}} \cdot L,$$
then,
$$\mathop {\min }\limits_{Ca{l_f}} ||{g_c}({I_f} - {d_c}) - {k_{ideal}} \cdot L|{|^2} = \mathop {\min }\limits_{Ca{l_f}} ||{g_c}[k \cdot L + d^{\prime}(t) - {d_c}] - {k_{ideal}} \cdot L|{|^2},$$
to solve the above equation,
$${g_c} = \frac{{{k_{ideal}}}}{k},{d_c} = d^{\prime}(t),$$
${d_c} = d^{\prime}(t)$ can estimate the value of the dark offset at different integration time using the least-squares method, according to Eq. (20).

3.2 Polarization correction model

Radiometric correction corrects each pixel's k to ${k_{ideal}}$ and removes each pixel's dark offset, and must be corrected for D and $\alpha$. The usual practice is to perform this using the superpixel correction method, but we have corrected each pixel for k so that ${{\rm I}^{\prime}_p}(\theta )$ is

$$\begin{aligned} {{I^{\prime}}_p}(\theta ) &= \frac{1}{2}{k_{ideal}} \cdot L \cdot [1 + D\cos (2\alpha )\cos (2\theta ) + D\sin (2\alpha )\sin (2\theta )]\\ &= {k_{ideal}} \cdot L \cdot \left[ {\begin{array}{{cccc}} 1&{{{A^{\prime}}_1}}&{{{A^{\prime}}_2}}&0 \end{array}} \right] \cdot {\left[ {\begin{array}{{cccc}} {\frac{1}{2}L}&{\frac{1}{2}L\cos (2\theta )}&{\frac{1}{2}L\sin (2\theta )}&0 \end{array}} \right]^T}\\ &= {k_{ideal}} \cdot L \cdot {{A^{\prime}}_f} \cdot {{S^{\prime}}_{in}}, \end{aligned}$$
where ${A^{\prime}_1} = {A_1}/{A_0} = D\cos (2\alpha )$, ${A^{\prime}_2} = {A_2}/{A_0} = D\sin (2\alpha )$. ${A^{\prime}_f} = \left[ {\begin{array}{{cccc}} 1&{{{A^{\prime}}_1}}&{{{A^{\prime}}_2}}&0 \end{array}} \right]$ is a unit analytic vector. ${S^{\prime}_{in}} = {\left[ {\begin{array}{{cccc}} {L/2}&{L\cos (2\theta )/2}&{L\sin (2\theta )/2}&0 \end{array}} \right]^T}$ is the Stokes vector of radiation L that passes through an ideal polarizer modulated at an angle of $\theta$.

Use the least squares that fit ${I^{\prime}_p}(\theta )$ and then solve for each pixel ${A^{\prime}_f}$. The superpixel, shown in Fig. 1, has a unit analysis matrix ${A^{\prime}_{sp}}$,

$${A^{\prime}_{sp}} = \left[ {\begin{array}{{cccc}} 1&{{{A^{\prime}}_{1,0}}}&{{{A^{\prime}}_{2,0}}}&0\\ 1&{{{A^{\prime}}_{1,45}}}&{{{A^{\prime}}_{2,45}}}&0\\ 1&{{{A^{\prime}}_{1,90}}}&{{{A^{\prime}}_{2,90}}}&0\\ 1&{{{A^{\prime}}_{1,135}}}&{{{A^{\prime}}_{2,135}}}&0 \end{array}} \right],$$
then the ideal unit analysis matrix is,
$${A^{\prime}_{sp,ideal}} = \left[ {\begin{array}{{cccc}} 1&{D\cos (0)}&{D\cos (0)}&0\\ 1&{D\cos (90)}&{D\cos (90)}&0\\ 1&{D\cos (180)}&{D\cos (180)}&0\\ 1&{D\cos (270)}&{D\cos (270)}&0 \end{array}} \right] = \left[ {\begin{array}{{cccc}} 1&1&0&0\\ 1&0&1&0\\ 1&{ - 1}&0&0\\ 1&0&{ - 1}&0 \end{array}} \right].$$

For superpixels, the non-uniformity correction is

$$\mathop {\min }\limits_{Ca{l_{sp}}} ||Ca{l_{sp}}({I_{sp}}) - {I_{sp,ideal}}|{|^2},$$
where $Ca{l_{sp}}$ is the correction program for the superpixel, ${I_{sp}}$ is the pixel of the superpixel, and ${I_{sp,ideal}}$ is the ideal pixel of the superpixel. Because ${I_{sp}} = {\left[ {\begin{array}{{cccc}} {{I_0}}&{{I_{45}}}&{{I_{90}}}&{{I_{135}}} \end{array}} \right]^T}$ is an $4 \times 1$ matrix, $Ca{l_{sp}}$ is also a matrix transformation.
$$Ca{l_{sp}}({I_{sp}}) = {G_c} \cdot {I_{sp}},$$
where ${G_c}$ is the superpixel correction factor. ${I_{sp,ideal}}$ is defined as,
$${I_{sp,ideal}} = {k_{ideal}} \cdot L \cdot {A^{\prime}_{sp,ideal}} \cdot {S_{in}},$$
then,
$$\begin{array}{l} \mathop {\min }\limits_{Ca{l_{sp}}} ||{G_c} \cdot {I_{sp}} - {k_{ideal}} \cdot L \cdot {{A^{\prime}}_{sp,ideal}} \cdot {S_{in}}|{|^2}\\ = \mathop {\min }\limits_{Ca{l_{sp}}} ||{G_c} \cdot ({k_{ideal}} \cdot L \cdot {{A^{\prime}}_{sp}} \cdot {S_{in}}) - {k_{ideal}} \cdot L \cdot {{A^{\prime}}_{sp,ideal}} \cdot {S_{in}}|{|^2}, \end{array}$$
then solve the correction factor ${G_c}$ in the superpixel,
$${G_c} = {A^{\prime}_{sp,ideal}} \cdot A_{sp}^ + ,$$
where $A_{sp}^ +$ is the pseudo-inverse of ${A^{\prime}_{sp}}$.

Figure 2 illustrates the arrangement of four superpixels centered around a single pixel. Consequently, a single pixel could be corrected four times. Therefore, after four calibrations for a single pixel, an average was obtained to derive the final calibration result.

4. Experimental results

4.1 Experimental setup

The non-uniformity correction algorithm was tested by acquiring uniform images according to the device shown in Fig. 3(a) and (b). The light source required for short-wave DoFP detector calibration was a high-temperature blackbody. In this study, a high-temperature blackbody with a working range of 0–400 °C was used as an unpolarized light source. The ideal polarizer is Thorlabs WP50L-UB, with polarized wavelengths from 250 nm to 4 µm and extinction ratios of up to 10,000:1. The high-precision rotating platform was a Thorlabs Model BSC 101. This study uses a short-wave DoFP detector [19] developed by the Shanghai Institute of Technical Physics, Chinese Academy of Sciences, and the pixel response band is 0.9um∼1.7um. The detector has $320 \times 256$ pixels, each of which has 14 bits.

First, the device shown in Fig. 3(a) was used to collect images taken at two different temperatures and rotated at 18 different angles at four integration time. The device shown in Fig. 3(b) was then used to collect images taken at 12 different temperatures by setting the DoFP detector at four different integration time. Each image was sampled 256 times to reduce the effect of time noise on the results. At the time of data acquisition, the maximum intensity was set as high as possible with the pixel unsaturated and then decreased by 10 °C each time. The rotating platform rotated by 18 angles, starting at 0° and increasing by 10°. In the experiment, we filled the field of view of the DoFP detector with the outgoing blackbody radiation so that the distance of blackbody radiation to the focal plane of the detector was as equal as possible.

4.2 Correction analysis

To elucidate the distinctive features and benefits of our proposed algorithm, we compared it with existing methods, including superpixel correction (Superpixel) [21], adjacent superpixel correction (A-superpixel) [22], average analysis matrix correction (A-matrix) [23], and Yin’s method [28]. This analysis focused on the correction parameter calculated using data collected under a 4 ms integration time. Subsequently, various correction algorithms were tested using datasets obtained at different integration time to assess their performance and to highlight the effectiveness of the algorithm in diverse scenarios.

To quantify the performance of the different correction algorithms, we used the RMSE as a metric to precisely describe the performance of the correction algorithm.

$$RMSE = \sqrt {\frac{1}{N}\sum\limits_{i = 1}^N {{{[{R(i) - {R_{ideal}}} ]}^2}} } ,$$
where ${R_{ideal}}$ represents the ideal value of the image, N signifies the total number of pixels, and $R(i)$ denotes the value of the $i$ th pixel in image R. RMSE serves as a quantitative measure. A greater RMSE value indicates a wider disparity between the image and the ideal value, correlating with lower correction accuracy. Conversely, a lower RMSE signifies a diminished gap between the image and ideal value, indicating a higher correction accuracy.

We designate the image captured by the DoFP, following modulation of blackbody emission radiation by an ideal polarizer, as a polarized image. In contrast, the image captured by the DoFP without ideal polarizer modulation is termed unpolarized. By applying the five correction algorithms to the unpolarized image, with ${R_{ideal}}$ representing the mean value of the image, we calculated the RMSE based on the S0 image of DoFP, as illustrated in Table 1. Additionally, the DoLP and AoLP images lack valid values and are thus excluded from Table 1. The second to sixth columns show the RMSE values calculated using five different correction algorithms: the Superpixel correction method, A-superpixel correction method, A-matrix correction method, Yin's method, and the correction method proposed in this paper.

Tables Icon

Table 1. Results of five correction algorithms applied to unpolarized images.

As observed in Table 1, the Superpixel correction, A-superpixel correction, and A-matrix methods display limited correction efficacy for unpolarized light. This limitation is attributed to their reliance on mutual constraints between superpixels. In scenarios with low scene polarization, the effective establishment of these mutual constraint falters leads to a pronounced reduction in correction effectiveness. Yin’s method can effectively correct the non-polarization scene, but with a change in the integration time, the Yin method deteriorates rapidly. In contrast, the correction method proposed in this paper is very effective for non-polarized images and has the best robustness in the integration time range of 1–4 ms.

Table 2 presents the RMSE calculation results for various correction algorithms for the S0, DoLP, and AoLP images of DoFP. It is crucial to highlight that in our experiment, the ideal DoLP was set to 1, and the ideal AoLP corresponded to the rotation angle of the ideal polarizer. Upon careful examination of Table 2, the A-superpixel method stands out for its superior efficacy compared with the Superpixel method. This approach strategically employs four superpixels adjacent to one pixel for correction when addressing a single pixel. However, the A-matrix method exhibits suboptimal performance on AoLP and DoLP images because of the lack of an ideal analysis matrix. However, it achieved the lowest RMSE for the S0 images. Yin's method fails to provide good results when correcting polarized images, probably because it fails to strike a balance between response correction and polarization correction. Remarkably, the correction algorithm proposed in this study outperformed the other four methods on DoLP images, delivering lower RMSE values. The proposed method demonstrates a significant advantage even on AoLP images, especially within the integration time range of 3–1 ms. Additionally, our algorithm demonstrates outstanding stability amidst changes in integration time, consistently maintaining a high correction effect. The RMSE variation observed in the AoLP and DoLP images was notably lower than that of the Superpixel and A-superpixel algorithms.

Tables Icon

Table 2. Results of five correction algorithms applied to polarized images.

As shown in Tables 1 and 2, to enhance the adaptability of the algorithm across diverse scenarios, we opted to segregate the intensity and polarization correction of DoFP. This strategic choice renders our proposed algorithm more advantageous for reconstructing intensity information (S0) in unpolarized scenes, albeit with a slight reduction in accuracy for intensity information in polarized scenes. However, the proposed algorithm guarantees higher accuracy in polarization information (DoLP and AoLP) during second-stage correction in polarized scenes.

In Fig. 7, a 1 ms integration time measurement is used as an example to visually illustrate the impact of different correction algorithms on the polarization state measurement accuracy of the DoFP detector. Figure 7 depicts the outcomes of the five distinct correction algorithms in the polarization state measurement, including the ideal values. The horizontal coordinates in Fig. 7 refer to 100 randomly sampled test points. The correction results of the A-matrix method differed from the ideal value, indicating that the use of the average analysis matrix was less effective in correcting the polarized scene. The results of Yin's method are unstable. The Superpixel correction method, A-superpixel correction method, and the algorithm proposed in this paper closely approach ideal values. As indicated in Table 2, the proposed algorithm demonstrates minor errors in the polarization state measurement compared with other algorithms.

 figure: Fig. 7.

Fig. 7. Schematic diagram of polarization state measurement, (a) polarization angle measurement, (b) polarization degree measurement.

Download Full Size | PDF

In summary, the algorithm proposed in this paper demonstrates significant advantages over the other four algorithms for unpolarized images. Moreover, our algorithm outperforms the others in terms of accurately measuring the polarization state in polarized images.

4.3 Visual effect comparison

In the final phase, we implemented our correction algorithm on authentic DoFP polarization images, subjecting them to testing against five distinct correction techniques. To demonstrate better visualization, all the final images presented use the [34] method to reduce the field of view error, which does not affect the comparison of non-uniformity correction algorithms.

Figure 8 shows the original image taken by the DoFP camera, and Fig. 8(a) to (d) shows the images taken when the integration time is set at 1 ms to 4 ms, respectively.

 figure: Fig. 8.

Fig. 8. Real scene captured by DoFP camera, (a) 1 ms image, (b) 2 ms image, (c) 3 ms image, (d) 4 ms image.

Download Full Size | PDF

In Fig. 9, a series of DoLP images are presented. The rows correspond to images captured with the DoFP camera set at integration time ranging from 4 ms to 1 ms. Within each row, the columns represent the uncorrected images, those corrected using the Superpixel method, A-superpixel method, A-matrix method, Yin’s method, and the algorithm proposed in this paper, respectively. For visual clarity, a pseudo-color representation is employed in the display of the DoLP images.

 figure: Fig. 9.

Fig. 9. DoLP images of real scenes, (a) Uncalibrated, (b) Superpixel, (c) A-superpixel, (d) A-matrix, (e) Yin’s method, (f) Proposed.

Download Full Size | PDF

The analysis in Fig. 9 reveals a notably low degree of linear polarization in the uncorrected image. As the integration time decreases from 4 ms, the images corrected by the Superpixel correction method, A-superpixel correction method, and Yin’s method exhibit increasing noise. Notably, the A-superpixel correction method surpasses the Superpixel correction method, showing superior correction effects and heightened stability with changing integration time. While the A-matrix method demonstrates more stable correction effects than the first two methods, it comes at the cost of a lower calculated polarization. This observation aligns with the findings in Table 2, underscoring a critical limitation of the A-matrix method: its failure to employ the ideal analysis matrix for correction, resulting in an inability to rectify the micropolarization array in DoFP to the desired level. In stark contrast, the algorithm proposed in this paper excels in correction, displaying optimal performance and remarkable stability across integration time ranging from 4 to 1 ms.

Figure 10 shows the AoLP images following the same arrangement as in Fig. 9. Notably, the polarization angle is displayed across a range of −90° to 90°, representing the angle of scene-polarized light relative to the 0° channel of the MPA pixel. Figure 10 shows that fringe noise emerges in the uncorrected image as the integration time changes. The correction effects of the Superpixel, A-superpixel, A-matrix, and Yin’s methods mirror those observed in the DoLP images, deteriorating with decreasing integration time. Remarkably, under an integration time of 1 ms, the AoLP images from these four correction methods struggle to distinguish features such as the car tail in the image. By contrast, the algorithm proposed in this study maintained the most effective correction and remarkable stability.

 figure: Fig. 10.

Fig. 10. AoLP images of real scenes, (a) Uncalibrated, (b) Superpixel, (c) A-superpixel, (d) A-matrix, (e) Yin’s method, (f) Proposed.

Download Full Size | PDF

It is difficult to evaluate the image quality of authentic DoFP images, but this study used the accuracy of polarization measurement redundancy (APMR) [35] metrics to evaluate authentic DoFP images. APMR, which is based on physical information, presents the distinct advantage of evaluating the polarization image quality without requiring reference data.

$$APMR = 10{\log _{10}}\left( {\frac{{{{({2^k} - 1)}^2} \cdot h \cdot w}}{{\sum\limits_{i = 1}^h {\sum\limits_{j = 1}^w {(I_{i,j}^0 + I_{i,j}^{45} - I_{i,j}^{90} - I_{i,j}^{135})} } }}} \right),$$
where h and w are the length and width of the polarized image, respectively. $I_{i,j}^0$, $I_{i,j}^{45}$, $I_{i,j}^{90}$, and $I_{i,j}^{135}$ are the pixel values of the four-channel polarized image at pixel point $(i,j)$, respectively. The higher the APMR, the better is the polarization image quality.

Table 3 shows the average APMR obtained using different correction algorithms at integration time ranging from 4 ms to 1 ms. The algorithm proposed in this paper achieved the highest APMR in authentic DoFP images, which indicates its excellent correction effect.

Tables Icon

Table 3. Average APMR of five correction algorithms for real DoFP images.

5. Summarize

In this paper, we introduce a two-stage non-uniformity correction algorithm for short-wave infrared polarization detectors and present the theoretical framework of the new correction method. We discuss in detail the source of non-uniformity noise in DoFP detectors based on the DoFP detector imaging model, discuss the effect of integration time on the non-uniformity noise, and introduce a dark offset estimation algorithm to remove the effect of integration time on the non-uniformity of DoFP.

Our method decomposes the analysis vectors of DoFP pixels into average polarization response and unit analysis vectors, which are corrected using radiometric and polarization correction methods, respectively, so that the correction algorithm can be adapted to a broader range of scenes. We compared the proposed algorithm with the current mainstream algorithms in uniform images, and the experimental results showed that the proposed method can adapt to both unpolarized and polarized scenes and achieve optimal results in polarization measurement accuracy. Most importantly, the algorithm proposed in this study exhibits the best robustness when the integration time changes.

Funding

The National Pre-research Program during the 14th Five-Year Plan (514010405).

Disclosures

The authors declare no conflicts of interest.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

1. H. Zhao, Huan Li, Xu-ling Lin, et al., “Research on spectral polarization imaging system based on static modulation,” Guang pu xue yu Guang pu fen xi = Guang pu 35, 1129–1133 (2015).

2. P. Terrier, Vincent Devlaminck, Jean Michel Charbois, et al., “Segmentation of rough surfaces using a polarization imaging system,” J. Opt. Soc. Am. A 25(2), 423–430 (2008). [CrossRef]  

3. N. M. Garcia, Ignacio de Erausquin, Christopher Edmiston, et al., “Surface normal reconstruction using circularly polarized light,” Opt. Express 23(11), 14391–14406 (2015). [CrossRef]  

4. B. Shen, Peng Wang, Randy Polson, et al., “Ultra-high-efficiency metamaterial polarizer,” Optica 1(5), 356–360 (2014). [CrossRef]  

5. G. G. Stokes, “On the composition and resolution of streams of polarized light from different sources,” Transactions of the Cambridge Philosophical Society 9, 399 (1851).

6. N. Li, Yongqiang Zhao, Quan Pan, et al., “Removal of reflections in LWIR image with polarization characteristics,” Opt. Express 26(13), 16488–16504 (2018). [CrossRef]  

7. D. Miyazaki, “Polarization-based inverse rendering from a single view,” in Computer Vision, IEEE International Conference on, (IEEE Computer Society, 2003), 982.

8. L. Shen and Yongqiang Zhao, “An iterative image dehazing method with polarization,” IEEE Trans. Multimedia 21(5), 1093–1107 (2019). [CrossRef]  

9. B. M. Ratliff, Charles F. LaCasse, J. Scott Tyo, et al., “Interpolation strategies for reducing IFOV artifacts in microgrid polarimeter imagery,” Opt. Express 17(11), 9112–9125 (2009). [CrossRef]  

10. A. Ahmed, Xiaojin Zhao, Viktor Gruev, et al., “Residual interpolation for division of focal plane polarization image sensors,” Opt. Express 25(9), 10651–10662 (2017). [CrossRef]  

11. S. Mihoubi, Olivier Losson, Benjamin Mathon, et al., “Multispectral Demosaicing Using Intensity in Edge-Sensing and Iterative Difference-Based Methods,” in 2016 12th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), (2016), pp. 805–810.

12. S. Qiu, Qiang Fu, Congli Wang, et al., “Polarization demosaicking for monochrome and color polarization focal plane arrays,” in International Symposium on Vision, Modeling and Visualization, 2019, (The Eurographics Association, 2019).

13. N. Li, Yongqiang Zhao, Quan Pan, et al., “Demosaicking DoFP images using Newton's polynomial interpolation and polarization difference model,” Opt. Express 27(2), 1376–1391 (2019). [CrossRef]  

14. S. Wen, Yinqiang Zheng, Feng Lu, et al., “A sparse representation based joint demosaicing method for single-chip polarized color sensor,” IEEE Trans. on Image Process. 30, 4171–4182 (2021). [CrossRef]  

15. Q. Hui-Ming, “Evaluation of non-uniformity correction precision for infrared focal panel arrays,” (2010).

16. Z.-l. Tang and L. Qi, “Correction of Non-uniformity of Infrared Focal Plane Image,” SEMICONDUCTOR OPTOELECTRONICS-CHONGQING 23, 344–346 (2002).

17. F. Su, S.-H. Sun, W.-S. Yang, et al., “Non-uniformity correction for IRFPA with image gradient-based neural network,” Infrared and Laser Engineering 36, 754 (2007).

18. B. Chen, Xiubao Sui, and Yuan Liu, “Non-uniformity correction based on complex neural network based on fixed scene,” Symmetry 10(11), 612 (2018). [CrossRef]  

19. D. Sun, Tao Li, Bo Yang, et al., “Research on polarization performance of InGaAs focal plane array integrated with superpixel-structured subwavelength grating,” Opt. Express 27(7), 9447–9458 (2019). [CrossRef]  

20. T. York and V. Gruev, “Characterization of a visible spectrum division-of-focal-plane polarimeter,” Appl. Opt. 51(22), 5392–5400 (2012). [CrossRef]  

21. S. B. Powell and V. Gruev, “Calibration methods for division-of-focal-plane polarimeters,” Opt. Express 21(18), 21040–21055 (2013). [CrossRef]  

22. Z. Chen, Xia Wang, Rongguang Liang, et al., “Calibration method of microgrid polarimeters with image interpolation,” Appl. Opt. 54(5), 995–1001 (2015). [CrossRef]  

23. J. Zhang, Haibo Luo, Bin Hui, et al., “Non-uniformity correction for division of focal plane polarimeters with a calibration method,” Appl. Opt. 55(26), 7236–7240 (2016). [CrossRef]  

24. Y. Lv, Shi Ze-Lin, Feng Bin, et al., “Non-uniformity calibration for MWIR polarization imagery obtained with integrated microgrid polarimeters,” in Selected Papers of the Chinese Society for Optical Engineering Conferences held October and November 2016, (2017).

25. B. Feng, Zelin Shi, Haizheng Liu, et al., “Polarized-pixel performance model for DoFP polarimeter,” J. Opt. 20(6), 065703 (2018). [CrossRef]  

26. N. Hagen, Shuhei Shibata, Yukitoshi Otani, et al., “Calibration and performance assessment of microgrid polarization cameras,” Opt. Eng. 58(08), 1 (2019). [CrossRef]  

27. Z. Ding, Shuhei Shibata, Yukitoshi Otani, et al., “Calibration method for division-of-focal-plane polarimeters using nonuniform light,” IEEE Photonics J. 12(2), 1–8 (2020). [CrossRef]  

28. J. Yin, “Calibration and non-uniformity correction of near-infrared polarization detector,” Journal of Infrared and Millimeter Waves 39, 235–241 (2020). [CrossRef]  

29. C. Lane, “Calibration of a polarization image sensor and investigation of influencing factors,” Appl. Opt. 61(6), C37–C45 (2022). [CrossRef]  

30. G. Chi, Mengfan Li, Yadong Hu, et al., “Study on polarimetric calibration method for multispectral division of focal plane polarimeter,” in Ninth Symposium on Novel Photoelectronic Detection Technology and Applications, (SPIE, 2023), 1861–1867.

31. D. Wang, Ren Zhi-Gang, Liu Sha, et al., “Polarization redundancy estimation scene-based non-uniformity correction algorithm,” Journal of Infrared and Millimeter Waves 40, 878–885 (2021). [CrossRef]  

32. Y. Giménez, Pierre-Jean Lapray, Alban Foulonneau, et al., “Calibration algorithms for polarization filter array camera: survey and evaluation,” J. Electron. Imag. 29(04), 1 (2020). [CrossRef]  

33. J. S. Tyo, “Design of optimal polarimeters: maximization of signal-to-noise ratio and minimization of systematic error,” Appl. Opt. 41(4), 619–630 (2002). [CrossRef]  

34. J. Xin, Zheng Li, Shiguang Wu, et al., “Demosaicking DoFP images using edge compensation method based on correlation,” Opt. Express 31(9), 13536–13551 (2023). [CrossRef]  

35. N. Li, Benjamin Le Teurnier, Matthieu Boffety, et al., “No-reference physics-based quality assessment of polarization images and its application to demosaicking,” IEEE Trans. on Image Process. 30, 8983–8998 (2021). [CrossRef]  

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (10)

Fig. 1.
Fig. 1. Schematic diagram of a micropolarization array sensor.
Fig. 2.
Fig. 2. DoFP camera imaging schematic.
Fig. 3.
Fig. 3. DoFP detector calibration model, (a) polarization calibration model, (b) radiometric calibration model.
Fig. 4.
Fig. 4. DoFP detector non-uniformity diagram, (a) average polarization responsivity ${A_0}$, (b) dark offset d, (c) diattenuation coefficient D, (d) the direction of polarization transmission of the micropolarizer $\alpha$.
Fig. 5.
Fig. 5. Image response curves of the DoFP detector, (a) the polarization response ${I_p}(\theta ,t)$, (b) the radiant response ${I_f}(T,t)$, (c) the polarization response divided by the integration time ${I^{\prime}_p}(\theta ,t)$, (d) the radiant response divided by the integration time ${I^{\prime}_f}(T,t)$.
Fig. 6.
Fig. 6. Four images A, B, C, and D are randomly selected at the DoFP detector Curve, (a) $d^{\prime}(t)$, (b) $\ln [d^{\prime}(t)]$.
Fig. 7.
Fig. 7. Schematic diagram of polarization state measurement, (a) polarization angle measurement, (b) polarization degree measurement.
Fig. 8.
Fig. 8. Real scene captured by DoFP camera, (a) 1 ms image, (b) 2 ms image, (c) 3 ms image, (d) 4 ms image.
Fig. 9.
Fig. 9. DoLP images of real scenes, (a) Uncalibrated, (b) Superpixel, (c) A-superpixel, (d) A-matrix, (e) Yin’s method, (f) Proposed.
Fig. 10.
Fig. 10. AoLP images of real scenes, (a) Uncalibrated, (b) Superpixel, (c) A-superpixel, (d) A-matrix, (e) Yin’s method, (f) Proposed.

Tables (3)

Tables Icon

Table 1. Results of five correction algorithms applied to unpolarized images.

Tables Icon

Table 2. Results of five correction algorithms applied to polarized images.

Tables Icon

Table 3. Average APMR of five correction algorithms for real DoFP images.

Equations (35)

Equations on this page are rendered with MathJax. Learn more.

S = [ S 0 S 1 S 2 S 3 ] = [ ( I 0 + I 45 + I 90 + I 135 ) / 2 I 0 I 90 I 45 I 135 I R I L ] ,
D o L P = S 1 2 + S 2 2 S 0 ,
A o L P = 1 2 arctan ( S 2 S 1 ) ,
M f = A [ 1 D cos ( 2 α ) D sin ( 2 α ) 0 D cos ( 2 α ) 1 D sin 2 ( 2 α ) D sin ( 4 α ) / ( 4 A ) 0 D sin ( 2 α ) D sin ( 4 α ) / ( 4 A ) 1 D cos 2 ( 2 α ) 0 0 0 0 1 D ] ,
A = 1 2 ( q + r ) , D = q r q + r .
M i d e a l = 1 2 [ 1 cos ( 2 α ) sin ( 2 α ) 0 cos ( 2 α ) 1 sin 2 ( 2 α ) sin ( 4 α ) / 2 0 sin ( 2 α ) sin ( 4 α ) / 2 1 cos 2 ( 2 α ) 0 0 0 0 0 ] .
S o u t = M f S i n .
L = [ 1 0 0 0 ] S o u t = [ 1 0 0 0 ] M f S i n .
I = g L + d ,
I = g [ 1 0 0 0 ] M f S i n + d = g A [ 1 D cos ( 2 α ) D sin ( 2 α ) 0 ] S i n + d = A f S i n + d , .
I p = g [ 1 0 0 0 ] M f M i d e a l S i n + d = 1 2 L [ A 0 + A 1 cos ( 2 θ ) + A 2 sin ( 2 θ ) ] + d ,
L = λ 2 λ 1 c 1 λ 5 [ e x p ( c 2 λ T ) 1 ] d λ ,
I f = g [ 1 0 0 0 ] M f S i n + d = A 0 L + d , .
I p ( θ , t ) = 1 2 A 0 ( t ) L d [ 1 + D cos ( 2 α ) cos ( 2 θ ) + D sin ( 2 α ) sin ( 2 θ ) ] + d ( t ) .
I f ( T , t ) = A 0 ( t ) L ( T ) + d ( t ) ,
A 0 ( t ) = k t ,
I f ( T , t ) = k L ( T ) + d ( t ) ,
I p ( θ , t ) = 1 2 k L d [ 1 + D cos ( 2 α ) cos ( 2 θ ) + D sin ( 2 α ) sin ( 2 θ ) ] + d ( t ) ,
ln [ d ( t ) ] = a ln ( t ) + b ,
d ( t ) = e b t a .
min c a l f | | C a l f ( I f ) I f , i d e a l | | 2 ,
C a l f ( I f ) = g c ( I f d c ) .
I f , i d e a l = k i d e a l L ,
min C a l f | | g c ( I f d c ) k i d e a l L | | 2 = min C a l f | | g c [ k L + d ( t ) d c ] k i d e a l L | | 2 ,
g c = k i d e a l k , d c = d ( t ) ,
I p ( θ ) = 1 2 k i d e a l L [ 1 + D cos ( 2 α ) cos ( 2 θ ) + D sin ( 2 α ) sin ( 2 θ ) ] = k i d e a l L [ 1 A 1 A 2 0 ] [ 1 2 L 1 2 L cos ( 2 θ ) 1 2 L sin ( 2 θ ) 0 ] T = k i d e a l L A f S i n ,
A s p = [ 1 A 1 , 0 A 2 , 0 0 1 A 1 , 45 A 2 , 45 0 1 A 1 , 90 A 2 , 90 0 1 A 1 , 135 A 2 , 135 0 ] ,
A s p , i d e a l = [ 1 D cos ( 0 ) D cos ( 0 ) 0 1 D cos ( 90 ) D cos ( 90 ) 0 1 D cos ( 180 ) D cos ( 180 ) 0 1 D cos ( 270 ) D cos ( 270 ) 0 ] = [ 1 1 0 0 1 0 1 0 1 1 0 0 1 0 1 0 ] .
min C a l s p | | C a l s p ( I s p ) I s p , i d e a l | | 2 ,
C a l s p ( I s p ) = G c I s p ,
I s p , i d e a l = k i d e a l L A s p , i d e a l S i n ,
min C a l s p | | G c I s p k i d e a l L A s p , i d e a l S i n | | 2 = min C a l s p | | G c ( k i d e a l L A s p S i n ) k i d e a l L A s p , i d e a l S i n | | 2 ,
G c = A s p , i d e a l A s p + ,
R M S E = 1 N i = 1 N [ R ( i ) R i d e a l ] 2 ,
A P M R = 10 log 10 ( ( 2 k 1 ) 2 h w i = 1 h j = 1 w ( I i , j 0 + I i , j 45 I i , j 90 I i , j 135 ) ) ,
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.