Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Noise effect on 2D photoluminescence decay analysis using the RATS method in a single-pixel camera configuration

Open Access Open Access

Abstract

Using a random temporal signal for sample excitation (RATS method) is a new, capable approach to measuring photoluminescence (PL) dynamics. The method can be used in single-point measurement (0D), but also it can be converted to PL decay imaging (2D) using a single-pixel camera configuration. In both cases, the reconstruction of the PL decay and PL snapshot is affected by ubiquitous noise. This article provides a detailed analysis of the noise effect on the RATS method and possible strategies for its suppression. We carried out an extensive set of simulations focusing on the effect of noise introduced through the random excitation signal and the corresponding PL waveform. We show that the PL signal noise level is critical for the method. Furthermore, we analyze the role of acquisition time, where we demonstrate the need for a non-periodic excitation signal. We show that it is beneficial to increase the acquisition time and that increasing the number of measurements in the single-pixel camera configuration has a minimal effect above a certain threshold. Finally, we study the effect of a regularization parameter used in the deconvolution step, and we observe that there is an optimum value set by the noise present in the PL dataset. Our results provide a guideline for optimization of the RATS measurement, but we also study effects generally occurring in PL decay measurements methods relying on the deconvolution step.

© 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

1. Introduction

Fluorescence lifetime imaging (FLIM) is a frequent spectrometric analysis in biology [1,2], chemistry [3], and materials engineering [4]. There are various techniques for measuring or evaluating photoluminescence (PL) dynamics, such as time-correlated single photon counting [5], gated PL counting [6], streak camera [7], time-domain or frequency-domain analog recording technique [8,9]. Another available method for PL decay measurement is based on random excitation of the measured sample - the RATS method (RAndom Temporal Signals) [10], which could also be set in a single-pixel camera (SPC) configuration [11] and carry out the FLIM experiment. We abbreviate this measurement as 2D-RATS. At the current state, the method can characterize morphology in the order of microseconds or sub-micro seconds (hundreds of nanoseconds), including halide perovskite samples, solid-phase luminophores, or Si nanocrystals [1214]. However, ongoing research shows that it will be realistic to measure even at the nanosecond scale.

The 2D-RATS method combines the SPC technique with the excitation of the PL with random patterns (masks) blinking randomly in time. Each mask leads to a specific PL decay, which is measured for a set of uncorrelated masks. Then, using algorithms for undetermined systems, it is possible to reconstruct PL decays in each individual pixel of the 2D scene. The quality of reconstruction is affected by noise, which is inevitably present in all measured data. Therefore, the noise analysis of the method is an essential piece of knowledge that allows optimization of the method and identifies the most sensitive aspects of the setup. Moreover, many results valid for the RATS method are also relevant for the PL measurement, where the deconvolution step is used [15].

In this article, we carry out a detailed study of various noise effects on the 2D-RATS measurement and their impact on the resulting FLIM information. Our analysis is based on extensive simulations and a set of synthetic data faithfully following the real experimental conditions for the SPC experiment carried with a digital micro-mirror device (binary illumination mask). A digital micro-mirror device is part of our latest 2D-RATS setup, where it replaced an optical diffuser (greyscale mask) [11]. Nevertheless, both binary and greyscale masks lead to the same trends with respect to the noise level, and the presented results are generally valid for both random mask implementations.

We analyze the benefits of various approaches to noise reduction. Besides the generally used option to prolong the acquisition time [16], the deconvolution step in the RATS method allows us to optimize the regularization parameter of the deconvolution [17,18]. Due to the random nature of the excitation signal in RATS, we avoid the use of any mathematical filters which can be apparently optimized for one type of signal, but due to the possibility of choosing a different signal frequency and sampling, such a filter can be difficult to transfer to a general case.

Our article provides guidelines for optimizing experiments for PL decay measurement and FLIM, where the deconvolution-based retrieval of PL dynamics is used. We demonstrate that the noise present in the PL dataset is the most critical factor. At the same time, we show that the resulting noise level in the FLIM dataset can be highly decreased by using a longer non-periodic excitation signal or by optimizing the regularization parameter. The parameter features an optimum value for a given noise level. We point out the issues connected to a periodic excitation signal.

In particular, we demonstrate that with proper choice of regularization parameter and acquisition time, the RATS method can attain results that are not distorted at all and can accurately map a 2D scene even with a relatively high noise level (3%).

2. RATS method

We will first introduce the principles of the single-spot 0D-RATS method and imaging 2D-RATS measurement. The cornerstone of the RATS method is sample excitation with a random signal IEXC. The random signal IEXC could be generated using a generator (lens, rotating diffuser, aperture) described in our previous work [10]. However, there are many different ways to generate a random signal. In the experiment should be detected IEXC (photodiode) and PL signal IPL (photomultiplier), which is given as convolution of IEXC and PL decay ID (Eq. (1)).

$${I_{PL}} = {I_{EXC}} \ast {I_D}.$$

This fact can be used to recover the PL decay from IPL by using the Fourier transform and the convolution theorem. The deconvolution is attainable only for the frequencies where the excitation signal has a non-zero amplitude. Nevertheless, due to random excitation, a single measurement contains a broad range of frequencies in a single dataset. PL decay ID could then be determined via deconvolution (Eq. (2)), wherein the denominator is regularization parameter ɛ adding a part of the average power of the spectrum due to it is possible to solve ill-conditioned problems.

$${I_D} = Re\left\{ {{\mathrm{\mathbb{F}}^{ - 1}}\left[ {\frac{{\mathrm{\mathbb{F}}({{I_{PL}}} ){\; }{\mathrm{\mathbb{F}}^\ast }({{I_{EXC}}} )}}{{\mathrm{\mathbb{F}}({{I_{EXC}}} ){\mathrm{\mathbb{F}}^\ast }({{I_{EXC}}} )+ \mathrm{\varepsilon }\overline {\mathrm{\mathbb{F}}({{I_{EXC}}} ){\mathrm{\mathbb{F}}^\ast }({{I_{EXC}}} )} }}} \right]} \right\}.$$

The 2D-RATS measurement is carried out in an SPC configuration, as we described in our previous article [11]. We point the reader to numerous articles summarizing the SPC experiment for more details [1922]. In our implementation of the SPC experiment, the sample was illuminated with a set of random excitation patterns (masks). The excitation masks were “blinking” with the same waveform IEXC(t), and the whole PL from each illuminated point i is collected to a single-pixel detector. The time t for which a single mask illuminates the sample following the intensity fluctuation of IEXC(t) is stated as acquisition time and is marked as tacq. For the 0D-RATS, the acquisition time is equal to the total duration of the experiment. For the 2D-RATS experiment, the measurement over the acquisition time is repeated for each random mask.

The photoluminescence IPL is given as a summation of IPL(i) signals. Then Eq. (1) can be rewritten for the total PL intensity as:

$${I_{PL}} = \sum\limits_{i = 1}^n {{I_{PL}}(i )= {I_{EXC}} \ast \sum\limits_{i = 1}^n {{I_D}(i )} } .$$

The number of excitation masks M is set by the number of image pixels N and the so-called compression ratio k = M/N. Because masks are not coherent, i.e., one pattern is not correlated with each other, each mask illuminates a different combination of the sample pixels, and, therefore, each mask represents its own IPL, which can be used to retrieve the PL decay IDA:

$${I_{DA}} = Re\left\{ {{\mathrm{\mathbb{F}}^{ - 1}}\left[ {\frac{{\mathrm{\mathbb{F}}\left( {\sum\limits_{i = 1}^n {{I_{PL(i)}}} } \right){\; }{\mathrm{\mathbb{F}}^\ast }({{I_{Exc}}} )}}{{\mathrm{\mathbb{F}}({{I_{Exc}}} ){\mathrm{\mathbb{F}}^\ast }({{I_{Exc}}} )+ \mathrm{\varepsilon }\overline {\mathrm{\mathbb{F}}({{I_{Exc}}} ){\mathrm{\mathbb{F}}^\ast }({{I_{Exc}}} )} }}} \right]} \right\}.$$

PL snapshot m(t) can be reconstructed in each delay after excitation t using the calculated IDA(t) curves. For the given delay and each excitation mask, the IDA(t) provides a dataset ISPC describing intensity fluctuation of M values – see Fig. 1(C), where each curve corresponds to a single ISPC dataset. Then PL snapshot m(t) is then retrieved from the underdetermined dataset by using a standard SPC retrieval:

$$min\{ ||{Am(t) - {I_{SPC}}} ||_2^2\; { + }TV(m(t))\} .$$

The sensing matrix A is formed from vectorized excitation patterns, TV stands for the total variation calculation.

 figure: Fig. 1.

Fig. 1. (A) Scheme of 2D-RATS approach, where the sample is illuminated with a set of random patterns (masks) blinking according to IEXC. The total PL intensity waveform IPL is detected for each mask with a single-pixel detector. (B) Example of a set of calculated IDA's for corresponding masks – see Eq. (4). (C) Intensity fluctuation for each delay after excitation of IDA. Knowing the fluctuation (ISPC signal) and set of masks makes it possible to determine the PL map m at a given delay after excitation of IDA using compressed sensing algorithms. (D) An example of reconstructed PL maps in delays t1 and t2. Plotted ID’s corresponding to pixel [14 10] (area “a”) and to pixel [16 25] (area “b”).

Download Full Size | PDF

By reconstructing a temporal snapshot for each delay t, we get a 3D datacube, which contains PL decay in every i-th pixel of the sample ID(i,t). The whole concept is illustrated and summarized in Fig. 1.

3. Noise effect simulation

A small contribution of noise can be expected in each measured signal in the experiment. In order to maintain stable conditions, the role of the noise was explored through simulations. A primary signal IEXC was simulated using temporal speckles patterns [23], which are cornerstones of a random analog signal generator presented in our previous work [10]. The length of the simulated IEXC signal was 0.1 s with an impulse response function of FWHM of 2.07µs. The PL decay ID was considered with the lifetime $\tau = 20$ µs. Used noise levels throughout the article are consistent with the noise that can be expected in a realistic experiment [15]. In the current optical setup, an amplified signal from a photomultiplier is used for IPL detection, and this sensitive part is the main source of the noise. The noise originates from scattered excitation photons and the noise induced in the detector itself, which is based on shot noise and standard electronic noise. The experimentally observed noise can be very well described with a flat frequency dependence, i.e., white noise.

The excitation signal IEXC was simulated as a non-periodic random signal. The importance of a non-periodic signal will be explained in section 4.1. It is worth noting that with the exception of section 4.3, the regularization parameter ɛ (Eq. (2) and Eq. (4), respectively) is considered as ɛ = 0.1.

3.1 0D-RATS

To demonstrate the basic steps, we shall start with the non-imaging RATS, i.e., 0D-RATS. We use two datasets of IEXC and IPL, which are subsequently used to retrieve the PL decay via Eq. (2). Therefore, we initially simulated the effect of noise present in these two datasets.

Firstly, we added white noise to IEXC, while IPL was kept absolutely noiseless (Fig. 2(A)) and vice versa (Fig. 2(B)). In both datasets in Fig. 2, the signal-to-noise ratio (SNR) was 15.2 dB which corresponds to 3% percent of noise in the system (see Eq. (6)).

 figure: Fig. 2.

Fig. 2. (A) Reconstructed ID with a noise level of 3% in IEXC, which corresponds with SNR about 15.2 dB. IPL was assumed noiseless. (B) Reconstructed ID with a noise level of 3% in IPL, corresponding with SNR about 15.2 dB. IEXC was assumed noiseless.

Download Full Size | PDF

For both retrieved decays in Fig. 2 (red lines), the noise had an effect on reconstructed ID, but the investigated PL dynamics were not biased, i.e., the overall decay shape was not altered, and it was in perfect agreement with the expected output (black lines). Nevertheless, we observed that the noise in the IPL dataset had a significantly more pronounced effect on the resulting noise in the retrieved PL decay (Fig. 2(B)).

$$SNR[dB] ={-} 10{\log _{10}}\left( {\frac{{noise[\%]}}{{100}}} \right).$$

We can quantify the noise level by the root-mean-square error, which reaches RMSEPL = 12.9·10−3 for the noise in the PL signal and RMSEEXC = 2.8·10−3 for the noise in the excitation signal. That suggests that regularization in the denominator of Eq. (2) has a more pronounced effect on IEXC than IPL, which becomes the dominating source of noise in the retrieved decay.

3.2 2D-RATS

As the next step, we also simulated the effect of noise in the IPL and IEXC signal on the 2D-RATS experiment. Here, the situation is more complex because the noise present in the IPL and IEXC datasets is first transposed into the noise of the retrieved PL decay curve IDA(t) from Eq. (4). The noise present in these curves is then propagating into the SPC signal ISPC, which is then used for the retrieval of the set of PL snapshots for each delay in Eq. (5).

All simulated reconstructions were performed using binary masks. We used the reconstruction algorithm based on the sparsity of total variation TVAL3 [24,25]. The main parameters of the TVAL3 algorithm were: mu (211), beta (27). As an investigated sample, we used Matlab predefined image Phantom, where the PL decay with a single lifetime of $\tau = 20$ µs was set to be constant all over the Phantom's “body”. Acquisition time and other conditions simulating real experiments were kept the same as for the 0D-RATS simulations above.

We carried out the same calculation as we presented in Section 3.1, and we show in Fig. 3 the retrieved PL snapshots m(t) in the peak PL intensity, i.e., t = 0 µs, where the contrast of the PL signal is the highest. The case was studied for three different SPC compression ratios k = 0.4, 0.6, 0.8 and four signal-to-noise ratios SNR = 15.2, 18.2, 20, 23 dB, which corresponds to 3%, 1.5%, 1%, 0.5% level of noise in the signal.

 figure: Fig. 3.

Fig. 3. Left part: reconstructions of PL map m in delay with maximal intensity (t = 0 µs) in case of noise in IEXC. Right part: reconstructions of PL map m in delay with maximal intensity (t = 0 µs) in case of noise in the IPL. The noise parameters are for both SNR = 15.2, 18.2, 20, 25 dB (rows) and the compression ratios are k = 0.4, 0.6, 0.8 (columns).

Download Full Size | PDF

The results are summarized in Fig. 3 for the noise introduced in the IEXC signal (left-hand side) and the noise introduced in the IPL signal (right-hand side), and the corresponding resulting noise levels are presented in Table 1.

Tables Icon

Table 1. Quality of the retrieved image (R, lower number = higher quality) and SPC signal (SPC-SNR, higher number = higher quality) corresponding to Fig. 3 for noise introduced via IEXC and IPL signal.

Analogously to the 0D-RATS, the noise in IPL has a significantly worse effect on the image retrieval than the noise in the IEXC signal. By comparing different noise levels (compare lines in Fig. 3), one can see that the SNR of the IPL is the main limiting factor in the snapshot retrieval. The effect of compression ratio (compare columns in Fig. 3) does not play any significant role for the values above 0.4. This means that it is not efficient to compensate for higher noise in the measured signal by simply increasing the number of measured excitation masks.

To quantify the effect of each parameter, we introduced three different measures. Firstly, we can judge the image reconstruction quality, where we compare the retrieved snapshot m (in delay t = 0 µs) with the actual image used in simulations U by using Frobenius norm of the two:

$$R = \frac{{{{ {||{m - U} } ||}_F}}}{{{{ {||U } ||}_F}}}.$$

We can also focus on the PL dynamics for each pixel i, where the reconstructed decay curve IDREC(i) is normalized and compared with the actual decay curve ID(i), which was used to simulate the data. The comparison was made from t0 = 0 µs to tΤ = 120 µs, which is a sufficient temporal range for the decay curve with a lifetime of 20 µs. We denote this error as the decay deviation σ:

$$\sigma = \frac{1}{N}\sum\limits_{i = 1}^N {\sum\limits_{t = {t_0}}^{{t_\tau }} {\sqrt {{{({{I_{DREC}}(i,t) - {I_D}(i,t)} )}^2}} } } .$$

Finally, we also determined the SNR of the ISPC signal, which is used for the image retrieval m in delay t = 0 µs. Note that the ISPC signal indicates the fluctuation of IDA curves corresponding to the respective delay. The fluctuations (ISPC) are affected by the noise in both IEXC and IPL. We extract the ISPC noise level to provide a comparison to other SPC experiments. SPC-SNREXC denotes the signal-to-noise level in ISPC when the noise was added to IEXC and SPC-SNRPL indicates the case when the noise was added to the IPL. Analogously, the indices “PL” and “EXC” have the same meanings for REXC and RPL or σEXC and σPL.

4. Noise level optimization

In Section 3, we studied the effect of the noise level in the IEXC respective IPL simulated dataset on the retrieval of the PL decay curve and PL snapshot. The noise levels are determined by the properties of an optical setup, which features a certain photon budget (number of detectable photons), types of detectors, and samples. For an optimized optical setup, such characteristics can not be easily improved.

On the other hand, it is possible to enhance the quality of the retrieved PL decay or FLIM on the expenses of the acquisition time. Therefore, we studied the benefits connected to a longer acquisition time. Due to the fact that the RATS method is based on signal deconvolution, an important factor is the periodicity of the signal, as we discuss in the following subsection.

4.1 Periodic extension of acquisition time

A straightforward approach to improve the quality of the PL decay ID retrieval via Eq. (2) is to repeat the same measurement for the same excitation waveform. Hence, we attain a periodic IEXC and IPL signal. However, it is worth stressing that the use of a periodic signal IEXC will create unwanted artefacts in the retrieved data. It follows from the nature of deconvolution in Eq. (2) that such periodic excitation waveform leads to a periodic ID signal with a lower amplitude. We will demonstrate this effect on a 0D-RATS simulation.

We compared the retrieved PL decay (ID curve) in the case of a non-periodic IEXC signal with a duration of 0.1 s and a periodic IEXC signal (7 periods) with the same total duration of 0.1 s. This is illustrated by Fig. 5. For completeness, we present in Fig. 4 the non-periodic signal used and the periodic signal counting seven periods. Both signals were simulated based on simulations of randomly changing speckle patterns [23], which corresponds with excitation signals generated via a random signal generator (lens-rotary diffuser-aperture) presented in our previous work [10]. Due to the rotating diffuser, a periodic signal can be expected, which due to small vibrations may be rather quasi-periodic. However, a perfectly periodic and non-periodic signal can be achieved via a suitable laser modulation.

 figure: Fig. 4.

Fig. 4. Used excitation non-periodic signal (left panel) and periodic signal with 7 periods (right panel). Both signals were simulated based on simulations of randomly changing speckle patterns [23], which corresponds with excitation signals generated via generator (lens-rotary diffuser-aperture) presented in our previous work [10].

Download Full Size | PDF

 figure: Fig. 5.

Fig. 5. Results of ID reconstruction (deconvolution), when non-periodic (panel A) and periodic (panel B) IEXC was used for sample excitation with lifetime Τ = 20 µs.

Download Full Size | PDF

The entire retrieved PL dataset is depicted in Fig. 5. The comparison between the periodic and non-periodic excitation – see right and left-hand side, respectively – shows that the amplitude of the retrieved PL for the periodic IEXC signal is about seven times smaller compared to the non-periodic case and the PL signal has multiple replicas.

When we zoom in Fig. 5(B) into the PL dynamics during the first hundreds of microseconds, i.e., one of the PL decay replicas, we get after normalization the correct ID following the actual decay – see Fig. 6. However, the resulting SNR is decreased. We tested in Fig. 6 the noise introduced via the excitation signal IEXC (panel A) and PL signal IPL (panel B). The root-mean-square error for curves in Fig. 6 reaches RMSEPL = 29.7·10−3 and RMSEEXC = 7.8·10−3 for the noise introduced in the IPL and IEXC signal, respectively. The noise level in Fig. 6 can be directly compared to Fig. 2, where we used a non-periodic signal and where RMSEPL = 12.9·10−3 and RMSEEXC = 2.8·10−3. For the non-periodic signal, the resulting noise level was more than 2-times lower.

 figure: Fig. 6.

Fig. 6. Zoomed results of ID reconstruction (Τ = 20 µs.), when IEXC was used as a periodic signal (7 periods). Redline is reconstructed data, and the black line is reference data. (A) Reconstruction with an amount of noise of 3% in IEXC (correspond with SNR about 15.2 dB). (B) Reconstruction with an amount of noise of 3% in IPL (correspond with SNR about 15.2 dB).

Download Full Size | PDF

To further illustrate this behavior, we carried out a set of simulations, where we kept a constant total acquisition time of 0.1 s, while the IEXC signal was set to be periodic with up to 16 periods – see Fig. 7. The root-mean-square error increases with the number of periods for both situations – noise in the IEXC and IPL signal. Therefore, for the sake of optimum signal reconstruction in the RATS method, it is worth avoiding any periodicity in the IEXC signal.

 figure: Fig. 7.

Fig. 7. RMSE of ID for a periodical IEXC with a constant total acquisition time of tacq = 0.1 s. The number of periods in the IEXC signal is varied. IPL respective IEXC noise level: SNR 15.2 dB.

Download Full Size | PDF

4.2 Non-periodic acquistion time extension

The possible way to suppress the noise effect is to extend the acquisition time so that we avoid any IEXC signal periodicity. This approach favors frequencies representing the true signal in the Fourier spectrum and suppresses the contribution of white noise. We carried out simulations corresponding to the 2D-RATS measurement presented in Fig. 3. Nevertheless, here we used a set of acquisition times tacq = 0.1 s, tacq = 0.2 s, tacq = 0.4 s, tacq = 1 s and tacq = 2 s. Other conditions, such as reconstruction parameters, regularization parameter ɛ, and signal properties, were kept the same as in Section 3.

As in Section 3.2, we focus on the quality of the retrieved image (REXC, RPL), noise introduced into the SPC signal (SPC-SNREXC, SPC-SNRPL) in delay t = 0 µs. Moreover, this section also focuses on the deviation of the whole reconstructed PL decay in each pixel of the sample (σEXC, σPL).

Dependences of each noise characteristics on the acquisition time are presented in Fig. 810. In these figures, the line/symbol color indicates the given SNR (red: 15.2dB, blue: 18.2dB, black: 20dB and magenta: 23dB); line/symbol type represent the compression ratio k (cross: 0.8, circle: 0.6, full line: 0.4).

 figure: Fig. 8.

Fig. 8. Reconstruction error REXC (left part), RPL (right part) at the delay t = 0 µs dependence on sensing time for different SNR: 15.2 dB (red), 18.2 dB (blue), 20 dB (black), 23 dB (magenta) and three different compression ratio k = 0.4 (full line), k = 0.6 (circle), k = 0.8 (cross).

Download Full Size | PDF

 figure: Fig. 9.

Fig. 9. Noise dependence in SPC signal (random fluctuation in intensity of ID in delay t = 0 µs, because of changing illumination masks) on sensing time according to added noise to IEXC (left part) and IPL (right part) with SNR: 15.2 dB (red), 18.2 dB (blue), 20 dB (black), 23 dB (magenta) and three different compression ratio k = 0.4 (full line), k = 0.6 (circle), k = 0.8 (cross).

Download Full Size | PDF

 figure: Fig. 10.

Fig. 10. Acquisition time dependance of σEXC – noise added to IEXC (left part) and σPL – noise added to IPL (right part). SNR: 15.2 dB (red), 18.2 dB (blue), 20 dB (black), 23 dB (magenta) and three different compression ratio k = 0.4 (full line), k = 0.6 (circle), k = 0.8 (cross).

Download Full Size | PDF

All the results in Fig. 810 confirm that the effect of noise level (varying color) is much more pronounced than the compression ratio (varying line/symbol type), i.e., increasing the number of excitation patterns above 40% compared to the number of the pixel has a negligible effect on the image quality.

When we focus on the noise introduced via IEXC signal, it has a low effect on the resulting image reconstruction – see Fig. 3, left-hand side. For this reason, the change in the acquisition time has almost no effect on the resulting noise level regarding the image quality and SPC signal error (see Fig. 8,9). A subtle peak in Fig. 8 for the acquisition time 0.2 s and a decrease in Fig. 9 for the same acquisition time are connected. They both indicate an increased amount of noise in the ISPC signal for the given case of PL map reconstruction at delay t = 0 µs, which is unexpected in light of the other results. However, we should consider that this result is connected just with only one delay point (t = 0 µs). If we take into account the whole decay curve ID (signal-to-noise ratio in all SPC signals connected with delay points of the curve ID), which is shown in Fig. 10, it can be observed that this irregularity is averaged out.

On the contrary, for the noise introduced via the IPL signal, we can highly improve the quality of the retrieved image by the increased acquisition time. This image quality enhancement is much more pronounced for higher noise levels. In the case where the noise level is 15.2 dB (3%), the RPL will decrease by 50%, while when the noise level is 23 dB (0.5%), the RPL will decrease by only 25%.

The results described in Fig. 8 are linked to the results presented in Fig. 9. As expected, the highest SPC-SNREXC and SPC-SNRPL are reached for the lowest noise level in the system - SNR = 23 dB (0.5%). On the other hand, the SPC-SNRPL increases as the acquisition time increases, which results in a decrease in the RPL. An interesting finding is that when the acquisition time is extended to 2s, the SPC-SNRPL increases even above the SPC-SNREXC value corresponding to this acquisition time. Consequently, the same trend is observed for the RPL and REXC values at a scanning time of 2 s.

Although it was stated that REXC and SPC-SNREXC do not change significantly with the acquisition time, it is worth noting that these values represent only a single PL snapshot at the selected delay t = 0 µs. The effect of acquisition time is notable for the decay curve reconstruction, which is highly improved both for the noise in IEXC and IPL – see σ in Fig. 10. Decay deviation σ decreases with the increasing acquisition time. Although both errors are in a different order of magnitude, by increasing the acquisition time from 0.1 s to 2 s, both σ errors decreased by the same ratio.

4.3. Regularization parameter effect

Another way to suppress the effect of noise is to change the regularization parameter ɛ in Eq. (2) and Eq. (4). The regularization parameter makes it possible to solve the ill-conditioned problem, where “division by zero” could occur for frequencies with very low amplitude in the IEXC signal [26]. The regularization parameter adds a part of the averaged power of the spectrum to the denominator of the Eq. (2) respective Eq. (4) and thus suppresses the influence of less frequent frequencies in the signal (white noise). As a result, the calculated ID or IDA is smoothed.

As in the previous section, the influence of the parameter ɛ was investigated regarding the quality of the reconstructed PL snapshot at the zero delay after excitation, which corresponds to the maximum PL intensity. All simulations were carried with the acquisition time of 0.1 s and a range of ɛ from 0.05 to 1. Reconstruction parameters and signal properties were held the same as in Section 3. Figure 1113 follow the same color scheme as in the previous section with respect to SNR (color) and compression ratio (line/symbol type).

 figure: Fig. 11.

Fig. 11. Reconstruction error REXC (left part), RPL (right part) at the delay t = 0 µs dependence on ɛ - different SNR: 15.2 dB (red), 18.2 dB (blue), 20 dB (black), 23 dB (magenta) and three different compression ratio k = 0.4 (full line), k = 0.6 (circle), k = 0.8 (cross).

Download Full Size | PDF

 figure: Fig. 12.

Fig. 12. Noise dependence in SPC signal (random fluctuation in intensity of ID in delay t = 0 µs, because of changing illumination masks) on ɛ according to added noise to IEXC (left part) and IPL (right part) with SNR: 15.2 dB (red), 18.2 dB (blue), 20 dB (black), 23 dB (magenta) and three different compression ratio k = 0.4 (full line), k = 0.6 (circle), k = 0.8 (cross).

Download Full Size | PDF

 figure: Fig. 13.

Fig. 13. ɛ dependance of σEXC – noise added to IEXC (left part) and σPL – noise added to IPL (right part). SNR: 15.2 dB (red), 18.2 dB (blue), 20 dB (black), 23 dB (magenta) and three different compression ratio k = 0.4 (full line), k = 0.6 (circle), k = 0.8 (cross).

Download Full Size | PDF

In accordance with the previous results, the effect of the added noise is much more pronounced than the compression ratio used. We will first focus on the influence of regularization parameter ɛ on the quality of the retrieved image, i.e., REXC and RPL – see Fig. 11. In these results, we see an interplay of two effects: the smoothing of the IDA and ID, respectively, and the bias of the reconstructed IDA respective ID.

Since the noise level in the IEXC affects the IDA reconstruction less than in IPL, the effect of biased reconstruction of IDA prevails and the REXC error increase with ɛ. Whereas in the case of RPL, the noise smoothing effect prevails in IDA for the low ɛ values and the RPL decreases. However, with increasing ɛ, the bias effect becomes dominant and the image quality is decreased again.

This is confirmed by Fig. 12, which shows the amount of noise in the individual SPC-SNREXC and SPC-SNRPL. This implies that for the given noise level in the IPL signal, there is an optimum regularization parameter providing the best results and this provides a guideline of the optimum ɛ value.

Figure 13 focuses on σ, which evaluates the fidelity of the reconstructed decay curves. Here, with increasing ɛ, both σEXC and σPL decrease despite the bias effect, i.e., a higher ɛ value provides a better estimate of the decay curve. We ascribe it to the fact that with decreasing intensity of IDA (the following delay after excitation), the noise level in the SPC signal increases, and thus the smoothing effect of the regularization parameter prevails over the bias effect.

Both the dependence of σEXC and σPL on ɛ are influenced by the amount of noise in the system. Especially for the high-noise PL signal (15.2 dB, 3%), the increase of ɛ from 0.05 to 1 reduced the σPL by 79%. Analogously to the previous results, the increase in regularization parameter has a lower effect on the noise introduced via IEXC signal – see σEXC, which decreases by 32% for the same noise level and ɛ change.

5. Conclusion

In this paper, we carried out an extensive analysis of the effect of noise within the RATS technique – a novel method for the PL decay reconstruction and FLIM. As we mentioned in the introduction, the method can now be used mainly in materials engineering due to the possibility of detecting PL decays at the microsecond or sub-microsecond level. However, ongoing research opens the possibility of measuring in units of nanoseconds, which could open up further possibilities for the characterization of a range of optical materials, chemical substances, as well as biological samples. Since this is a new method, the findings presented are important for the further direction of the method. The problem was investigated using simulations for cases with noise levels reaching 0.5–3% (SNR 23–15.2dB) of the signal. To disentangle the effect of each noise source, the noise was added to IEXC only and IPL was left noiseless and vice versa.

We consistently observed that the same noise level has a significantly greater effect when present in the IPL, which we ascribe to the fact that the regularization parameter ɛ is associated with the IEXC in the denominator of the relationship Eq. (2) and Eq. (4). Hence, the most efficient strategy to improve the data quality is to focus on the IPL intensity level and the connected noise.

Secondly, all our data simulations revealed that the effect of noise level is incomparably more important than the compression ratio k, i.e., the number of measured excitation masks in the single-pixel experiment. In other words, for k > 0.4, it is not possible to compensate for a higher noise level by increasing the number of excitation masks.

It is also essential to avoid using periodic excitation signals, which can cause periodicity in the retrieved decay and increase the resulting ID relative noise level. It is worth noting that the RATS method was originally based on an analog random signal generator, the main component of which is a rotary diffuser. Therefore, we attained a quasi-periodic signal, which played a significant role in the method. Using a non-periodic signal, for instance, by laser modulation, a greater signal-to-noise ratio will be obtained.

As expected, we observed that increasing the acquisition time of a single decay measurement (single excitation mask) can highly reduce the resulting noise and effectively compensate for the noise present in the PL measurement. The choice of acquisition time is also connected with the IRF of the signal and the expected PL lifetimes. Moreover, it fundamentally manages total sensing time during which the entire data set is acquired from all masks. Here we used lifetime Τ = 20 µs, so that IEXC signal with IRF = 2.07 µs was selected with data sampling 0.99 µs. For other signal parameters, different results than those presented here can be achieved after the same signal length extension. If we focus on shorter lifetimes, a faster signal (smaller IRF) is needed, and the total scanning time is also reduced in a given ratio. However, the simulated trends for R, SPC-SNR, and σ can be applied without compromising generality.

In order to suppress signal noise, we have deliberately avoided any mathematical signal filtering techniques so that we do not lose important information due to the random nature of the signal. Mathematical signal filtering could be optimized on the expenses of the general applicability of the results. Therefore, we explored instead the possibility to optimize the regularization parameter ɛ used in the PL decay retrieval.

The parameter ɛ was changed in the range 0.05 to 1. We observed a trade-off between the two effects. On the one hand, a higher value of ɛ smoothes the IDA curve, while, on the other hand, it distorts the IDA because some frequencies of the Fourier spectrum are favored. Therefore, we observed that there is an optimum value of ɛ connected to the noise level in the IPL signal. As a rule of thumb, for a system with a low noise level, we recommend keeping the parameter ɛ at 0.1 or 0.2. For a system with a high noise level, it is possible to increase the regularization parameter ɛ more significantly.

Funding

Ministerstvo Školství, Mládeže a Tělovýchovy (CZ.02.1.01/0.0/0.0/16_026/0008390); Technická Univerzita v Liberci (SGS-2021-3003).

Acknowledgment

We gratefully acknowledge the Mechanics laboratory of TOPTEC (Institute of Plasma Physics, Czech Academy of Sciences) for providing us with unique optomechanics components since the beginning of RATS method development.

Disclosures

The authors declare no conflicts of interest.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

1. R. Cubeddu, D. Comelli, C. D’Andrea, P. Taroni, and G. Valentini, “Time-resolved fluorescence imaging in biology and medicine,” J. Phys. D: Appl. Phys. 35(9), 201R61 (2002). [CrossRef]  

2. S. Kalinina, J. Breymayer, P. Schäfer, E. Calzia, V. Shcheslavskiy, W. Becker, and A. Rück, “Correlative NAD(P)H-FLIM and oxygen sensing-PLIM for metabolic mapping,” J. Biophotonics 9(8), 800–811 (2016). [CrossRef]  

3. C. D. Wilms, H. Schmidt, and J. Eilers, “Quantitative two-photon Ca2 + imaging via fluorescence lifetime analysis,” Cell Calcium 40(1), 73–79 (2006). [CrossRef]  

4. K. Žídek, F. Trojánek, P. Malý, L. Ondič, I. Pelant, K. Dohnalová, L. Šiller, R. Little, and B. R. Horrocks, “Femtosecond luminescence spectroscopy of core states in silicon nanocrystals,” Opt. Express 18(24), 25241–25249 (2010). [CrossRef]  

5. W. Becker, Advanced Time-Correlated Single Photon Counting Techniques, (Springer, Berlin, 2005).

6. J. Sytsma, J. M. Vroom, D. Grauw, and H. C. Gerritsen, “Time-gated fluorescence lifetime imaging and microvolume spectroscopy using two-photon excitation,” J. Microsc. 191(1), 39–51 (2008). [CrossRef]  

7. J. Qu, L. Liu, D. Chen, Z. Lin, G. Xu, B. Guo, and H. Niu, “Temporally and spectrally resolved sampling imaging with a specially designed streak camera,” Opt. Lett. 31(3), 368–370 (2006). [CrossRef]  

8. Y. Won, S. Moon, W. Yang, D. Kim, W.-T. Han, and D. Y. Kim, “High-speed confocal fluorescence lifetime imaging microscopy (FLIM) with the analog mean delay (AMD) method,” Opt. Express 19(4), 3396–3405 (2011). [CrossRef]  

9. E. Gratton, S. Breusegem, J. D. B. Sutin, Q. Ruan, and N. P. Barry, “Fluorescence lifetime imaging for the two-photon microscope: time-domain and frequency-domain methods,” J. Biomed. Opt 8(3), 381–390 (2003). [CrossRef]  

10. J. Junek, L. Ondič, and K. Žídek, “Random temporal laser speckles for the robust measurement of sub-microsecond photoluminescence decay,” Opt. Express 28(8), 12363–12372 (2020). [CrossRef]  

11. J. Junek and K. Žídek, “Fluorescence lifetime imaging via spatio-temporal speckle patterns in a single-pixel camera configuration,” Opt. Express 29(4), 5538–5551 (2021). [CrossRef]  

12. K. Zheng, K. Žídek, M. Abdellah, M. E. Messing, M. J. Al-Marri, and T. Pullerits, “Trap States and Their Dynamics in Organometal Halide Perovskite Nanoparticles and Bulk Crystals,” J. Phys. Chem. C 120(5), 3077–3084 (2016). [CrossRef]  

13. J. M. Griffin, A. J. Miller, A. J. Berry, S. Wimperis, and S. E. Ashbrook, “Dynamics on the microsecond timescale in hydrous silicates studied by solid-state 2H NMR spectroscopy,” Phys. Chem. Chem. Phys. 12(12), 2989–2998 (2010). [CrossRef]  

14. K. Dohnalová, L. Ondič, K. Kůsová, I. Pelant, J. L. Rehspringer, and R.-R. Mafouana, “White-emitting oxidized silicon nanocrystals: Discontinuity in spectral development with reducing size,” J. Appl. Phys. 107(5), 053102 (2010). [CrossRef]  

15. P. Pande and J. A. Jo, “Automated Analysis of Fluorescence Lifetime Imaging Microscopy (FLIM) Data Based on the Laguerre Deconvolution Method,” IEEE Trans. Biomed. Eng. 58(1), 172–181 (2011). [CrossRef]  

16. A. B. Watson, “Probability summation over time,” Vision Res. 19(5), 515–522 (1979). [CrossRef]  

17. T. Regińska, “A Regularization Parameter in Discrete Ill-Posed Problems,” SIAM J. Sci. Comput. 17(3), 740–749 (1996). [CrossRef]  

18. H. W. Engl, “On the choice of the regularization parameter for iterated Tikhonov regularization of III-posed problems,” J. Approximation Theory 49(1), 55–63 (1987). [CrossRef]  

19. V. Studer, J. Bobin, M. Chahid, H. S. Mousavi, E. Candes, and M. Dahan, “Compressive fluorescence microscopy for biological and hyperspectral imaging,” Proc. Natl. Acad. Sci. U. S. A. 109(26), E1679–E1687 (2012). [CrossRef]  

20. Q. Pian, R. Yao, N. Sinsuebphon, and X. Intes, “Compressive hyperspectral time-resolved wide-field fluorescence lifetime imaging,” Nat. Photonics 11(7), 411–414 (2017). [CrossRef]  

21. K. Žídek, O. Denk, and J. Hlubuček, “Lensless Photoluminescence Hyperspectral Camera Employing Random Speckle Patterns,” Sci. Rep. 7(1), 15309 (2017). [CrossRef]  

22. M. F. Duarte, M. A. Davenport, D. Takhar, J. N. Laska, T. Sun, K. F. Kelly, and R. G. Baraniuk, “Single-pixel imaging via compressive sampling,” IEEE Signal Process. Mag. 25(2), 83–91 (2008). [CrossRef]  

23. F. Gascón and F. Salazar, “A simple method to simulate diffraction and speckle patterns with a PC,” Optik 117(2), 49–57 (2006). [CrossRef]  

24. C. Li, Wotao Yin, and Yin Zhang, TVAL3 Home, Rice University, 2009, Last updated 11/07/2013, https://www.caam.rice.edu/~optimization/L1/TVAL3/.

25. C. Li, W. Yin, and Y. Zhang, “User's guide for TVAL3: TV minimization by augmented lagrangian and alternating direction algorithms,” CAAM Report20, 46–47 (2009).

26. A. N. Tikhonov and V. Y. Arsenin, “Solutions of ill-posed problems,” SIAM Rev. 21, 266–267 (1979). [CrossRef]  

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (13)

Fig. 1.
Fig. 1. (A) Scheme of 2D-RATS approach, where the sample is illuminated with a set of random patterns (masks) blinking according to IEXC. The total PL intensity waveform IPL is detected for each mask with a single-pixel detector. (B) Example of a set of calculated IDA's for corresponding masks – see Eq. (4). (C) Intensity fluctuation for each delay after excitation of IDA. Knowing the fluctuation (ISPC signal) and set of masks makes it possible to determine the PL map m at a given delay after excitation of IDA using compressed sensing algorithms. (D) An example of reconstructed PL maps in delays t1 and t2. Plotted ID’s corresponding to pixel [14 10] (area “a”) and to pixel [16 25] (area “b”).
Fig. 2.
Fig. 2. (A) Reconstructed ID with a noise level of 3% in IEXC, which corresponds with SNR about 15.2 dB. IPL was assumed noiseless. (B) Reconstructed ID with a noise level of 3% in IPL, corresponding with SNR about 15.2 dB. IEXC was assumed noiseless.
Fig. 3.
Fig. 3. Left part: reconstructions of PL map m in delay with maximal intensity (t = 0 µs) in case of noise in IEXC. Right part: reconstructions of PL map m in delay with maximal intensity (t = 0 µs) in case of noise in the IPL. The noise parameters are for both SNR = 15.2, 18.2, 20, 25 dB (rows) and the compression ratios are k = 0.4, 0.6, 0.8 (columns).
Fig. 4.
Fig. 4. Used excitation non-periodic signal (left panel) and periodic signal with 7 periods (right panel). Both signals were simulated based on simulations of randomly changing speckle patterns [23], which corresponds with excitation signals generated via generator (lens-rotary diffuser-aperture) presented in our previous work [10].
Fig. 5.
Fig. 5. Results of ID reconstruction (deconvolution), when non-periodic (panel A) and periodic (panel B) IEXC was used for sample excitation with lifetime Τ = 20 µs.
Fig. 6.
Fig. 6. Zoomed results of ID reconstruction (Τ = 20 µs.), when IEXC was used as a periodic signal (7 periods). Redline is reconstructed data, and the black line is reference data. (A) Reconstruction with an amount of noise of 3% in IEXC (correspond with SNR about 15.2 dB). (B) Reconstruction with an amount of noise of 3% in IPL (correspond with SNR about 15.2 dB).
Fig. 7.
Fig. 7. RMSE of ID for a periodical IEXC with a constant total acquisition time of tacq = 0.1 s. The number of periods in the IEXC signal is varied. IPL respective IEXC noise level: SNR 15.2 dB.
Fig. 8.
Fig. 8. Reconstruction error REXC (left part), RPL (right part) at the delay t = 0 µs dependence on sensing time for different SNR: 15.2 dB (red), 18.2 dB (blue), 20 dB (black), 23 dB (magenta) and three different compression ratio k = 0.4 (full line), k = 0.6 (circle), k = 0.8 (cross).
Fig. 9.
Fig. 9. Noise dependence in SPC signal (random fluctuation in intensity of ID in delay t = 0 µs, because of changing illumination masks) on sensing time according to added noise to IEXC (left part) and IPL (right part) with SNR: 15.2 dB (red), 18.2 dB (blue), 20 dB (black), 23 dB (magenta) and three different compression ratio k = 0.4 (full line), k = 0.6 (circle), k = 0.8 (cross).
Fig. 10.
Fig. 10. Acquisition time dependance of σEXC – noise added to IEXC (left part) and σPL – noise added to IPL (right part). SNR: 15.2 dB (red), 18.2 dB (blue), 20 dB (black), 23 dB (magenta) and three different compression ratio k = 0.4 (full line), k = 0.6 (circle), k = 0.8 (cross).
Fig. 11.
Fig. 11. Reconstruction error REXC (left part), RPL (right part) at the delay t = 0 µs dependence on ɛ - different SNR: 15.2 dB (red), 18.2 dB (blue), 20 dB (black), 23 dB (magenta) and three different compression ratio k = 0.4 (full line), k = 0.6 (circle), k = 0.8 (cross).
Fig. 12.
Fig. 12. Noise dependence in SPC signal (random fluctuation in intensity of ID in delay t = 0 µs, because of changing illumination masks) on ɛ according to added noise to IEXC (left part) and IPL (right part) with SNR: 15.2 dB (red), 18.2 dB (blue), 20 dB (black), 23 dB (magenta) and three different compression ratio k = 0.4 (full line), k = 0.6 (circle), k = 0.8 (cross).
Fig. 13.
Fig. 13. ɛ dependance of σEXC – noise added to IEXC (left part) and σPL – noise added to IPL (right part). SNR: 15.2 dB (red), 18.2 dB (blue), 20 dB (black), 23 dB (magenta) and three different compression ratio k = 0.4 (full line), k = 0.6 (circle), k = 0.8 (cross).

Tables (1)

Tables Icon

Table 1. Quality of the retrieved image (R, lower number = higher quality) and SPC signal (SPC-SNR, higher number = higher quality) corresponding to Fig. 3 for noise introduced via IEXC and IPL signal.

Equations (8)

Equations on this page are rendered with MathJax. Learn more.

I P L = I E X C I D .
I D = R e { F 1 [ F ( I P L ) F ( I E X C ) F ( I E X C ) F ( I E X C ) + ε F ( I E X C ) F ( I E X C ) ¯ ] } .
I P L = i = 1 n I P L ( i ) = I E X C i = 1 n I D ( i ) .
I D A = R e { F 1 [ F ( i = 1 n I P L ( i ) ) F ( I E x c ) F ( I E x c ) F ( I E x c ) + ε F ( I E x c ) F ( I E x c ) ¯ ] } .
m i n { | | A m ( t ) I S P C | | 2 2 + T V ( m ( t ) ) } .
S N R [ d B ] = 10 log 10 ( n o i s e [ % ] 100 ) .
R = | | m U | | F | | U | | F .
σ = 1 N i = 1 N t = t 0 t τ ( I D R E C ( i , t ) I D ( i , t ) ) 2 .
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.