## Abstract

we propose the oriented spatial filter masks for filtering in electronic speckle pattern interferometry (ESPI) phase fringe patterns. We establish the oriented derivative operator that only highlights noise without edges of an image. The noise in the image can be removed while still preserving the edges simply by subtracting the oriented derivative image from original image, which can be implemented with one pass of the oriented spatial filter mask. Further, we make an improvement on the oriented spatial filter mask for enhancing the smoothness. The performance of the oriented spatial filter masks is demonstrated via application to a simulated speckle phase fringe pattern and an experimentally obtained phase fringe pattern and comparison with other directional filtering methods.

©2010 Optical Society of America

## 1. Introduction

Electronic speckle pattern interferometry (ESPI) is a well-known, whole-field technique for measurement. Accurate extraction of phase value is of fundamental importance because it is related with a physical quantity. The phase-shifting technique is one of the most commonly used methods for phase extraction because of its high accuracy [1,2]. However, owing to speckle decorrelation effects, the resultant phase fringe patterns are strongly affected by noise. Moreover, the easily blurred high density regions in fringe patterns increase the difficulty of removing the noise while preserving the features [3]. In order to make the phase unwrapping process easier, the noise presented in wrapped phase patterns must somehow be dealt with.

Filtering methods along the fringe orientation have been demonstrated to be a powerful tool for filtering in ESPI fringe patterns, especially for patterns with high fringe density. In the past few years some works have been developed for directional filtering such as the contoured window filter [4] and our tangent fitting filter [5], in which the small filtering window is designed along the fringe orientation, pixel by pixel, and a filtering method is performed in this directional filtering window. Recently, some efforts have been made toward the directional filtering methods without having to laboriously establish the small filtering window along the fringe orientation. In our former works [6,7], we have proposed the second-order oriented partial differential equations (PDEs) filtering models and the oriented-couple PDE models respectively, which make the diffusion only along fringe orientation. In the oriented PDEs-based filtering methods, filtering along fringe orientation for the entire image is simply realized through solving the oriented PDEs numerically. However, when the oriented PDEs-based filtering methods are applied to the phase patterns that are seriously noisy, they usually require many iterations [7]. Furthermore, single-direction diffusion is not sufficient in the regions with low fringe density [3]. For solving this problem, Wang et al. [3] improved the second-order oriented PDEs filtering models, and proposed an application of coherence-enhancing diffusion to fringe-pattern denoising. It smoothed a fringe pattern along directions both parallel and perpendicular to fringe orientation with suitable diffusion speeds, and could give the better results in both high and low fringe density. However, for implementing the diffusion, the distance map is needed, which seem to be inconvenient. J. Villa et al. [8] used a different and powerful mathematical tool for directional filtering. They constructed the oriented, regularized quadratic-cost function. The minimization of this cost function is equivalent to smoothing the image only along the fringe’s tangent direction, which is easily implemented using iterative methods.

In this paper, we derive the new directional filtering method with better performance, based on the spatial masks. It is well-known that the spatial masks have been widely used in smoothing and sharpening of an image [9], and the processing based on spatial masks may be straightforward. Unfortunately, not all previous spatial filter masks take into account fringe orientation, and they cannot carry out filtering along fringe orientation. Inspired by image sharpening using the Laplace operator, we establish the oriented derivative operator that only highlights noise without edges of an image. The noise in the image can be removed while still preserving the edges simply by subtracting the oriented operator image from original image, which can be implemented with one pass of the mask (we name the oriented spatial filter mask). Further, we make an improvement on the oriented spatial filter mask for enhancing the smoothness in the regions with low fringe density. We test the proposed method on the simulated and experimentally obtained ESPI phase fringe pattern, respectively, and comparison with the oriented-couple PDE method and the oriented, regularized quadratic-cost function method. In all cases, our method can give desired results. In the following sections, we will first review image sharpening based on the Laplace operator briefly and then describe in detail the derivation of our oriented spatial filter masks. Section 3 contains experiments and discussion. Section 4 provides the summary for this paper.

## 2. The derivation of our oriented spatial filter masks

#### 2.1 A brief review of the Laplacian for sharpening

The principal objective of sharpening is to highlight fine details in an image or to enhance details that have been blurred. Sharpening can be accomplished by spatial differentiation [9]. The Laplacian is a simple, widely used isotropic derivative operator, which is implemented using the Laplace masks. Its use highlights gray-level discontinuities in an image and deemphasizes regions with slowly varying gray levels. Background features can be recovered while still preserving the sharpening effect of the Laplacian operation simply by adding the original and Laplacian image. There are several ways to define the Laplace masks. As noted, it is very important to keep in mind which mask is used. If the mask used has a negative center coefficient, then we subtract, rather than add, to the Laplacian image to obtain a sharpened result. Thus, the basic way in which the Laplacian is used for image enhancement is [9]:

Where*α*is a constant.

#### 2.2 The derivation of the oriented spatial filter mask

It is well-known that filtering and sharpening are two distinct problems. Therefore, it is logical to conclude that we should subtract Laplacian image from the original for filtering. If the mask used has a negative center coefficient, then we add, rather than subtract for filtering. Contrary to Eq. (1), the basic way in which the Laplacian is used for image filtering is:

However, as we can see that the Laplacian image for a noisy image includes both noise and image edges. Thus, the filtering method based on Eq. (2) will blur image edges seriously. For solving this problem, we propose a oriented derivative operator, which, for an image $f(x,y)$, is defined as:Where*ρ*is a length coordinate in the direction of the fringe or edge orientation. ${\partial}^{2}f/\partial {\rho}^{2}$ is the second order partial derivative of

*f*with respect to

*ρ*. It is obvious that the gray values of an image along the image edge have little change. Unlike the Laplacian, the oriented derivative at image edges still has small values. Therefore, the oriented derivative image for a noisy image mainly contains noise without edges. The noise in the image can be removed while still preserving the edges simply by substituting ${\nabla}_{\rho}^{2}f$ for ${\nabla}^{2}f$in Eq. (2). Thus, the basic way in which the oriented derivative is used for image filtering is:It is noted the parameter

*α*in Eqs. (1)-(4) have the opposite sign as center coefficient of Laplacian mask or oriented derivative mask.Since, the first order partial derivative of $f(x,y)$ with respect to

*ρ*is:

*ρ*at pixel $(x,y)$and the

*x*coordinate axis, which must be evaluated in advance. Here the spatial variables$(x,y)$ are omitted for simplicity.Hence, the oriented derivative can be expressed as:

In order to be useful for digital image processing, Eq. (6) needs to be expressed in discrete form. Here we use the following fourth-order finite differences, derived by standard collocated formulas [10],

Inserting Eq. (7) into Eq. (6), the discrete scheme of the oriented derivative ${\nabla}_{\rho}^{2}f$is obtained. Further, Eq. (4) can be expressed as:#### 2.3 The improvement of the oriented spatial filter mask

Using above oriented spatial filter mask, filtering can be made only along fringe orientation. As above-mentioned, the single-direction smoothing is not sufficient, and the level of smoothness may be low in the regions with low fringe density [3]. For improving the performance of the oriented spatial filter mask, we add a Gaussian filter ${F}_{G}(x,y)$to the right side of Eq. (4)

Where*β*is a positive constant. ${F}_{G}(x,y)$ can be expressed as

*M*and

*N*are sizes of image.

For implementing our filtering method, the orientation angle *θ* of each pixel has to be evaluated in advance. Recently, we proposed an approach for estimating orientation field of optical fringes with poor quality, which is based on the Fourier transform [11]. What follows is a brief synopsis of the method used in this study.

A window with its center point$(x,y)$is considered. Let$(k,l)$denote pixel position in the window. The orientation angle $\theta (x,y)$ of this point can be estimated by

## 3. Experiments and discussion

In this section, we test the improved, oriented spatial filter mask (IOSFM) on a simulated and a real ESPI phase image respectively, and compare with the oriented-couple PDE model (OCPDE) [7] and the oriented, regularized quadratic-cost function (ORQCF) [8]. As noted, applying directly a filter to original phase image often smears out the $2\pi $discontinuities. This problem can be solved by the sine/cosine filter method [7]. The sine and cosine of the wrapped phase image are firstly calculated, and then are filtered individually. The arctangent of the ratio of the filtered sine image to the filtered cosine image is the denoised phase image.

Figure 1(a)
is a simulated noisy ESPI phase pattern. Figures 1(b)-1(d) show the filtered images by ORQCF, OCPDE and IOSFM, respectively. For comparing, we take the same iterations in the three methods. We use 30 iterations in this case. Further, to quantitatively evaluate the performance, we calculate the image fidelity *f*, which is defined as $f=1-{\displaystyle \sum {\left({I}_{0}-I\right)}^{2}}/{\displaystyle \sum {I}_{0}{}^{2}},$ where ${I}_{0}$ and *I* are the noiseless wrapped phase image and the estimated, wrapped phase image, respectively. A high fidelity value will indicate that the processed image is very similar to the noiseless one. The value *f* in the respective figure (Figs. 1(b)–1(d)) is 0.8457, 0.8716, and **0.9048**. Figure 2
shows a real ESPI phase pattern and its filtered images obtained by the three methods with 80 iterations.

As we can see, the two original phase patterns are seriously noisy; especially for the real ESPI phase pattern, and the fringe density of the test images is variable. Obviously, our results are even better than the ones obtained with ORQCF and OCPDE. The consequence is accordant with the quantitative evaluation result. Moreover, our directional filter is easily implemented, in which the fringe orientation angle of each pixel is first estimated, and then the filtered image is obtained by applying Eq. (13).

Like OCPDE and ORQCF, there isn’t the explicit formula or a method to determine the parameters *α* and *β* in Eq. (10). They should be set according to the fringe density. Generally, the higher the fringe density is, the larger value *α* is and smaller value *β* is. According to our own experience in this method, the appropriate absolute value of *α*is somewhere between 0.25 and 0.36, and *β* is between 1/50 and 1/10.

## 4. Conclusion

We propose the oriented spatial filter masks for directional filtering of ESPI phase patterns. We test our IOSFM on a simulated and a real ESPI phase fringe pattern that contain variable fringe density, and heavy noise, and compare with the OCPDE and the ORQCF. Simulation and experimental results show that our IOSFM outperforms ORQCF and OCPDE.

This work is supported the by National Natural Science Foundation of China (NNSFC) (grant 60877001).We thank the anonymous reviewers for their constructive and helpful comments.

## References and links

**1. **S. Nakadate and H. Saito, “Fringe scanning speckle-pattern interferometry,” Appl. Opt. **24**(14), 2172–2180 (1985). [CrossRef] [PubMed]

**2. **K. Creath, “Phase-shifting speckle interferometry,” Appl. Opt. **24**(18), 3053–3058 (1985). [CrossRef] [PubMed]

**3. **H. Wang, Q. Kemao, W. Gao, F. Lin, and H. S. Seah, “Fringe pattern denoising using coherence-enhancing diffusion,” Opt. Lett. **34**(8), 1141–1143 (2009). [CrossRef] [PubMed]

**4. **Q. Yu, X. Sun, X. Liu, and Z. Qiu, “Spin filtering with curve windows for interferometric fringe patterns,” Appl. Opt. **41**(14), 2650–2654 (2002). [CrossRef] [PubMed]

**5. **C. Tang, W. Wang, H. Yan, and X. Gu, “Tangent least-squares fitting filtering method for electrical speckle pattern interferometry phase fringe patterns,” Appl. Opt. **46**(15), 2907–2913 (2007). [CrossRef] [PubMed]

**6. **C. Tang, L. Han, H. Ren, D. Zhou, Y. Chang, X. Wang, and X. Cui, “Second-order oriented partial-differential equations for denoising in electronic-speckle-pattern interferometry fringes,” Opt. Lett. **33**(19), 2179–2181 (2008). [CrossRef] [PubMed]

**7. **C. Tang, L. Han, H. Ren, T. Gao, Z. Wang, and K. Tang, “The oriented-couple partial differential equations for filtering in wrapped phase patterns,” Opt. Express **17**(7), 5606–5617 (2009). [CrossRef] [PubMed]

**8. **J. Villa, J. A. Quiroga, and I. De la Rosa, “Regularized quadratic cost function for oriented fringe-pattern filtering,” Opt. Lett. **34**(11), 1741–1743 (2009). [CrossRef] [PubMed]

**9. **R. C. Gonzalez, and R. E. Woods, *Digital image processing.2nd ed.* (Publishing House of Electronics Industry, Beijing, 2002).

**10. **N. A. Kampanis and J. A. Ekaterinaris, “A staggered grid, high-order accurate method for the incompressible Navier–Stokes equations,” J. Comput. Phys. **215**(2), 589–613 (2006). [CrossRef]

**11. **C. Tang, Z. Wang, L. Wang, J. Wu, T. Gao, and S. Yan, “Estimation of fringe orientation for optical fringe patterns with poor quality based on Fourier transform,” Appl. Opt. **49**(4), 554–561 (2010). [CrossRef] [PubMed]