Vector operators based on robust order statistics have proved successful in digital multichannel imaging applications, particularly color image filtering and enhancement, in dealing with impulsive noise while preserving edges and fine image details. These operators often have very high computational requirements which limits their use in time-critical applications. This paper introduces techniques to speed up vector filters using the minimax approximation theory. Extensive experiments on a large and diverse set of color images show that proposed approximations achieve an excellent balance among ease of implementation, accuracy, and computational speed.
Cost-Effective Implementation of Order-Statistics Based Vector Filters Using Minimax Approximations
M. Emre Celebi, Hassan A. Kingravi, Rastislav Lukac, and Fatih Celiker
Dept. of Computer Science, Louisiana State University, Shreveport, LA, USA
Dept. of Computer Science, Georgia Institute of Technology, Atlanta, GA, USA
Epson Edge, Epson Canada Ltd., Toronto, Ontario, Canada
Dept. of Mathematics, Wayne State University, Detroit, MI, USA
Corresponding author: email@example.com
OCIS codes: 100.2000,100.2980,100.3010
Image noise filtering - the process of estimating the original image information from noisy data - is a common preprocessing step in image processing and analysis applications, as the presence of noise in images not only lowers their perceptual quality, but also makes subsequent tasks such as edge detection and segmentation more difficult . With the recent shift from traditional grayscale imaging to color imaging, numerous filters have been proposed for removing noise from color images. An extensive overview of color image filtering solutions and their applications can be found in , with detailed performance analysis presented in .
An important class of filters for noise reduction in color images is the one based on robust vector order statistics [4, 5]. A typical natural image exhibits strong correlation between its red, green, and blue color channels; therefore, treating the pixels of the image as vectors avoids color shifts and artifacts in the output of the filter. Since images are nonstationary due to the presence of edges as well as noise and blur introduced during the image formation, vector filters usually operate on pixels inside a supporting window that slides over the image. Desired noise filtering characteristics can be obtained by using vectors with certain ranks in the ordered set of pixel values inside the supporting window, as an ordering operation performed according to a distance or similarity criterion distinguishes outliers from noise-free samples .
Many researchers have noted the high computational requirements of order-statistics based vector filters; however, relatively few studies [6, 7] have focused on alleviating this problem. Furthermore, the scope of these studies is limited to the vector median filter , which has been considered as the gold standard of performance in color image filtering due to its robustness and excellent impulsive noise suppression capability .
This paper introduces techniques to speed up popular vector filters which use vector ordering criteria other than the Euclidean distance. In particular, the filtering solutions from [10, 11, 12] involve, respectively, computationally expensive inverse cosine, exponential, and logarithmic functions that are evaluated during the filtering process typically millions of times. In order to allow the use such filters in time-critical imaging applications, we utilize the minimax approximation theory to substitute the abovementioned elementary functions with computationally efficient polynomials. Extensive experiments on a large and diverse image set show that the presented approximations achieve an excellent balance among ease of implementation, accuracy, and computational speed.
The rest of the paper is organized as follows. Section 2 gives background on minimax approximation theory. Section 3 introduces the use of the minimax approximation theory in speeding up order-statistics based vector filters. Motivation and design characteristics are discussed in detail. Section 4 describes the image set, noise models, filtering performance criteria, and the experimental setup. Finally, conclusions are given in Section 5.
2 Overview of Minimax Approximation Theory
Given a function , we would like to approximate it by another function so that the error () between them over a given interval is arbitrarily small. The existence of such approximations is stated by the following theorem:
(Weierstrass) Let be a continuous real-valued function defined on , i.e. . Then there exists a polynomial such that , i.e. .
This is commonly known as the minimax approximation to a function. It differs from other methods, e.g. least squares approximations, in that it minimizes the maximum error () rather than the average error:
A similar theorem establishes the existence of a rational variant of this method . Let be a natural number and let
be the set of all polynomials of degree less than or equal to . The set of irreducible rational functions, , is defined as
where and have no common factors. Then :
For each function , there exists at least one best rational approximation from the class .
This theorem states the existence of a rational approximation to a function that is optimal in the Chebyshev sense:
where denotes the distance between and with respect to some norm, in our case, the Chebyshev (maximum) norm. Regarding the choice between a polynomial and a rational approximant, it can be said that certain functions can be approximated more accurately by rationals than by polynomials. Jean-Michel Muller explains this phenomenon as follows “It seems quite difficult to predict if a given function will be much better approximated by rational functions than by polynomials. It makes sense to think that functions that have a behavior that is ’highly nonpolynomial’ (finite limits at , poles, infinite derivatives, ) will be poorly approximated by polynomials.” .
In this study the Remez Exchange Algorithm, an iterative method that uses Lagrangian interpolation to systematically minimize the maximum absolute difference between the given function and its polynomial approximation, was used to calculate the polynomials. The reader is referred to [13, 14] for more information on the minimax approximation theory and  for the implementation details of the Remez algorithm.
3 Proposed Implementations of Vector Filters
Consider an red-green-blue (RGB) input image X that represents a two-dimensional array of three-component vectors occupying the spatial location , with the row and column indices and , respectively. In the pixel , the values denote the red (), green (), and blue () components. In order to isolate small image regions, each of which can be treated as stationary, and reduce processing errors by operating in such a localized area of the input image, an supporting window centered on pixel is used. The window slides over the entire image X in a raster fashion and the procedure replaces the input vector with the output vector of a filter function that operates over the samples inside . Repeating the procedure for each pair , with and , produces the output vector of the filtered image Y. For notational simplicity, the input vectors inside are re-indexed as a set, i.e. (see Figure 1), as commonly seen in the related literature [2, 3]. In this notation, the center pixel in is given by and in the vector with components , the and indices denote the position of the vector inside the window and the color channel, respectively.
3.a Vector Directional Filters
The vector directional filter (VDF) family  operates on the direction of the input vectors with the aim of eliminating the vectors with atypical directions. This family utilizes the angle between the input vectors to order the vectors inside the supporting window. For example, the output of the basic vector directional filter (BVDF), the most well-known member of the VDF class, is the input vector inside the supporting window whose direction is the maximum likelihood estimate of the directions of the input vectors :
where denotes the angle between the two input vectors and and is the (Euclidean) norm. Note that in addition to BVDF, the angular function was used in the design of a number of other filters including the generalized VDF , directional distance filter , hybrid vector filters , weighted VDFs , data-adaptive VDFs , and switching VDFs .
The computational requirements of these filters can be reduced by speeding up the inverse cosine (ARCCOS) function, whose argument falls into the interval (see Figure 2). Unfortunately, approximating the ARCCOS function in this interval is not easy because of its behavior near . This can be circumvented using the following numerically more stable identity for :
where the inverse sine function (ARCSIN) receives its arguments from the interval (see Figure 3). Instead of plugging the value of into a minimax approximation for the ARCSIN function and then multiplying the result by , two multiplication operations can be avoided if the following function is approximated:
where the argument falls into the interval .
Table 1 lists the coefficients of the fourth degree minimax polynomials that approximate the ARCSIN and ARCCOS functions. Since both functions exhibit strong linearity in their respective intervals, they can be accurately approximated by polynomials, as indicated by the small error values listed in the table.
3.b Adaptive Multichannel Non-Parametric Filters
Adaptive Multichannel Non-Parametric Filters (AMNFs)  approach the filtering problem from an estimation theoretic perspective. Specifically, these filters employ non-parametric kernel density estimators to determine the pixels in the filtered image as follows:
where denotes the (City-Block) norm. Two possible choices for the kernel function are the multivariate exponential (AMNFE) and the multivariate gaussian (AMNFG) functions. The scaling factor in the kernel width calculation is set to the author recommended value of 0.33 . The computational requirements of (8) can be reduced by speeding up the kernel computation. Both kernels involve the exponential (EXP) function which can be accurately approximated by polynomials. Note that in addition to AMNFs, the EXP function was used in the design of a number of other filters including the fuzzy vector median filter , fuzzy vector median-rational hybrid filter , kernel vector median filter , fast adaptive noise reduction filter , and self-adaptive noise reduction filter .
The argument of the EXP function in (8) depends on the value, and the size and contents of a particular window. However, to obtain an accurate approximation, this argument needs to be constrained to a preferably small interval. Fortunately, for most practical purposes, we can set a cutoff point at ( 4.539993e-05) and return 0 for arguments outside the interval . Figure 4 shows a plot of the function in this interval.
Table 2 shows the coefficients of the minimax polynomials of various degrees. Here, and represent the degree of the polynomial and the error of minimax approximation, respectively. It can be seen that the error values are relatively high, and as the approximation degree is increased, the accuracy doesn’t improve significantly. This suggests that rational functions might be better suited for this approximation. Table 3 lists the coefficients of a minimax rational that approximates the EXP function with an error of 2.227050e-06.
3.c Entropy Vector Filters
Entropy vector median filter (EVMF) introduced in  adaptively switches between the identity operation and a noise filtering mode to improve signal-detail preserving characteristics of standard filters such as the vector median filter, which performs fixed amount of smoothing in all pixel locations. Noise filtering is performed only in pixel locations which are identified as noisy by a switching operator. This is realized by comparing an adaptive threshold expressed in the form of normalized entropy to a measure of normalized local contrast as follows:
where and denote the linear index of the center pixel (see Figure 1) and the mean vector inside , i.e. , respectively.
Note that within the so-called generalized entropy vector filter (EVF) class , new filters can be designed by replacing the Euclidean distance function in (9) with some other distance or similarity measure.
The computational requirements of EVFs can be reduced by speeding up the entropy (ENT) function, whose argument falls into the interval . Although, in theory, as the argument approaches , the function value approaches , in practice, this doesn’t hold as the value of the logarithm function approaches negative infinity. Therefore, as in the case of the EXP function, we set a cutoff point at and return for arguments less than . Figure 5 shows a plot of the function in the interval . It can be seen that this function is highly nonpolynomial , i.e. its derivatives are infinite at , and therefore using rational functions is more appropriate. Table 4 lists the coefficients of a minimax rational that approximates the ENT function with an error of 7.342477e-07.
4 Experimental Results
In order to evaluate the performance and robustness of the presented approximations, a set of 100 high quality RGB images was collected from the Internet. The set included images of people, animals, plants, buildings, aerial maps, man-made objects, natural scenery, paintings, sketches, as well as scientific, biomedical, synthetic, and test images commonly used in the color image processing literature.
The corruption in the test images was simulated using three noise models : uncorrelated impulsive noise model, correlated impulsive noise model, and mixed noise model (Gaussian Noise + Correlated Impulsive Noise):
where and represent the original and noisy color vectors, respectively, is a random vector that represents the impulsive noise, is the sample corruption probability, and , , and are the corruption probabilities for the red, green, and blue channels, respectively. In the experiments, the channel corruption probabilities were set to .
Filtering performance was evaluated by three effectiveness criteria :
Mean Absolute Error:
where, and denote respectively the original and filtered images in the RGB color space. MAE measures the detail preservation capability of a filter.
Mean Squared Error:
MSE measures the noise suppression capability of a filter.
Normalized Color Difference:
where, and denote the CIEL*a*b* coordinates  of the pixel in the original and filtered images, respectively. NCD measures the color preservation capability of a filter.
The efficiency of a filter was measured by execution time in seconds (Programming Language: C, Compiler: gcc 3.4.4, CPU: Intel Pentium D 2.66Ghz).
Table 5 shows the performance statistics for the three noise models. The test images were first corrupted using one of the noise models and then filtered using the exact and approximate versions of each filter. In the ’Mean’ column, negative values and positive values for the MAE, MSE, and NCD indicate the percentage of filtering quality degradation and improvement, respectively. For example, for 10% correlated impulsive noise, with respect to the MAE criterion, the approximate version of BVDF performs on the average 0.926% worse than the exact version, whereas with respect to the MSE criterion, the former performs 0.171% better than the latter. On the other hand, for the execution time criterion, positive values indicate reduction in filtering time due to the use of the presented approximations. For example, the approximate version of BVDF is on the average 1371% (or 13.71 times) faster than the exact version.
|Uncorrelated Impulsive||Correlated Impulsive||Mixed|
It can be seen that in most cases the exact filters slightly outperform their respective approximate versions. This was expected since the approximate filters necessarily involve small amounts of computational error. Nevertheless, the difference between the approximate and exact versions for each filter is negligible for most practical purposes, which demonstrates the accuracy of the presented approximations. In addition, the low standard deviation values indicate the robustness of the approximations.
The discrepancies in the speed up factors for the three filters can be attributed to the relative computational cost of the elementary functions involved. In other words, the speed up in BVDF is much greater than the other two filters because the ARCCOS function is computationally much more expensive than the EXP and ENT functions.
Since the filters presented in Section 3 are primarily intended for the removal of impulsive noise, we conducted further experiments with the most commonly used impulsive noise model [2, 3], i.e. the correlated impulsive noise model . Table 6 shows the performance statistics at 20%, 30%, and 40% noise levels. It can be seen that the performance of the approximate filters does not change significantly as the noise level is increased.
Figure 6 compares the exact and approximate versions of each filter on the Lenna image. It can be seen that the presented approximations achieve substantial computational savings without introducing any perceivable artifacts on the filtering results. In addition, the MAE and MSE values indicate that the filtering effectiveness of the exact and approximate filters are virtually the same.
In this article, we proposed a novel approach to speed up popular vector filters using minimax approximations. Advantages of this approach include ease of implementation, extremely good accuracy, and high computational speed. The presented approach can be adapted to other noise removal filters that involve computationally expensive mathematical functions. Finally, the given approximations have applications that go beyond color image filtering including computer graphics and computational geometry.
This publication was made possible by a grant from The Louisiana Board of Regents (LEQSF2008-11-RD-A-12).
-  K.N. Plataniotis and A.N. Venetsanopoulos, Color Image Processing and Applications (Springer, 2000).
-  R. Lukac and K.N. Plataniotis, “A Taxonomy of Color Image Filtering and Enhancement Solutions,” in Advances in Imaging & Electron Physics (Vol. 140), P.W. Hawkes, ed. (Academic Press, 2006), pp. 187–264.
-  M.E. Celebi, H.A. Kingravi, and Y.A. Aslandogan, “Nonlinear Vector Filtering for Impulsive Noise Removal from Color Images,” Journal of Electronic Imaging 16(3), 033008 (2007).
-  R. Lukac, B. Smolka, K. Martin, K.N. Plataniotis, and Venetsanopoulos A.N., “Vector Filtering for Color Imaging,” IEEE Signal Processing Magazine 22(1), 74–86 (2005).
-  M.E. Celebi and Y.A. Aslandogan, “Robust Switching Vector Median Filter for Impulsive Noise Removal,” Journal of Electronic Imaging 17(4), 043006 (2008).
-  M. Barni, “A Fast Algorithm for 1-Norm Vector Median Filtering,” IEEE Trans. on Image Processing 6(10), 1452–1455 (1997).
-  M. Barni, F. Buti, F. Bartolini, and V. Cappellini, “A Quasi-Euclidean Norm to Speed up Vector Median Filtering,” IEEE Trans. on Image Processing 9(10), 1704–1709 (2000).
-  J. Astola, P. Haavisto, and Y. Neuvo, “Vector Median Filters,” Proc. of the IEEE 78(4), 678–689 (1990).
-  M.E. Celebi, H.A. Kingravi, B. Uddin, and Y.A. Aslandogan, “Fast Switching Filter for Impulsive Noise Removal from Color Images,” Journal of Imaging Science and Technology 51(2): 155–165 (2007).
-  P.E. Trahanias and A.N. Venetsanopoulos, “Vector Directional Filters: A New Class of Multichannel Image Processing Filters,” IEEE Trans. on Image Processing 2(4), 528–534 (1993).
-  K.N. Plataniotis, D. Androutsos, S. Vinayagamoorthy, and A.N. Venetsanopoulos, “Color Image Processing Using Adaptive Multichannel Filters,” IEEE Trans. on Image Processing 6(7), 933–949 (1997).
-  R. Lukac, B. Smolka, K.N. Plataniotis, and A.N. Venetsanopoulos, “Entropy Vector Median Filter,” in Proc. of the IbPRIA Conf., Lecture Notes in Computer Science 2652, pp. 1117–1125 (2003).
-  E.W. Cheney, Introduction to Approximation Theory (AMS, 2000).
-  J.-M. Muller, Elementary Functions: Algorithms and Implementation (Birkhäuser, 2006).
-  W. Fraser, “A Survey of Methods of Computing Minimax and Near-Minimax Polynomial Approximations for Functions of a Single Independent Variable,” Journal of the ACM 12(3), 295–314 (1965).
-  N. Nikolaidis and I. Pitas, “Nonlinear Processing and Analysis of Angular Signals,” IEEE Trans. on Signal Processing, 46(12), 3181–3194 (1998).
-  P.E. Trahanias, D. Karakos, and A.N. Venetsanopoulos, ”Directional Processing of Color Images: Theory and Experimental Results,” IEEE Trans. on Image Processing 5(6), 868–880 (1996).
-  D.G. Karakos and P.E. Trahanias, “Generalized Multichannel Image Filtering Structures,” IEEE Trans. Image Processing 6(7), 1038-1045 (1997).
-  L. Khriji and M. Gabbouj, “Adaptive Fuzzy Order Statistics-Rational Hybrid Filters for Color Image Processing,” Fuzzy Sets and Systems 128(1), 35–46 (2002).
-  R. Lukac, “Adaptive Color Image Filtering Based on Center-Weighted Vector Directional Filters,” Multidimensional Systems and Signal Processing 15(2), 169–196 (2004).
-  K.N. Plataniotis, D. Androutsos, and A.N. Venetsanopoulos, “Color Image Processing Using Adaptive Vector Directional Filters,” IEEE Trans. on Circuits and Systems-II 45(10), 1414–1419 (1998).
-  R. Lukac, B. Smolka, K.N. Plataniotis, and A.N. Venetsanopoulos, “Vector Sigma Filters for Noise Detection and Removal in Color Images,” Journal of Visual Communication and Image Representation 17(1), 1–26 (2006).
-  K.N. Plataniotis, D. Androutsos, and A.N. Venetsanopoulos, “Adaptive Fuzzy Systems for Multichannel Signal Processing,” Proceedings of the IEEE 87(9), 1601–1622 (1999).
-  B. Smolka, K.N. Plataniotis, R. Lukac, and A.N. Venetsanopoulos, “Kernel Density Estimation Based Impulsive Noise Reduction Filter,” in Proc. of the IEEE Int. Conf. on Image Processing (ICIP’03) 2, pp. 137–140 (2003).
-  B. Smolka, R. Lukac, A. Chydzinski, K.N. Plataniotis, and K. Wojciechowski, “Fast Adaptive Similarity Based Impulsive Noise Reduction Filter,” Real-Time Imaging 9(4), 261–276 (2003).
-  B. Smolka, K.N. Plataniotis, A. Chydzinski, M. Szczepanski, A.N. Venetsanopoulos , K. Wojciechowski, “Self-Adaptive Algorithm of Impulsive Noise Reduction in Color Images,” Pattern Recognition 35(8), 1771–1784 (2002).
-  R. Lukac, B. Smolka, K.N. Plataniotis, and A.N. Venetsanopoulos, “Generalized Entropy Vector Filters,” in Proc. of the 4th EURASIP EC-VIP-MC, Video, Image Processing and Multimedia Communications Conf., pp. 239–244 (2003).
-  T. Viero, K. Oistamo, and Y. Neuvo, “Three-Dimensional Median-Related Filters for Color Image Sequence Filtering,” IEEE Trans. on Circuits and Systems for Video Technology 4(2), 129–142 (1994).