|
|
| Line 1: |
Line 1: |
| {{ScaleSpaceNavbox}}
| | The author is recognized by [http://www.dailyroads.com/profile_info.php?ID=2363798 over the counter std test] title of Numbers Lint. To collect coins is what his family members and him appreciate. North Dakota is her beginning place but she will have to move one day or another. My working day job is a librarian. |
| | |
| {{context|date=August 2011}}
| |
| | |
| The '''linear [[scale space|scale-space representation]]''' of an ''N''-dimensional continuous signal, | |
| | |
| :<math>f_C \left (x_1, \cdots, x_N, t \right),</math>
| |
| | |
| is obtained by [[convolution|convolving]] ''f<sub>C</sub>'' with an ''N''-dimensional Gaussian kernel:
| |
| | |
| :<math>g_N \left (x_1, \cdots, x_N, t \right).</math>
| |
| | |
| In other words:
| |
| | |
| :<math>L \left (x_1, \cdots, x_N, t \right ) =\int_{u_1=-\infty}^{\infty} \cdots \int_{u_N=-\infty}^{\infty} f_C \left (x_1-u_1, \cdots, x_N-u_N, t \right ) \cdot g_N \left(u_1, \cdots, u_N, t \right) \, du_1 \cdots du_N.</math>
| |
| | |
| However, for '''implementation''', this definition is impractical, since it is continuous. When applying the scale space concept to a discrete signal ''f<sub>D</sub>'', different approaches can be taken. This article is a brief summary of some of the most frequently used methods.
| |
| | |
| ==Separability==
| |
| Using the ''separability property'' of the Gaussian kernel
| |
| | |
| :<math>g_N \left (x_1,\dots, x_N, t \right) = G\left(x_1, t \right) \cdots G\left(x_N, t\right) </math>
| |
| | |
| the ''N''-dimensional [[convolution]] operation can be decomposed into a set of separable smoothing steps with a one-dimensional Gaussian kernel ''G'' along each dimension
| |
| | |
| :<math>L(x_1, \cdots, x_N, t) = \int_{u_1=-\infty}^{\infty} \cdots \int_{u_N=-\infty}^{\infty} f_C(x_1-u_1, \cdots, x_N-u_N, t) G(u_1, t) \, du_1 \cdots G(u_N, t) \, du_N,</math>
| |
| | |
| where
| |
| | |
| :<math>G(x, t) = \frac {1}{\sqrt{2\pi t}} e^{-\frac{x^2}{2t}}</math>
| |
| | |
| and the standard deviation of the Gaussian σ is related to the scale parameter ''t'' according to ''t'' = σ<sup>2</sup>.
| |
| | |
| Separability will be assumed in all that follows, even when the kernel is not exactly Gaussian, since separation of the dimensions is the most practical way to implement multidimensional smoothing, especially at larger scales. Therefore, '''the rest of the article focuses on the one-dimensional case.'''
| |
| | |
| ==The sampled Gaussian kernel==
| |
| When implementing the one-dimensional smoothing step in practice, the presumably simplest approach is to convolve the discrete signal ''f<sub>D</sub>'' with a ''sampled Gaussian kernel'':
| |
| | |
| :<math>L(x, t) = \sum_{n=-\infty}^{\infty} f(x-n) \, G(n, t)</math>
| |
| | |
| where
| |
| | |
| :<math>G(n, t) = \frac {1}{\sqrt{2\pi t}} e^{-\frac{n^2}{2t}}</math>
| |
| | |
| (with ''t'' = σ<sup>2</sup>) which in turn is truncated at the ends to give a filter with finite impulse response
| |
| | |
| :<math>L(x, t) = \sum_{n=-M}^{M} f(x-n) \, G(n, t)</math>
| |
| | |
| for ''M'' chosen sufficiently large (see [[error function]]) such that
| |
| | |
| :<math>2 \int_M^{\infty} G(u, t) \, du = 2 \int_{\frac{M}{\sqrt{t}}}^{\infty} G(v, 1) \, dv < \varepsilon.</math>
| |
| | |
| A common choice is to set M to a constant C times the standard deviation of the Gaussian kernel
| |
| | |
| :<math>M = C \sigma + 1 = C \sqrt{t} + 1</math>
| |
| | |
| where ''C'' is often chosen somewhere between 3 and 6.
| |
| | |
| Using the sampled Gaussian kernel can, however, lead to implementation problems, in particular when computing higher-order derivatives at finer scales by applying sampled derivatives of Gaussian kernels. When accuracy and robustness are primary design criteria, alternative implementation approaches should therefore be considered.
| |
| | |
| For small values of ε (10<sup>−6</sup> to 10<sup>−8</sup>) the errors introduced by truncating the Gaussian are usually negligible. For larger values of ε, however, there are many better alternatives to a rectangular [[window function]]. For example, for a given number of points, a [[Hamming window]], [[Blackman window]], or [[Kaiser window]] will do less damage to the spectral and other properties of the Gaussian than a simple truncation will. Nonwithstanding this, since the Gaussian kernel decreases rapidly at the tails, the main recommendation is still to use a sufficiently small value of ε such that the truncation effects are no longer important.
| |
| | |
| ==The discrete Gaussian kernel==
| |
| [[Image:Discrete Gaussians.svg|right|thumb|300px|The ideal discrete Gaussian kernel (black x, dashed) compared with sampled ordinary Gaussian (red x, solid), for scales ''t'' = [0.5, 1, 2, 4]]]
| |
| | |
| A more refined approach is to convolve the original signal by the ''discrete Gaussian kernel'' ''T''(''n'', ''t'')<ref name="tpl90">[http://www.nada.kth.se/~tony/abstracts/Lin90-PAMI.html Lindeberg, T., "Scale-space for discrete signals," PAMI(12), No. 3, March 1990, pp. 234-254.]</ref><ref name=lin94>[http://www.csc.kth.se/~tony/book.html Lindeberg, T., Scale-Space Theory in Computer Vision, Kluwer Academic Publishers, 1994], ISBN 0-7923-9418-6 </ref><ref name="HaddadAkansu">R.A. Haddad and A.N. Akansu, "A Class of Fast Gaussian Binomial Filters for Speech and Image Processing," IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 39, pp 723-727, March 1991.</ref>
| |
| | |
| :<math>L(x, t) = \sum_{n=-\infty}^{\infty} f(x-n) \, T(n, t)</math>
| |
| | |
| where
| |
| | |
| :<math>T(n, t) = e^{-t} I_n(t)</math>
| |
| | |
| and <math>I_n(t)</math> denotes the [[modified Bessel function]]s of integer order, ''n''. This is the discrete counterpart of the continuous Gaussian in that it is the solution to the discrete [[diffusion equation]] (discrete space, continuous time), just as the continuous Gaussian is the solution to the continuous diffusion equation.<ref name="tpl90"/><ref name=lin94/><ref> Campbell, J, 2007, ''[http://dx.doi.org/10.1016/j.tpb.2007.08.001 The SMM model as a boundary value problem using the discrete diffusion equation]'', Theor Popul Biol. 2007 Dec;72(4):539-46.</ref>
| |
| | |
| This filter can be truncated in the spatial domain as for the sampled Gaussian
| |
| | |
| :<math>L(x, t) = \sum_{n=-M}^{M} f(x-n) \, T(n, t)</math>
| |
| | |
| or can be implemented in the Fourier domain using a closed-form expression for its [[discrete-time Fourier transform]]:
| |
| | |
| :<math>\widehat{T}(\theta, t) = \sum_{n=-\infty}^{\infty} T(n, t) \, e^{-i \theta n} = e^{t(\cos \theta - 1)}. </math>
| |
| | |
| With this frequency-domain approach, the scale-space properties transfer ''exactly'' to the discrete domain, or with excellent approximation using periodic extension and a suitably long [[discrete Fourier transform]] to approximate the [[discrete-time Fourier transform]] of the signal being smoothed. Moreover, higher-order derivative approximations can be computed in a straightforward manner (and preserving scale-space properties) by applying small support central difference operators to the discrete [[scale space representation]].<ref>[http://www.nada.kth.se/~tony/abstracts/Lin93-JMIV.html Lindeberg, T. Discrete derivative approximations with scale-space properties: A basis for low-level feature extraction, J. of Mathematical Imaging and Vision, 3(4), pp. 349--376, 1993.]</ref>
| |
| | |
| As with the sampled Gaussian, a plain truncation of the infinite impulse response will in most cases be a sufficient approximation for small values of ε, while for larger values of ε it is better to use either a decomposition of the discrete Gaussian into a cascade of generalized binomial filters or alternatively to construct a finite approximate kernel by multiplying by a [[window function]]. If ε has been chosen too large such that effects of the truncation error begin to appear (for example as spurious extrema or spurious responses to higher-order derivative operators), then the options are to decrease the value of ε such that a larger finite kernel is used, with cutoff where the support is very small, or to use a tapered window.
| |
| | |
| ==Recursive filters==
| |
| [[Image:ScaleSpaceKernels.png|frame|right|Scale-space kernels. Ideal discrete gaussian based on bessel functions (red), and two-pole-pair forward/backward recursive smoothing filters (blue) with poles as described in the text. Top shows individual kernels, and bottom is their cumulative convolution with each other; ''t'' = [0.5, 1, 2, 4].]]
| |
| | |
| Since computational efficiency is often important, low-order ''[[recursive filter]]s'' are often used for scale-space smoothing. For example, Young and van Vliet<ref name=young>{{cite journal | url = http://citeseer.ist.psu.edu/young95recursive.html | author = Ian T. Young and Lucas J. van Vliet | title = Recursive implementation of the Gaussian filter | journal = Signal Processing | volume = 44 | year = 1995 | pages = pp. 139–151 | publisher = Elsevier | doi = 10.1016/0165-1684(95)00020-E | issue = 2 }}</ref> use a third-order recursive filter with one real pole and a pair of complex poles, applied forward and backward to make a sixth-order symmetric approximation to the Gaussian with low computational complexity for any smoothing scale.
| |
| | |
| By relaxing a few of the axioms, Lindeberg<ref name="tpl90"/> concluded that good smoothing filters would be "normalized [[Pólya]] frequency sequences", a family of discrete kernels that includes all filters with real poles at 0 < ''Z'' < 1 and/or ''Z'' > 1, as well as with real zeros at ''Z'' < 0. For symmetry, which leads to approximate directional homogeneity, these filters must be further restricted to pairs of poles and zeros that lead to zero-phase filters.
| |
| | |
| To match the transfer function curvature at zero frequency of the discrete Gaussian, which ensures an approximate [[semi-group]] property of additive ''t'', two poles at
| |
| | |
| :<math>Z = 1 + \frac{2}{t} - \sqrt{\left (1 + \frac{2}{t} \right)^2 - 1}</math>
| |
| | |
| can be applied forward and backwards, for symmetry and stability. This filter is the simplest implementation of a normalized Pólya frequency sequence kernel that works for any smoothing scale, but it is not as excellent an approximation to the Gaussian as Young and van Vliet's filter, which is ''not'' normalized Pólya frequency sequence, due to its complex poles.
| |
| | |
| The transfer function, ''H''<sub>1</sub>, of a symmetric pole-pair recursive filter is closely related to the [[discrete-time Fourier transform]] of the discrete Gaussian kernel via first-order approximation of the exponential:
| |
| | |
| :<math>\widehat{T}(\theta, t) = \frac{1}{e^{t(1 - \cos \theta)}} \approx \frac{1}{{1 +t(1 - \cos \theta)}} = H_1(\theta, t),</math>
| |
| | |
| where the ''t'' parameter here is related to the stable pole position ''Z'' = ''p'' via:
| |
| | |
| :<math>t = \frac{2p}{(1-p)^2}.</math>
| |
| | |
| Furthermore, such filters with ''N'' pairs of poles, such as the two pole pairs illustrated in this section, are an even better approximation to the exponential:
| |
| | |
| :<math>\frac{1}{\left (1 +\frac{t}{N}(1 - \cos \theta)\right)^N} = H_N(\theta, t),</math>
| |
| | |
| where the stable pole positions are adjusted by solving:
| |
| | |
| :<math>\frac{t}{N} = \frac{2p}{(1-p)^2}.</math>
| |
| | |
| The impulse responses of these filters are not very close to gaussian unless more than two pole pairs are used. However, even with only one or two pole pairs per scale, a signal successively smoothed at increasing scales will be very close to a gaussian-smoothed signal. The semi-group property is poorly approximated when too few pole pairs are used.
| |
| | |
| [[Scale-space axioms]] that are still satisfied by these filters are:
| |
| | |
| *''linearity''
| |
| *''shift invariance'' (integer shifts)
| |
| *''non-creation of local extrema'' (zero-crossings) in one dimension
| |
| *''non-enhancement of local extrema'' in any number of dimensions
| |
| *''positivity''
| |
| *''normalization''
| |
| | |
| The following are only approximately satisfied, the approximation being better for larger numbers of pole pairs:
| |
| | |
| *existence of an ''infinitesimal generator'' ''A'' (the infinitesimal generator of the discrete Gaussian, or a filter approximating it, approximately maps a recursive filter response to one of infinitesimally larger ''t'')
| |
| *the ''semi-group structure'' with the associated ''cascade smoothing property'' (this property is approximated by considering kernels to be equivalent when they have the same ''t'' value, even if they are not quite equal)
| |
| *''rotational symmetry''
| |
| *''scale invariance''
| |
| | |
| This recursive filter method and variations to compute both the Gaussian smoothing as well as Gaussian derivatives has been described by several authors.<ref name=young/><ref>[http://citeseer.ist.psu.edu/deriche93recursively.html Deriche, R: Recursively implementing the Gaussian and its derivatives, INRIA Research Report 1893, 1993.]</ref><ref>[http://www.dicklyon.com/tech/Scans/ICASSP87_ScaleSpace-Lyon.pdf Richard F. Lyon. "Speech recognition in scale space," Proc. of 1987 ICASSP. San Diego, March, pp. 29.3.14, 1987.]</ref><ref>Jin, JS, Gao Y. "Recursive implementation of LoG Filtering". ''Real-Time Imaging'' 1997;3:59–65.</ref> Tan ''et al.'' have analyzed and compared some of these approaches, and have pointed out that the Young and van Vliet filters are a cascade (multiplication) of forward and backward filters, while the Deriche and the Jin ''et al.'' filters are sums of forward and backward filters.<ref>[http://www.pspc.dibe.unige.it/ecovision/pubs/papers/tan-dale-johnston.pdf .] {{cite journal | title = Performance of three recursive algorithms for fast space-variant Gaussian filtering | author = Sovira Tan, Jason L. Dale, and Alan Johnston | journal = Real-Time Imaging | volume = 9 | year = 2003 | pages = 215–228 | doi = 10.1016/S1077-2014(03)00040-8 | issue = 3 }}</ref>
| |
| | |
| At fine scales, the recursive filtering approach as well as other separable approaches are not guaranteed to give the best possible approximation to rotational symmetry, so non-separable implementations for 2D images may be considered as an alternative.
| |
| | |
| When computing several derivatives in the [[N-jet]] simultaneously, discrete scale-space smoothing with the discrete analogue of the Gaussian kernel, or with a recursive filter approximation, followed by small support difference operators, may be both faster and more accurate than computing recursive approximations of each derivative operator.
| |
| | |
| ==Finite-impulse-response (FIR) smoothers==
| |
| For small scales, a low-order FIR filter may be a better smoothing filter than a recursive filter. The symmetric 3-kernel <math>[t/2,\ 1-t,\ t/2]</math>, for <math>t \le 0.5</math> smooths to a scale of ''t'' using a pair of real zeros at ''Z'' < 0, and approaches the discrete Gaussian in the limit of small ''t''. In fact, with infinitesimal ''t'', either this two-zero filter or the two-pole filter with poles at ''Z'' = ''t''/2 and ''Z'' = 2/''t'' can be used as the infinitesimal generator for the discrete Gaussian kernels described above.
| |
| | |
| The FIR filter's zeros can be combined with the recursive filter's poles to make a general high-quality smoothing filter. For example, if the smoothing process is to always apply a biquadratic (two-pole, two-zero) filter forward then backwards on each row of data (and on each column in the 2D case), the poles and zeros can each do a part of the smoothing. The zeros limit out at ''t'' = 0.5 per pair (zeros at ''Z'' = –1), so for large scales the poles do most of the work. At finer scales, the combination makes an excellent approximation to the discrete Gaussian if the poles and zeros each do about half the smoothing. The ''t'' values for each portion of the smoothing (poles, zeros, forward and backward multiple applications, etc.) are additive, in accordance with the approximate semi-group property.
| |
| | |
| [[Image:Smoothing Filter Pole Zero Plot.svg|center|thumb|380px|''Z''-plane locations of four poles (X) and four zeros (circles) for a smoothing filter using forward/backward biquad to smooth to a scale ''t'' = 2, with half the smoothing from the poles and half from the zeros. The zeros are all at ''Z'' = –1; the poles are at ''Z'' = 0.172 and ''Z'' = 5.83. The poles outside the unit circle are implemented by filtering backwards with the stable poles.]]
| |
| | |
| The FIR filter transfer function is closely related to the discrete Gaussian's DTFT, just as was the recursive filter's. For a single pair of zeros, the transfer function is
| |
| | |
| :<math>\widehat{T}(\theta, t) = e^{-t(1 - \cos \theta)} \approx {1 -t(1 - \cos \theta)} = F_1(\theta, t),</math>
| |
| | |
| where the ''t'' parameter here is related to the zero positions ''Z'' = ''z'' via:
| |
| | |
| :<math>t = -\frac{2z}{(1-z)^2},</math>
| |
| | |
| and we require <math>t \le 0.5</math> to keep the transfer function non-negative.
| |
| | |
| Furthermore, such filters with ''N'' pairs of zeros, are an even better approximation to the exponential and extend to higher values of ''t'' :
| |
| | |
| :<math>\left(1 -\frac{t}{N}(1 - \cos \theta) \right)^N = F_N(\theta, t),</math>
| |
| | |
| where the stable zero positions are adjusted by solving:
| |
| | |
| :<math>\frac{t}{N} = -\frac{2z}{(1-z)^2}.</math>
| |
| | |
| These FIR and pole-zero filters are valid scale-space kernels, satisfying the same axioms as the all-pole recursive filters.
| |
| | |
| ==Real-time implementation within pyramids and discrete approximation of scale-normalized derivatives==
| |
| Regarding the topic of automatic scale selection based on normalized derivatives, [[pyramid (image processing)|pyramid approximations]] are frequently used to obtain real-time performance.<ref>{{cite journal | author = Lindeberg, Tony and Bretzner, Lars | year = 2003 | title = Real-time scale selection in hybrid multi-scale representations | journal = Proc. Scale-Space'03, Springer Lecture Notes in Computer Science
| |
| | volume = 2695 | pages = 148–163 | doi = 10.1007/3-540-44935-3_11 | isbn = 978-3-540-40368-5 | url = http://www.nada.kth.se/cvap/abstracts/cvap279.html | series = Lecture Notes in Computer Science }}</ref><ref>[http://www-prima.inrialpes.fr/Prima/Homepages/jlc/papers/Crowley-ScaleSpace03.pdf Crowley, J, Riff O: Fast computation of scale normalised Gaussian receptive fields, Proc. Scale-Space'03, Isle of Skye, Scotland, Springer Lecture Notes in Computer Science, volume 2695, 2003.]</ref><ref>[http://citeseer.ist.psu.edu/lowe04distinctive.html Lowe, D. G., “Distinctive image features from scale-invariant keypoints”, International Journal of Computer Vision, 60, 2, pp. 91-110, 2004.]</ref> The appropriateness of approximating scale-space operations within a pyramid originates from the fact that repeated cascade smoothing with generalized binomial kernels leads to equivalent smoothing kernels that under reasonable conditions approach the Gaussian. Furthermore, the binomial kernels (or more generally the class of generalized binomial kernels) can be shown to constitute the unique class of finite-support kernels that guarantee non-creation of local extrema or zero-crossings with increasing scale (see the article on [[multi-scale approaches]] for details). Special care may, however, need to be taken to avoid discretization artifacts.
| |
| | |
| ==Other multi-scale approaches==
| |
| For one-dimensional kernels, there is a well-developed theory of [[multi-scale approaches]], concerning filters that do not create new local extrema or new zero-crossings with increasing scales. For continuous signals, filters with real poles in the ''s''-plane are within this class, while for discrete signals the above-described recursive and FIR filters satisfy these criteria. Combined with the strict requirement of a continuous semi-group structure, the continuous Gaussian and the discrete Gaussian constitute the unique choice for continuous and discrete signals.
| |
| | |
| There are many other multi-scale signal processing, image processing and data compression techniques, using [[wavelets]] and a variety of other kernels, that do not exploit or require the [[scale-space axioms|same requirements]] as [[scale space]] descriptions do; that is, they do not depend on a coarser scale not generating a new extremum that was not present at a finer scale (in 1D) or non-enhancement of local extrema between adjacent scale levels (in any number of dimensions).
| |
| | |
| ==See also==
| |
| | |
| *[[scale space]]
| |
| *[[pyramid (image processing)]]
| |
| *[[multi-scale approaches]]
| |
| *[[Gaussian filter]]
| |
| | |
| ==References==
| |
| | |
| <references/>
| |
| | |
| [[Category:Image processing]]
| |
| [[Category:Computer vision]]
| |
| [[Category:Gaussian function]]
| |