Electromagnetic shielding: Difference between revisions
en>Ovidcaput →How electromagnetic shielding works: diction, precision |
en>Glrx Undid revision 591246097 by 115.185.59.50 (talk) advert |
||
Line 1: | Line 1: | ||
{{other uses | Estimation (disambiguation)}} | |||
'''Estimation theory''' is a branch of [[statistics]] that deals with estimating the values of parameters based on measured/empirical data that has a random component. The parameters describe an underlying physical setting in such a way that their value affects the distribution of the measured data. An [[estimator]] attempts to approximate the unknown parameters using the measurements. | |||
For example, it is desired to estimate the proportion of a population of voters who will vote for a particular candidate. That proportion is the parameter sought; the estimate is based on a small random sample of voters. | |||
< | Or, for example, in [[radar]] the goal is to estimate the range of objects (airplanes, boats, etc.) by analyzing the two-way transit timing of received echoes of transmitted pulses. Since the reflected pulses are unavoidably embedded in electrical noise, their measured values are randomly distributed, so that the transit time must be estimated. | ||
In estimation theory, two approaches are generally considered. | |||
<ref> | |||
{{cite book|last1=Walter|first1=E.|last2=Pronzato|first2=L.| | |||
title=Identification of Parametric Models from Experimental Data| | |||
year=1997|publisher=Springer-Verlag|location=London, UK}} | |||
</ref> | |||
* The probabilistic approach (described in this article) assumes that the measured data is random with [[probability distribution]] dependent on the parameters of interest | |||
* The [[set estimation|set-membership approach]] assumes that the measured data vector belongs to a set which depends on the parameter vector. | |||
For example, in electrical communication theory, the measurements which contain information regarding the parameters of interest are often associated with a [[noise (physics)|noisy]] [[signal (electrical engineering)|signal]]. Without randomness, or noise, the problem would be [[determinism|deterministic]] and estimation would not be needed. | |||
== Estimation process == | |||
The entire purpose of estimation theory is to arrive at an estimator — preferably an easily implementable one. The estimator takes the measured data as input and produces an estimate of the parameters with the | |||
corresponding accuracy. | |||
It is also preferable to derive an estimator that exhibits [[optimization (mathematics)|optimality]]. Estimator optimality usually refers to achieving minimum average error over some class of estimators, for example, a minimum [[variance]] unbiased estimator. In this case, the class is the set of unbiased estimators, and the average error measure is [[variance]] (average squared error between the value of the estimate and the parameter). However, optimal estimators do not always exist. | |||
These are the general steps to arrive at an estimator: | |||
* In order to arrive at a desired estimator, it is first necessary to determine a [[probability distribution]] for the measured data, and the distribution's dependence on the unknown parameters of interest. Often, the [[probability distribution]] may be derived from physical models that explicitly show how the measured data depends on the parameters to be estimated, and how the data is corrupted by random errors or noise. In other cases, the [[probability distribution]] for the measured data is simply "assumed", for example, based on familiarity with the measured data and/or for analytical convenience. | |||
* After deciding upon a probabilistic model, it is helpful to find the theoretically achievable (optimal) precision available to any estimator based on this model. The [[Cramér–Rao bound]] is useful for this. | |||
* Next, an estimator needs to be developed, or applied (if an already known estimator is valid for the model). There are a variety of methods for developing estimators; [[maximum likelihood]] estimators are often the default although they may be hard to compute or even fail to exist. If possible, the theoretical performance of the estimator should be derived and compared with the optimal performance found in the last step. | |||
* Finally, experiments or simulations can be run using the estimator to test its performance. | |||
After arriving at an estimator, real data might show that the model used to derive the estimator is incorrect, which may require repeating these steps to find a new estimator. | |||
A non-implementable or infeasible estimator may need to be scrapped and the process started anew. | |||
Estimation theory can be applied to both [[linear]] and [[nonlinear]] models and is closely related to [[system identification]] and [[nonlinear system identification]].<ref name="SAB1">Billings S.A. "Nonlinear System Identification: NARMAX Methods in the Time, Frequency, and Spatio-Temporal Domains". Wiley, 2013</ref> | |||
In summary, the estimator estimates the parameters of a physical model based on measured data. | |||
== Basics == | |||
To build a model, several statistical "ingredients" need to be known. | |||
These are needed to ensure the estimator has some mathematical tractability instead of being based on "good feel". | |||
The first is a set of [[statistical sample]]s taken from a [[random vector]] (RV) of size ''N''. Put into a [[vector (geometric)|vector]], | |||
: <math>\mathbf{x} = \begin{bmatrix} x[0] \\ x[1] \\ \vdots \\ x[N-1] \end{bmatrix}.</math> | |||
Secondly, there are the corresponding ''M'' parameters | |||
: <math>\mathbf{\theta} = \begin{bmatrix} \theta_1 \\ \theta_2 \\ \vdots \\ \theta_M \end{bmatrix},</math> | |||
which need to be established with their continuous [[probability density function]] (pdf) or its discrete counterpart, the [[probability mass function]] (pmf) | |||
: <math>p(\mathbf{x} | \mathbf{\theta}).\,</math> | |||
It is also possible for the parameters themselves to have a probability distribution (e.g., [[Bayesian statistics]]). It is then necessary to define the [[Bayesian probability]] | |||
: <math>\pi( \mathbf{\theta}).\,</math> | |||
After the model is formed, the goal is to estimate the parameters, commonly denoted <math>\hat{\mathbf{\theta}}</math>, where the "hat" indicates the estimate. | |||
One common estimator is the [[minimum mean squared error]] estimator, which utilizes the error between the estimated parameters and the actual value of the parameters | |||
: <math>\mathbf{e} = \hat{\mathbf{\theta}} - \mathbf{\theta}</math> | |||
as the basis for optimality. This error term is then squared and minimized for the MMSE estimator. | |||
==Estimators== | |||
Commonly used estimators and estimation methods, and topics related to them: | |||
*[[Maximum likelihood]] estimators | |||
*[[Bayes estimator]]s | |||
*[[method of moments (statistics)|Method of moments]] estimators | |||
*[[Cramér–Rao bound]] | |||
*[[Minimum mean squared error]] (MMSE), also known as Bayes least squared error (BLSE) | |||
*[[Maximum a posteriori]] (MAP) | |||
*[[Minimum variance unbiased estimator]] (MVUE) | |||
*[[nonlinear system identification]] | |||
*[[Best linear unbiased estimator]] (BLUE) | |||
*Unbiased estimators — see [[estimator bias]]. | |||
*[[Particle filter]] | |||
*[[Markov chain Monte Carlo]] (MCMC) | |||
*[[Kalman filter]], and its various derivatives | |||
*[[Wiener filter]] | |||
==Examples== | |||
===Unknown constant in additive white Gaussian noise=== | |||
Consider a received [[discrete signal]], <math>x[n]</math>, of <math>N</math> [[statistical independence|independent]] [[statistical sample|samples]] that consists of an unknown constant <math>A</math> with [[additive white Gaussian noise]] (AWGN) <math>w[n]</math> with known [[variance]] <math>\sigma^2</math> (''i.e.'', <math>\mathcal{N}(0, \sigma^2)</math>). | |||
Since the variance is known then the only unknown parameter is <math>A</math>. | |||
The model for the signal is then | |||
: <math>x[n] = A + w[n] \quad n=0, 1, \dots, N-1</math> | |||
Two possible (of many) estimators are: | |||
* <math>\hat{A}_1 = x[0]</math> | |||
* <math>\hat{A}_2 = \frac{1}{N} \sum_{n=0}^{N-1} x[n]</math> which is the [[sample mean]] | |||
Both of these estimators have a [[mean]] of <math>A</math>, which can be shown through taking the [[expected value]] of each estimator | |||
:<math>\mathrm{E}\left[\hat{A}_1\right] = \mathrm{E}\left[ x[0] \right] = A</math> | |||
and | |||
:<math> | |||
\mathrm{E}\left[ \hat{A}_2 \right] | |||
= | |||
\mathrm{E}\left[ \frac{1}{N} \sum_{n=0}^{N-1} x[n] \right] | |||
= | |||
\frac{1}{N} \left[ \sum_{n=0}^{N-1} \mathrm{E}\left[ x[n] \right] \right] | |||
= | |||
\frac{1}{N} \left[ N A \right] | |||
= | |||
A | |||
</math> | |||
At this point, these two estimators would appear to perform the same. | |||
However, the difference between them becomes apparent when comparing the variances. | |||
:<math>\mathrm{var} \left( \hat{A}_1 \right) = \mathrm{var} \left( x[0] \right) = \sigma^2</math> | |||
and | |||
:<math> | |||
\mathrm{var} \left( \hat{A}_2 \right) | |||
= | |||
\mathrm{var} \left( \frac{1}{N} \sum_{n=0}^{N-1} x[n] \right) | |||
\overset{independence}{=} | |||
\frac{1}{N^2} \left[ \sum_{n=0}^{N-1} \mathrm{var} (x[n]) \right] | |||
= | |||
\frac{1}{N^2} \left[ N \sigma^2 \right] | |||
= | |||
\frac{\sigma^2}{N} | |||
</math> | |||
It would seem that the sample mean is a better estimator since its variance is lower for every N>1. | |||
====Maximum likelihood==== | |||
{{main|Maximum likelihood}} | |||
Continuing the example using the [[maximum likelihood]] estimator, the [[probability density function]] (pdf) of the noise for one sample <math>w[n]</math> is | |||
:<math>p(w[n]) = \frac{1}{\sigma \sqrt{2 \pi}} \exp\left(- \frac{1}{2 \sigma^2} w[n]^2 \right)</math> | |||
and the probability of <math>x[n]</math> becomes (<math>x[n]</math> can be thought of a <math>\mathcal{N}(A, \sigma^2)</math>) | |||
:<math>p(x[n]; A) = \frac{1}{\sigma \sqrt{2 \pi}} \exp\left(- \frac{1}{2 \sigma^2} (x[n] - A)^2 \right)</math> | |||
By independence, the probability of <math>\mathbf{x}</math> becomes | |||
:<math> | |||
p(\mathbf{x}; A) | |||
= | |||
\prod_{n=0}^{N-1} p(x[n]; A) | |||
= | |||
\frac{1}{\left(\sigma \sqrt{2\pi}\right)^N} | |||
\exp\left(- \frac{1}{2 \sigma^2} \sum_{n=0}^{N-1}(x[n] - A)^2 \right) | |||
</math> | |||
Taking the [[natural logarithm]] of the pdf | |||
:<math> | |||
\ln p(\mathbf{x}; A) | |||
= | |||
-N \ln \left(\sigma \sqrt{2\pi}\right) | |||
- \frac{1}{2 \sigma^2} \sum_{n=0}^{N-1}(x[n] - A)^2 | |||
</math> | |||
and the maximum likelihood estimator is | |||
:<math>\hat{A} = \arg \max \ln p(\mathbf{x}; A)</math> | |||
Taking the first [[derivative]] of the log-likelihood function | |||
:<math> | |||
\frac{\partial}{\partial A} \ln p(\mathbf{x}; A) | |||
= | |||
\frac{1}{\sigma^2} \left[ \sum_{n=0}^{N-1}(x[n] - A) \right] | |||
= | |||
\frac{1}{\sigma^2} \left[ \sum_{n=0}^{N-1}x[n] - N A \right] | |||
</math> | |||
and setting it to zero | |||
:<math> | |||
0 | |||
= | |||
\frac{1}{\sigma^2} \left[ \sum_{n=0}^{N-1}x[n] - N A \right] | |||
= | |||
\sum_{n=0}^{N-1}x[n] - N A | |||
</math> | |||
This results in the maximum likelihood estimator | |||
:<math> | |||
\hat{A} = \frac{1}{N} \sum_{n=0}^{N-1}x[n] | |||
</math> | |||
which is simply the sample mean. | |||
From this example, it was found that the sample mean is the maximum likelihood estimator for <math>N</math> samples of a fixed, unknown parameter corrupted by AWGN. | |||
====Cramér–Rao lower bound==== | |||
{{details|Cramér–Rao bound}} | |||
To find the [[Cramér–Rao lower bound]] (CRLB) of the sample mean estimator, it is first necessary to find the [[Fisher information]] number | |||
:<math> | |||
\mathcal{I}(A) | |||
= | |||
\mathrm{E} | |||
\left( | |||
\left[ | |||
\frac{\partial}{\partial A} \ln p(\mathbf{x}; A) | |||
\right]^2 | |||
\right) | |||
= | |||
-\mathrm{E} | |||
\left[ | |||
\frac{\partial^2}{\partial A^2} \ln p(\mathbf{x}; A) | |||
\right] | |||
</math> | |||
and copying from above | |||
:<math> | |||
\frac{\partial}{\partial A} \ln p(\mathbf{x}; A) | |||
= | |||
\frac{1}{\sigma^2} \left[ \sum_{n=0}^{N-1}x[n] - N A \right] | |||
</math> | |||
Taking the second derivative | |||
:<math> | |||
\frac{\partial^2}{\partial A^2} \ln p(\mathbf{x}; A) | |||
= | |||
\frac{1}{\sigma^2} (- N) | |||
= | |||
\frac{-N}{\sigma^2} | |||
</math> | |||
and finding the negative expected value is trivial since it is now a deterministic constant | |||
<math> | |||
-\mathrm{E} | |||
\left[ | |||
\frac{\partial^2}{\partial A^2} \ln p(\mathbf{x}; A) | |||
\right] | |||
= | |||
\frac{N}{\sigma^2} | |||
</math> | |||
Finally, putting the Fisher information into | |||
:<math> | |||
\mathrm{var}\left( \hat{A} \right) | |||
\geq | |||
\frac{1}{\mathcal{I}} | |||
</math> | |||
results in | |||
:<math> | |||
\mathrm{var}\left( \hat{A} \right) | |||
\geq | |||
\frac{\sigma^2}{N} | |||
</math> | |||
Comparing this to the variance of the sample mean (determined previously) shows that the sample mean is ''equal to'' the Cramér–Rao lower bound for all values of <math>N</math> and <math>A</math>. | |||
In other words, the sample mean is the (necessarily unique) [[efficient estimator]], and thus also the [[minimum variance unbiased estimator]] (MVUE), in addition to being the [[maximum likelihood]] estimator. | |||
===Maximum of a uniform distribution=== | |||
{{main|German tank problem}} | |||
One of the simplest non-trivial examples of estimation is the estimation of the maximum of a uniform distribution. It is used as a hands-on classroom exercise and to illustrate basic principles of estimation theory. Further, in the case of estimation based on a single sample, it demonstrates philosophical issues and possible misunderstandings in the use of [[maximum likelihood]] estimators and [[likelihood functions]]. | |||
Given a [[discrete uniform distribution]] <math>1,2,\dots,N</math> with unknown maximum, the [[UMVU]] estimator for the maximum is given by | |||
:<math>\frac{k+1}{k} m - 1 = m + \frac{m}{k} - 1</math> | |||
where ''m'' is the [[sample maximum]] and ''k'' is the [[sample size]], sampling without replacement.<ref name="Johnson">{{citation | |||
|last=Johnson | |||
|first=Roger | |||
|title=Estimating the Size of a Population | |||
|year=1994 | |||
|journal=[http://www.rsscse.org.uk/ts/index.htm Teaching Statistics] | |||
|volume=16 | |||
|issue=2 (Summer) | |||
|doi=10.1111/j.1467-9639.1994.tb00688.x | |||
|pages=50 | |||
}}</ref><ref name="Johnson2">{{citation | |||
|last=Johnson | |||
|first=Roger | |||
|contribution=Estimating the Size of a Population | |||
|title=Getting the Best from Teaching Statistics | |||
|year=2006 | |||
|url=http://www.rsscse.org.uk/ts/gtb/contents.html | |||
|contribution-url=http://www.rsscse.org.uk/ts/gtb/johnson.pdf | |||
}}</ref> This problem is commonly known as the [[German tank problem]], due to application of maximum estimation to estimates of German tank production during [[World War II]]. | |||
The formula may be understood intuitively as: | |||
:"The sample maximum plus the average gap between observations in the sample", | |||
the gap being added to compensate for the negative bias of the sample maximum as an estimator for the population maximum.<ref group="note">The sample maximum is never more than the population maximum, but can be less, hence it is a [[biased estimator]]: it will tend to ''underestimate'' the population maximum.</ref> | |||
This has a variance of<ref name="Johnson"/> | |||
:<math>\frac{1}{k}\frac{(N-k)(N+1)}{(k+2)} \approx \frac{N^2}{k^2} \text{ for small samples } k \ll N</math> | |||
so a standard deviation of approximately <math>N/k</math>, the (population) average size of a gap between samples; compare <math>\frac{m}{k}</math> above. This can be seen as a very simple case of [[maximum spacing estimation]]. | |||
The sample maximum is the [[maximum likelihood]] estimator for the population maximum, but, as discussed above, it is biased. | |||
== Applications == | |||
Numerous fields require the use of estimation theory. | |||
Some of these fields include (but are by no means limited to): | |||
* Interpretation of scientific [[experiment]]s | |||
* [[Signal processing]] | |||
* [[Clinical trial]]s | |||
* [[Opinion poll]]s | |||
* [[Quality control]] | |||
* [[Telecommunication]]s | |||
* [[Project management]] | |||
* [[Software engineering]] | |||
* [[Control theory]] (in particular [[Adaptive control]]) | |||
* [[Network intrusion detection system]] | |||
* [[Orbit determination]] | |||
Measured data are likely to be subject to [[noise (physics)|noise]] or uncertainty and it is through statistical [[probability]] that [[optimization (mathematics)|optimal]] solutions are sought to extract as much [[Fisher information|information]] from the data as possible. | |||
==See also== | |||
* [[:Category:Estimation theory]] | |||
* [[:Category:Estimation for specific distributions]] | |||
{{colbegin}} | |||
* [[Best linear unbiased estimator]] (BLUE) | |||
* [[Chebyshev center]] | |||
* [[Completeness (statistics)]] | |||
* [[Cramér–Rao bound]] | |||
* [[Detection theory]] | |||
* [[Efficiency (statistics)]] | |||
* [[Estimator]], [[Estimator bias]] | |||
* [[Expectation-maximization algorithm]] (EM algorithm) | |||
* [[Information theory]] | |||
* [[Kalman filter]] | |||
* [[Least-squares spectral analysis]] | |||
* [[Markov chain Monte Carlo]] (MCMC) | |||
* [[Matched filter]] | |||
* [[Maximum a posteriori]] (MAP) | |||
* [[Maximum likelihood]] | |||
* [[Maximum entropy spectral estimation]] | |||
* [[Method of moments (statistics)|Method of moments]], [[generalized method of moments]] | |||
* [[Minimum mean squared error]] (MMSE) | |||
* [[Minimum variance unbiased estimator]] (MVUE) | |||
*[[nonlinear system identification]] | |||
* [[Nuisance parameter]] | |||
* [[Parametric equation]] | |||
* [[Particle filter]] | |||
* [[Rao–Blackwell theorem]] | |||
* [[Spectral density]], [[Spectral density estimation]] | |||
* [[Statistical signal processing]] | |||
* [[Sufficiency (statistics)]] | |||
* [[Wiener filter]] | |||
{{colend}} | |||
==Notes== | |||
{{reflist|group="note"}} | |||
==References== | |||
{{reflist}} | |||
==References== | |||
* ''Theory of Point Estimation'' by E.L. Lehmann and G. Casella. (ISBN 0387985026) | |||
* ''Systems Cost Engineering'' by Dale Shermon. (ISBN 978-0-566-08861-2) | |||
* ''Mathematical Statistics and Data Analysis'' by John Rice. (ISBN 0-534-209343) | |||
* ''Fundamentals of Statistical Signal Processing: Estimation Theory'' by Steven M. Kay (ISBN 0-13-345711-7) | |||
* ''An Introduction to Signal Detection and Estimation'' by H. Vincent Poor (ISBN 0-387-94173-8) | |||
* ''Detection, Estimation, and Modulation Theory, Part 1'' by Harry L. Van Trees (ISBN 0-471-09517-6; [http://gunston.gmu.edu/demt/demtp1/ website]) | |||
* ''Optimal State Estimation: Kalman, H-infinity, and Nonlinear Approaches'' by Dan Simon [http://academic.csuohio.edu/simond/estimation/ website] | |||
* [[Ali H. Sayed]], Adaptive Filters, Wiley, NJ, 2008, ISBN 978-0-470-25388-5. | |||
* [[Ali H. Sayed]], Fundamentals of Adaptive Filtering, Wiley, NJ, 2003, ISBN 0-471-46126-1. | |||
* [[Thomas Kailath]], [[Ali H. Sayed]], and [[Babak Hassibi]], Linear Estimation, Prentice-Hall, NJ, 2000, ISBN 978-0-13-022464-4. | |||
* [[Babak Hassibi]], [[Ali H. Sayed]], and [[Thomas Kailath]], Indefinite Quadratic Estimation and Control: A Unified Approach to H2 and Hoo Theories, Society for Industrial & Applied Mathematics (SIAM), PA, 1999, ISBN 978-0-89871-411-1. | |||
* V.G.Voinov, M.S.Nikulin, "Unbiased estimators and their applications. Vol.1: Univariate case", Kluwer Academic Publishers, 1993, ISBN 0-7923-2382-3. | |||
* V.G.Voinov, M.S.Nikulin, "Unbiased estimators and their applications. Vol.2: Multivariate case", Kluwer Academic Publishers, 1996, ISBN 0-7923-3939-8. | |||
{{DSP}} | |||
[[Category:Estimation theory| ]] | |||
[[Category:Statistical inference]] | |||
[[Category:Signal processing]] |
Revision as of 01:12, 19 January 2014
I'm Fernando (21) from Seltjarnarnes, Iceland.
I'm learning Norwegian literature at a local college and I'm just about to graduate.
I have a part time job in a the office.
my site; wellness [continue reading this..]
Estimation theory is a branch of statistics that deals with estimating the values of parameters based on measured/empirical data that has a random component. The parameters describe an underlying physical setting in such a way that their value affects the distribution of the measured data. An estimator attempts to approximate the unknown parameters using the measurements.
For example, it is desired to estimate the proportion of a population of voters who will vote for a particular candidate. That proportion is the parameter sought; the estimate is based on a small random sample of voters.
Or, for example, in radar the goal is to estimate the range of objects (airplanes, boats, etc.) by analyzing the two-way transit timing of received echoes of transmitted pulses. Since the reflected pulses are unavoidably embedded in electrical noise, their measured values are randomly distributed, so that the transit time must be estimated.
In estimation theory, two approaches are generally considered. [1]
- The probabilistic approach (described in this article) assumes that the measured data is random with probability distribution dependent on the parameters of interest
- The set-membership approach assumes that the measured data vector belongs to a set which depends on the parameter vector.
For example, in electrical communication theory, the measurements which contain information regarding the parameters of interest are often associated with a noisy signal. Without randomness, or noise, the problem would be deterministic and estimation would not be needed.
Estimation process
The entire purpose of estimation theory is to arrive at an estimator — preferably an easily implementable one. The estimator takes the measured data as input and produces an estimate of the parameters with the corresponding accuracy.
It is also preferable to derive an estimator that exhibits optimality. Estimator optimality usually refers to achieving minimum average error over some class of estimators, for example, a minimum variance unbiased estimator. In this case, the class is the set of unbiased estimators, and the average error measure is variance (average squared error between the value of the estimate and the parameter). However, optimal estimators do not always exist.
These are the general steps to arrive at an estimator:
- In order to arrive at a desired estimator, it is first necessary to determine a probability distribution for the measured data, and the distribution's dependence on the unknown parameters of interest. Often, the probability distribution may be derived from physical models that explicitly show how the measured data depends on the parameters to be estimated, and how the data is corrupted by random errors or noise. In other cases, the probability distribution for the measured data is simply "assumed", for example, based on familiarity with the measured data and/or for analytical convenience.
- After deciding upon a probabilistic model, it is helpful to find the theoretically achievable (optimal) precision available to any estimator based on this model. The Cramér–Rao bound is useful for this.
- Next, an estimator needs to be developed, or applied (if an already known estimator is valid for the model). There are a variety of methods for developing estimators; maximum likelihood estimators are often the default although they may be hard to compute or even fail to exist. If possible, the theoretical performance of the estimator should be derived and compared with the optimal performance found in the last step.
- Finally, experiments or simulations can be run using the estimator to test its performance.
After arriving at an estimator, real data might show that the model used to derive the estimator is incorrect, which may require repeating these steps to find a new estimator. A non-implementable or infeasible estimator may need to be scrapped and the process started anew.
Estimation theory can be applied to both linear and nonlinear models and is closely related to system identification and nonlinear system identification.[2]
In summary, the estimator estimates the parameters of a physical model based on measured data.
Basics
To build a model, several statistical "ingredients" need to be known. These are needed to ensure the estimator has some mathematical tractability instead of being based on "good feel".
The first is a set of statistical samples taken from a random vector (RV) of size N. Put into a vector,
Secondly, there are the corresponding M parameters
which need to be established with their continuous probability density function (pdf) or its discrete counterpart, the probability mass function (pmf)
It is also possible for the parameters themselves to have a probability distribution (e.g., Bayesian statistics). It is then necessary to define the Bayesian probability
After the model is formed, the goal is to estimate the parameters, commonly denoted , where the "hat" indicates the estimate.
One common estimator is the minimum mean squared error estimator, which utilizes the error between the estimated parameters and the actual value of the parameters
as the basis for optimality. This error term is then squared and minimized for the MMSE estimator.
Estimators
Commonly used estimators and estimation methods, and topics related to them:
- Maximum likelihood estimators
- Bayes estimators
- Method of moments estimators
- Cramér–Rao bound
- Minimum mean squared error (MMSE), also known as Bayes least squared error (BLSE)
- Maximum a posteriori (MAP)
- Minimum variance unbiased estimator (MVUE)
- nonlinear system identification
- Best linear unbiased estimator (BLUE)
- Unbiased estimators — see estimator bias.
- Particle filter
- Markov chain Monte Carlo (MCMC)
- Kalman filter, and its various derivatives
- Wiener filter
Examples
Unknown constant in additive white Gaussian noise
Consider a received discrete signal, , of independent samples that consists of an unknown constant with additive white Gaussian noise (AWGN) with known variance (i.e., ). Since the variance is known then the only unknown parameter is .
The model for the signal is then
Two possible (of many) estimators are:
- which is the sample mean
Both of these estimators have a mean of , which can be shown through taking the expected value of each estimator
and
At this point, these two estimators would appear to perform the same. However, the difference between them becomes apparent when comparing the variances.
and
It would seem that the sample mean is a better estimator since its variance is lower for every N>1.
Maximum likelihood
Mining Engineer (Excluding Oil ) Truman from Alma, loves to spend time knotting, largest property developers in singapore developers in singapore and stamp collecting. Recently had a family visit to Urnes Stave Church. Continuing the example using the maximum likelihood estimator, the probability density function (pdf) of the noise for one sample is
and the probability of becomes ( can be thought of a )
By independence, the probability of becomes
Taking the natural logarithm of the pdf
and the maximum likelihood estimator is
Taking the first derivative of the log-likelihood function
and setting it to zero
This results in the maximum likelihood estimator
which is simply the sample mean. From this example, it was found that the sample mean is the maximum likelihood estimator for samples of a fixed, unknown parameter corrupted by AWGN.
Cramér–Rao lower bound
DTZ gives a comprehensive integrated property and services administration resolution for buyers, corporate house for sale In singapore owners, management firms and occupiers of property whatever their needs with the only goal of optimising and enhancing the investment worth of their property. We at the moment make use of a staff of more than 70 skilled staffs who are well-trained and dedicated to collectively achieving our purchasers' objectives.
Actual estate agency specialising in non-public condos and landed properties island vast. 10 Winstedt Highway, District 10, #01-thirteen, Singapore 227977. Property providers for enterprise relocation. Situated at 371 Beach Street, #19-10 KeyPoint, Singapore 199597. Property agents for homes, town houses, landed property, residences and condominium for sales and rentals of properties. Administration letting services for property homeowners. is there a single authority in singapore who regulates real property agents that i can file a complaint with for unethical behaviour? or is CASE is simply route? The 188 pages of Secrets and techniques of Singapore Property Gurus are full of professional knowledge and life altering wisdom. Asian industrial property market outlook Property Listing Supervisor Property Advertising Services
Should sellers go along with an agent who claims to specialize in your space? His experience might turn out to be useful, but he is probably additionally advertising a number of models within the neighbourhood – and so they're all your rivals. Within the worst-case state of affairs, your house may be used as a "showflat" as house owner YS Liang found. "Weekend after weekend, our agent would convey a stream of individuals to speed-go to our apartment, leaving within minutes. She did not even try to promote our condominium. It felt like we were just one of the many tour stops for her clients," he complains.
Step one in direction of conducting enterprise as an actual property company in Singapore is to include an organization, or if you happen to're going the partnership or sole-proprietorship route, register your Limited Legal responsibility Partnership or sole-proprietorship with the ACRA (Accounting and Company Regulatory Authority of Singapore) Whether or not you might be considering to promote, let, hire or buy a new industrial property, we're right here to assist. Search and browse our commercial property section. Possess not less than 3 years of working expertise below a Singapore licensed real-property agency; Sale, letting and property administration and taxation companies. three Shenton Means, #10-08 Shenton Home, Singapore 068805. Real property agents for purchasing, promoting, leasing, and renting property. Caveat Search
Firstly, the events might take into account to rescind the sale and buy agreement altogether. This avenue places the contracting events to a position as if the contract didn't happen. It's as if the contract was terminated from the start and events are put back into place that they were before the contract. Any items or monies handed are returned to the respective original house owners. As the worldwide real property market turns into extra refined and worldwide real property investments will increase, the ERA real estate network is well equipped to offer professional recommendation and guidance to our shoppers in making critical actual estate decisions. Relocationg, leasing and sales of properties for housing, food and beverage, retail and workplace wants.
Pasir Panjang, Singapore - $5,000-6,000 per 30 days By likelihood one among our buddies here in Singapore is an agent and we made contact for her to help us locate an residence, which she did. days from the date of execution if the doc is signed in Singapore; Be a Singapore Citizen or PR (Permanent Resident); The regulations also prohibit property agents from referring their shoppers to moneylenders, to discourage irresponsible shopping for. Brokers are additionally prohibited from holding or dealing with money on behalf of any party in relation to the sale or purchase of any property situated in Singapore, and the lease of HDB property. - Negotiate To Close A Sale together with sale and lease of HDB and private properties) Preparing your house for sale FEATURED COMMERCIAL AGENTS Property Guides
i) registered as a patent agent or its equal in any nation or territory, or by a patent workplace, specified within the Fourth Schedule; The business-specific tips for the true property agency and telecommunication sectors have been crafted to address considerations about scenarios that particularly apply to the two sectors, the PDPC stated. Mr Steven Tan, Managing Director of OrangeTee real property company, nonetheless, felt that it was a matter of "practising until it becomes part of our knowledge". "After a while, the agents ought to know the spirit behind the (Act)," he stated. Rising office sector leads real property market efficiency, while prime retail and enterprise park segments moderate and residential sector continues in decline Please choose an attendee for donation.
To find the Cramér–Rao lower bound (CRLB) of the sample mean estimator, it is first necessary to find the Fisher information number
and copying from above
Taking the second derivative
and finding the negative expected value is trivial since it is now a deterministic constant
Finally, putting the Fisher information into
results in
Comparing this to the variance of the sample mean (determined previously) shows that the sample mean is equal to the Cramér–Rao lower bound for all values of and . In other words, the sample mean is the (necessarily unique) efficient estimator, and thus also the minimum variance unbiased estimator (MVUE), in addition to being the maximum likelihood estimator.
Maximum of a uniform distribution
Mining Engineer (Excluding Oil ) Truman from Alma, loves to spend time knotting, largest property developers in singapore developers in singapore and stamp collecting. Recently had a family visit to Urnes Stave Church. One of the simplest non-trivial examples of estimation is the estimation of the maximum of a uniform distribution. It is used as a hands-on classroom exercise and to illustrate basic principles of estimation theory. Further, in the case of estimation based on a single sample, it demonstrates philosophical issues and possible misunderstandings in the use of maximum likelihood estimators and likelihood functions.
Given a discrete uniform distribution with unknown maximum, the UMVU estimator for the maximum is given by
where m is the sample maximum and k is the sample size, sampling without replacement.[3][4] This problem is commonly known as the German tank problem, due to application of maximum estimation to estimates of German tank production during World War II.
The formula may be understood intuitively as:
- "The sample maximum plus the average gap between observations in the sample",
the gap being added to compensate for the negative bias of the sample maximum as an estimator for the population maximum.[note 1]
This has a variance of[3]
so a standard deviation of approximately , the (population) average size of a gap between samples; compare above. This can be seen as a very simple case of maximum spacing estimation.
The sample maximum is the maximum likelihood estimator for the population maximum, but, as discussed above, it is biased.
Applications
Numerous fields require the use of estimation theory. Some of these fields include (but are by no means limited to):
- Interpretation of scientific experiments
- Signal processing
- Clinical trials
- Opinion polls
- Quality control
- Telecommunications
- Project management
- Software engineering
- Control theory (in particular Adaptive control)
- Network intrusion detection system
- Orbit determination
Measured data are likely to be subject to noise or uncertainty and it is through statistical probability that optimal solutions are sought to extract as much information from the data as possible.
See also
- Best linear unbiased estimator (BLUE)
- Chebyshev center
- Completeness (statistics)
- Cramér–Rao bound
- Detection theory
- Efficiency (statistics)
- Estimator, Estimator bias
- Expectation-maximization algorithm (EM algorithm)
- Information theory
- Kalman filter
- Least-squares spectral analysis
- Markov chain Monte Carlo (MCMC)
- Matched filter
- Maximum a posteriori (MAP)
- Maximum likelihood
- Maximum entropy spectral estimation
- Method of moments, generalized method of moments
- Minimum mean squared error (MMSE)
- Minimum variance unbiased estimator (MVUE)
- nonlinear system identification
- Nuisance parameter
- Parametric equation
- Particle filter
- Rao–Blackwell theorem
- Spectral density, Spectral density estimation
- Statistical signal processing
- Sufficiency (statistics)
- Wiener filter
Notes
43 year old Petroleum Engineer Harry from Deep River, usually spends time with hobbies and interests like renting movies, property developers in singapore new condominium and vehicle racing. Constantly enjoys going to destinations like Camino Real de Tierra Adentro.
References
43 year old Petroleum Engineer Harry from Deep River, usually spends time with hobbies and interests like renting movies, property developers in singapore new condominium and vehicle racing. Constantly enjoys going to destinations like Camino Real de Tierra Adentro.
References
- Theory of Point Estimation by E.L. Lehmann and G. Casella. (ISBN 0387985026)
- Systems Cost Engineering by Dale Shermon. (ISBN 978-0-566-08861-2)
- Mathematical Statistics and Data Analysis by John Rice. (ISBN 0-534-209343)
- Fundamentals of Statistical Signal Processing: Estimation Theory by Steven M. Kay (ISBN 0-13-345711-7)
- An Introduction to Signal Detection and Estimation by H. Vincent Poor (ISBN 0-387-94173-8)
- Detection, Estimation, and Modulation Theory, Part 1 by Harry L. Van Trees (ISBN 0-471-09517-6; website)
- Optimal State Estimation: Kalman, H-infinity, and Nonlinear Approaches by Dan Simon website
- Ali H. Sayed, Adaptive Filters, Wiley, NJ, 2008, ISBN 978-0-470-25388-5.
- Ali H. Sayed, Fundamentals of Adaptive Filtering, Wiley, NJ, 2003, ISBN 0-471-46126-1.
- Thomas Kailath, Ali H. Sayed, and Babak Hassibi, Linear Estimation, Prentice-Hall, NJ, 2000, ISBN 978-0-13-022464-4.
- Babak Hassibi, Ali H. Sayed, and Thomas Kailath, Indefinite Quadratic Estimation and Control: A Unified Approach to H2 and Hoo Theories, Society for Industrial & Applied Mathematics (SIAM), PA, 1999, ISBN 978-0-89871-411-1.
- V.G.Voinov, M.S.Nikulin, "Unbiased estimators and their applications. Vol.1: Univariate case", Kluwer Academic Publishers, 1993, ISBN 0-7923-2382-3.
- V.G.Voinov, M.S.Nikulin, "Unbiased estimators and their applications. Vol.2: Multivariate case", Kluwer Academic Publishers, 1996, ISBN 0-7923-3939-8.
- ↑
20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
My blog: http://www.primaboinca.com/view_profile.php?userid=5889534 - ↑ Billings S.A. "Nonlinear System Identification: NARMAX Methods in the Time, Frequency, and Spatio-Temporal Domains". Wiley, 2013
- ↑ 3.0 3.1 Many property agents need to declare for the PIC grant in Singapore. However, not all of them know find out how to do the correct process for getting this PIC scheme from the IRAS. There are a number of steps that you need to do before your software can be approved.
Naturally, you will have to pay a safety deposit and that is usually one month rent for annually of the settlement. That is the place your good religion deposit will likely be taken into account and will kind part or all of your security deposit. Anticipate to have a proportionate amount deducted out of your deposit if something is discovered to be damaged if you move out. It's best to you'll want to test the inventory drawn up by the owner, which can detail all objects in the property and their condition. If you happen to fail to notice any harm not already mentioned within the inventory before transferring in, you danger having to pay for it yourself.
In case you are in search of an actual estate or Singapore property agent on-line, you simply should belief your intuition. It's because you do not know which agent is nice and which agent will not be. Carry out research on several brokers by looking out the internet. As soon as if you end up positive that a selected agent is dependable and reliable, you can choose to utilize his partnerise in finding you a home in Singapore. Most of the time, a property agent is taken into account to be good if he or she locations the contact data on his website. This may mean that the agent does not mind you calling them and asking them any questions relating to new properties in singapore in Singapore. After chatting with them you too can see them in their office after taking an appointment.
Have handed an trade examination i.e Widespread Examination for House Brokers (CEHA) or Actual Property Agency (REA) examination, or equal; Exclusive brokers are extra keen to share listing information thus making certain the widest doable coverage inside the real estate community via Multiple Listings and Networking. Accepting a severe provide is simpler since your agent is totally conscious of all advertising activity related with your property. This reduces your having to check with a number of agents for some other offers. Price control is easily achieved. Paint work in good restore-discuss with your Property Marketing consultant if main works are still to be done. Softening in residential property prices proceed, led by 2.8 per cent decline within the index for Remainder of Central Region
Once you place down the one per cent choice price to carry down a non-public property, it's important to accept its situation as it is whenever you move in – faulty air-con, choked rest room and all. Get round this by asking your agent to incorporate a ultimate inspection clause within the possibility-to-buy letter. HDB flat patrons routinely take pleasure in this security net. "There's a ultimate inspection of the property two days before the completion of all HDB transactions. If the air-con is defective, you can request the seller to repair it," says Kelvin.
15.6.1 As the agent is an intermediary, generally, as soon as the principal and third party are introduced right into a contractual relationship, the agent drops out of the image, subject to any problems with remuneration or indemnification that he could have against the principal, and extra exceptionally, against the third occasion. Generally, agents are entitled to be indemnified for all liabilities reasonably incurred within the execution of the brokers´ authority.
To achieve the very best outcomes, you must be always updated on market situations, including past transaction information and reliable projections. You could review and examine comparable homes that are currently available in the market, especially these which have been sold or not bought up to now six months. You'll be able to see a pattern of such report by clicking here It's essential to defend yourself in opposition to unscrupulous patrons. They are often very skilled in using highly unethical and manipulative techniques to try and lure you into a lure. That you must also protect your self, your loved ones, and personal belongings as you'll be serving many strangers in your home. Sign a listing itemizing of all of the objects provided by the proprietor, together with their situation. HSR Prime Recruiter 2010 - ↑ Many property agents need to declare for the PIC grant in Singapore. However, not all of them know find out how to do the correct process for getting this PIC scheme from the IRAS. There are a number of steps that you need to do before your software can be approved.
Naturally, you will have to pay a safety deposit and that is usually one month rent for annually of the settlement. That is the place your good religion deposit will likely be taken into account and will kind part or all of your security deposit. Anticipate to have a proportionate amount deducted out of your deposit if something is discovered to be damaged if you move out. It's best to you'll want to test the inventory drawn up by the owner, which can detail all objects in the property and their condition. If you happen to fail to notice any harm not already mentioned within the inventory before transferring in, you danger having to pay for it yourself.
In case you are in search of an actual estate or Singapore property agent on-line, you simply should belief your intuition. It's because you do not know which agent is nice and which agent will not be. Carry out research on several brokers by looking out the internet. As soon as if you end up positive that a selected agent is dependable and reliable, you can choose to utilize his partnerise in finding you a home in Singapore. Most of the time, a property agent is taken into account to be good if he or she locations the contact data on his website. This may mean that the agent does not mind you calling them and asking them any questions relating to new properties in singapore in Singapore. After chatting with them you too can see them in their office after taking an appointment.
Have handed an trade examination i.e Widespread Examination for House Brokers (CEHA) or Actual Property Agency (REA) examination, or equal; Exclusive brokers are extra keen to share listing information thus making certain the widest doable coverage inside the real estate community via Multiple Listings and Networking. Accepting a severe provide is simpler since your agent is totally conscious of all advertising activity related with your property. This reduces your having to check with a number of agents for some other offers. Price control is easily achieved. Paint work in good restore-discuss with your Property Marketing consultant if main works are still to be done. Softening in residential property prices proceed, led by 2.8 per cent decline within the index for Remainder of Central Region
Once you place down the one per cent choice price to carry down a non-public property, it's important to accept its situation as it is whenever you move in – faulty air-con, choked rest room and all. Get round this by asking your agent to incorporate a ultimate inspection clause within the possibility-to-buy letter. HDB flat patrons routinely take pleasure in this security net. "There's a ultimate inspection of the property two days before the completion of all HDB transactions. If the air-con is defective, you can request the seller to repair it," says Kelvin.
15.6.1 As the agent is an intermediary, generally, as soon as the principal and third party are introduced right into a contractual relationship, the agent drops out of the image, subject to any problems with remuneration or indemnification that he could have against the principal, and extra exceptionally, against the third occasion. Generally, agents are entitled to be indemnified for all liabilities reasonably incurred within the execution of the brokers´ authority.
To achieve the very best outcomes, you must be always updated on market situations, including past transaction information and reliable projections. You could review and examine comparable homes that are currently available in the market, especially these which have been sold or not bought up to now six months. You'll be able to see a pattern of such report by clicking here It's essential to defend yourself in opposition to unscrupulous patrons. They are often very skilled in using highly unethical and manipulative techniques to try and lure you into a lure. That you must also protect your self, your loved ones, and personal belongings as you'll be serving many strangers in your home. Sign a listing itemizing of all of the objects provided by the proprietor, together with their situation. HSR Prime Recruiter 2010
Cite error: <ref>
tags exist for a group named "note", but no corresponding <references group="note"/>
tag was found