Marangoni number

The forward–backward algorithm is an inference algorithm for hidden Markov models which computes the posterior marginals of all hidden state variables given a sequence of observations/emissions $o_{1:t}:=o_1,\dots ,o_t$, i.e. it computes, for all hidden state variables $X_k\in \{X_1,\dots ,X_t\}$, the distribution $P(X_k|o_{1:t})$. This inference task is usually called smoothing. The algorithm makes use of the principle of dynamic programming to compute efficiently the values that are required to obtain the posterior marginal distributions in two passes. The first pass goes forward in time while the second goes backward in time; hence the name forward–backward algorithm.

The term forward–backward algorithm is also used to refer to any algorithm belonging to the general class of algorithms that operate on sequence models in a forward–backward manner. In this sense, the descriptions in the remainder of this article refer but to one specific instance of this class.

Overview

In the first pass, the forward–backward algorithm computes a set of forward probabilities which provide, for all $k\in \{1,\dots ,t\}$, the probability of ending up in any particular state given the first $k$ observations in the sequence, i.e. $P(X_k|o_{1:k})$. In the second pass, the algorithm computes a set of backward probabilities which provide the probability of observing the remaining observations given any starting point $k$, i.e. $P(o_{k+1:t}|X_k)$. These two sets of probability distributions can then be combined to obtain the distribution over states at any specific point in time given the entire observation sequence:

$P(X_k|o_{1:t})=P(X_k|o_{1:k},o_{k+1:t})\propto P(o_{k+1:t}|X_k)P(X_k|o_{1:k})$

The last step follows from an application of Bayes' rule and the conditional independence of $o_{k+1:t}$ and $o_{1:k}$ given $X_k$.

As outlined above, the algorithm involves three steps:

1. computing forward probabilities
2. computing backward probabilities
3. computing smoothed values.

The forward and backward steps may also be called "forward message pass" and "backward message pass" - these terms are due to the message-passing used in general belief propagation approaches. At each single observation in the sequence, probabilities to be used for calculations at the next observation are computed. The smoothing step can be calculated simultaneously during the backward pass. This step allows the algorithm to take into account any past observations of output for computing more accurate results.

The forward–backward algorithm can be used to find the most likely state for any point in time. It cannot, however, be used to find the most likely sequence of states (see Viterbi algorithm).

Forward probabilities

The following description will use matrices of probability values rather than probability distributions, although in general the forward-backward algorithm can be applied to continuous as well as discrete probability models.

We transform the probability distributions related to a given hidden Markov model into matrix notation as follows. The transition probabilities $\mathbf{P}(X_t\mid X_{t-1})$ of a given random variable $X_t$ representing all possible states in the hidden Markov model will be represented by the matrix $\mathbf{T}$ where the row index, i, will represent the start state and the column index, j, represents the target state. The example below represents a system where the probability of staying in the same state after each step is 70% and the probability of transitioning to the other state is 30%. The transition matrix is then:

$\mathbf{T}=\left(\begin{array}{cc}0.7& 0.3\\ 0.3& 0.7\end{array}\right)$

In a typical Markov model we would multiply a state vector by this matrix to obtain the probabilities for the subsequent state. In a hidden Markov model the state is unknown, and we instead observe events associated with the possible states. An event matrix of the form:

$\mathbf{B}=\left(\begin{array}{cc}0.9& 0.1\\ 0.2& 0.8\end{array}\right)$

provides the probabilities for observing events given a particular state. In the above example, event 1 will be observed 90% of the time if we are in state 1 while event 2 has a 10% probability of occurring in this state. In contrast, event 1 will only be observed 20% of the time if we are in state 2 and event 2 has an 80% chance of occurring. Given a state vector ($\mathit{\pi }$), the probability of observing event j is then:

$\mathbf{P}(O=j)=\sum _i{\pi }_i{b}_{i,j}$

This can be represented in matrix form by multiplying the state vector ($\mathit{\pi }$) by an observation matrix (${\mathbf{O}}_{\mathbf{j}}=\mathrm{d}\mathrm{i}\mathrm{a}\mathrm{g}(b_{*,o_j})$) containing only diagonal entries. Each entry is the probability of the observed event given each state. Continuing the above example, an observation of event 1 would be:

${\mathbf{O}}_{\mathbf{1}}=\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right)$

This allows us to calculate the probabilities associated with transitioning to a new state and observing the given event as:

${\mathbf{f}}_{\mathbf{0}\mathbf{:}\mathbf{1}}=\mathit{\pi }\mathbf{T}{\mathbf{O}}_{\mathbf{1}}$

The probability vector that results contains entries indicating the probability of transitioning to each state and observing the given event. This process can be carried forward with additional observations using:

${\mathbf{f}}_{\mathbf{0}\mathbf{:}\mathbf{t}}={\mathbf{f}}_{\mathbf{0}\mathbf{:}\mathbf{t}\mathbf{-}\mathbf{1}}\mathbf{T}{\mathbf{O}}_{\mathbf{t}}$

This value is the forward probability vector. The i'th entry of this vector provides:

${\mathbf{f}}_{\mathbf{0}\mathbf{:}\mathbf{t}}(i)=\mathbf{P}(o_1,o_2,\dots ,o_t,X_t=x_i|\mathit{\pi })$

Typically, we will normalize the probability vector at each step so that its entries sum to 1. A scaling factor is thus introduced at each step such that:

${\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{t}}=c_t^{-1}{\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{t}\mathbf{-}\mathbf{1}}\mathbf{T}{\mathbf{O}}_{\mathbf{t}}$

where ${\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{t}\mathbf{-}\mathbf{1}}$ represents the scaled vector from the previous step and $c_t$ represents the scaling factor that causes the resulting vector's entries to sum to 1. The product of the scaling factors is the total probability for observing the given events irrespective of the final states:

$\mathbf{P}(o_1,o_2,\dots ,o_t|\mathit{\pi })=\prod _{s=1}^t{c}_s$

This allows us to interpret the scaled probability vector as:

${\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{t}}(i)=\frac{{\mathbf{f}}_{\mathbf{0}\mathbf{:}\mathbf{t}}(i)}{\prod _{s=1}^t{c}_s}=\frac{\mathbf{P}(o_1,o_2,\dots ,o_t,X_t=x_i|\mathit{\pi })}{\mathbf{P}(o_1,o_2,\dots ,o_t|\mathit{\pi })}=\mathbf{P}(X_t=x_i|o_1,o_2,\dots ,o_t,\mathit{\pi })$

We thus find that the product of the scaling factors provides us with the total probability for observing the given sequence up to time t and that the scaled probability vector provides us with the probability of being in each state at this time.

Backward probabilities

A similar procedure can be constructed to find backward probabilities. These intend to provide the probabilities:

${\mathbf{b}}_{\mathbf{t}\mathbf{:}\mathbf{T}}(i)=\mathbf{P}(o_{t+1},o_{t+2},\dots ,o_T|X_t=x_i)$

That is, we now want to assume that we start in a particular state ($X_t=x_i$), and we are now interested in the probability of observing all future events from this state. Since the initial state is assumed as given (i.e. the prior probability of this state = 100%), we begin with:

${\mathbf{b}}_{\mathbf{T}\mathbf{:}\mathbf{T}}=[111\dots {]}^T$

Notice that we are now using a column vector while the forward probabilities used row vectors. We can then work backwards using:

${\mathbf{b}}_{\mathbf{t}\mathbf{-}\mathbf{1}\mathbf{:}\mathbf{T}}=\mathbf{T}{\mathbf{O}}_{\mathbf{t}}{\mathbf{b}}_{\mathbf{t}\mathbf{:}\mathbf{T}}$

While we could normalize this vector as well so that its entries sum to one, this is not usually done. Noting that each entry contains the probability of the future event sequence given a particular initial state, normalizing this vector would be equivalent to applying Bayes' theorem to find the likelihood of each initial state given the future events (assuming uniform priors for the final state vector). However, it is more common to scale this vector using the same $c_t$ constants used in the forward probability calculations. ${\mathbf{b}}_{\mathbf{T}\mathbf{:}\mathbf{T}}$ is not scaled, but subsequent operations use:

${\hat{\mathbf{b}}}_{\mathbf{t}\mathbf{-}\mathbf{1}\mathbf{:}\mathbf{T}}=c_t^{-1}\mathbf{T}{\mathbf{O}}_{\mathbf{t}}{\hat{\mathbf{b}}}_{\mathbf{t}\mathbf{:}\mathbf{T}}$

where ${\hat{\mathbf{b}}}_{\mathbf{t}\mathbf{:}\mathbf{T}}$ represents the previous, scaled vector. This result is that the scaled probability vector is related to the backward probabilities by:

${\hat{\mathbf{b}}}_{\mathbf{t}\mathbf{:}\mathbf{T}}(i)=\frac{{\mathbf{b}}_{\mathbf{t}\mathbf{:}\mathbf{T}}(i)}{\prod _{s=t+1}^T{c}_s}$

This is useful because it allows us to find the total probability of being in each state at a given time, t, by multiplying these values:

${\mathit{\gamma }}_{\mathbf{t}}(i)=\mathbf{P}(X_t=x_i|o_1,o_2,\dots ,o_T,\mathit{\pi })=\frac{\mathbf{P}(o_1,o_2,\dots ,o_T,X_t=x_i|\mathit{\pi })}{\mathbf{P}(o_1,o_2,\dots ,o_T|\mathit{\pi })}=\frac{{\mathbf{f}}_{\mathbf{0}\mathbf{:}\mathbf{t}}(i)\cdot {\mathbf{b}}_{\mathbf{t}\mathbf{:}\mathbf{T}}(i)}{\prod _{s=1}^T{c}_s}={\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{t}}(i)\cdot {\hat{\mathbf{b}}}_{\mathbf{t}\mathbf{:}\mathbf{T}}(i)$

To understand this, we note that ${\mathbf{f}}_{\mathbf{0}\mathbf{:}\mathbf{t}}(i)\cdot {\mathbf{b}}_{\mathbf{t}\mathbf{:}\mathbf{T}}(i)$ provides the probability for observing the given events in a way that passes through state $x_i$ at time t. This probability includes the forward probabilities covering all events up to time t as well as the backward probabilities which include all future events. This is the numerator we are looking for in our equation, and we divide by the total probability of the observation sequence to normalize this value and extract only the probability that $X_t=x_i$. These values are sometimes called the "smoothed values" as they combine the forward and backward probabilities to compute a final probability.

The values ${\mathit{\gamma }}_{\mathbf{t}}(i)$ thus provide the probability of being in each state at time t. As such, they are useful for determining the most probable state at any time. It should be noted, however, that the term "most probable state" is somewhat ambiguous. While the most probable state is the most likely to be correct at a given point, the sequence of individually probable states is not likely to be the most probable sequence. This is because the probabilities for each point are calculated independently of each other. They do not take into account the transition probabilities between states, and it is thus possible to get states at two moments (t and t+1) that are both most probable at those time points but which have very little probability of occurring together, i.e. $\mathbf{P}(X_t=x_i,X_{t+1}=x_j)\ne \mathbf{P}(X_t=x_i)\mathbf{P}(X_{t+1}=x_j)$. The most probable sequence of states that produced an observation sequence can be found using the Viterbi algorithm.

Example

This example takes as its basis the umbrella world in Russell & Norvig 2010 Chapter 15 pp. 566 in which we would like to infer the weather given observation of a man either carrying or not carrying an umbrella. We assume two possible states for the weather: state 1 = rain, state 2 = no rain. We assume that the weather has a 70% chance of staying the same each day and a 30% chance of changing. The transition probabilities are then:

$\mathbf{T}=\left(\begin{array}{cc}0.7& 0.3\\ 0.3& 0.7\end{array}\right)$

We also assume each state generates 2 events: event 1 = umbrella, event 2 = no umbrella. The conditional probabilities for these occurring in each state are given by the probability matrix:

$\mathbf{B}=\left(\begin{array}{cc}0.9& 0.1\\ 0.2& 0.8\end{array}\right)$

We then observe the following sequence of events: {umbrella, umbrella, no umbrella, umbrella, umbrella} which we will represent in our calculations as:

${\mathbf{O}}_{\mathbf{1}}=\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right){\mathbf{O}}_{\mathbf{2}}=\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right){\mathbf{O}}_{\mathbf{3}}=\left(\begin{array}{cc}0.1& 0.0\\ 0.0& 0.8\end{array}\right){\mathbf{O}}_{\mathbf{4}}=\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right){\mathbf{O}}_{\mathbf{5}}=\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right)$

Note that ${\mathbf{O}}_{\mathbf{3}}$ differs from the others because of the "no umbrella" observation.

In computing the forward probabilities we begin with:

${\mathbf{f}}_{\mathbf{0}\mathbf{:}\mathbf{0}}=\left(\begin{array}{cc}0.5& 0.5\end{array}\right)$

which is our prior state vector indicating that we don't know which state the weather is in before our observations. While a state vector should be given as a row vector, we will use the transpose of the matrix so that the calculations below are easier to read. Our calculations are then written in the form:

$({\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{t}}{)}^T=c^{-1}{\mathbf{O}}_{\mathbf{t}}(\mathbf{T}{)}^T({\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{t}\mathbf{-}\mathbf{1}}{)}^T$

instead of:

${\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{t}}=c^{-1}{\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{t}\mathbf{-}\mathbf{1}}\mathbf{T}{\mathbf{O}}_{\mathbf{t}}$

Notice that the transformation matrix is also transposed, but in our example the transpose is equal to the original matrix. Performing these calculations and normalizing the results provides:

$({\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{1}}{)}^T=c_1^{-1}\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right)\left(\begin{array}{cc}0.7& 0.3\\ 0.3& 0.7\end{array}\right)\left(\begin{array}{c}0.5000\\ 0.5000\end{array}\right)=c_1^{-1}\left(\begin{array}{c}0.4500\\ 0.1000\end{array}\right)=\left(\begin{array}{c}0.8182\\ 0.1818\end{array}\right)$

$({\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{2}}{)}^T=c_2^{-1}\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right)\left(\begin{array}{cc}0.7& 0.3\\ 0.3& 0.7\end{array}\right)\left(\begin{array}{c}0.8182\\ 0.1818\end{array}\right)=c_2^{-1}\left(\begin{array}{c}0.5645\\ 0.0745\end{array}\right)=\left(\begin{array}{c}0.8834\\ 0.1166\end{array}\right)$

$({\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{3}}{)}^T=c_3^{-1}\left(\begin{array}{cc}0.1& 0.0\\ 0.0& 0.8\end{array}\right)\left(\begin{array}{cc}0.7& 0.3\\ 0.3& 0.7\end{array}\right)\left(\begin{array}{c}0.8834\\ 0.1166\end{array}\right)=c_3^{-1}\left(\begin{array}{c}0.0653\\ 0.2772\end{array}\right)=\left(\begin{array}{c}0.1907\\ 0.8093\end{array}\right)$

$({\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{4}}{)}^T=c_4^{-1}\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right)\left(\begin{array}{cc}0.7& 0.3\\ 0.3& 0.7\end{array}\right)\left(\begin{array}{c}0.1907\\ 0.8093\end{array}\right)=c_4^{-1}\left(\begin{array}{c}0.3386\\ 0.1247\end{array}\right)=\left(\begin{array}{c}0.7308\\ 0.2692\end{array}\right)$

$({\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{5}}{)}^T=c_5^{-1}\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right)\left(\begin{array}{cc}0.7& 0.3\\ 0.3& 0.7\end{array}\right)\left(\begin{array}{c}0.7308\\ 0.2692\end{array}\right)=c_5^{-1}\left(\begin{array}{c}0.5331\\ 0.0815\end{array}\right)=\left(\begin{array}{c}0.8673\\ 0.1327\end{array}\right)$

For the backward probabilities we start with:

${\mathbf{b}}_{\mathbf{5}\mathbf{:}\mathbf{5}}=\left(\begin{array}{c}1.0\\ 1.0\end{array}\right)$

We are then able to compute (using the observations in reverse order and normalizing with different constants):

${\hat{\mathbf{b}}}_{\mathbf{4}\mathbf{:}\mathbf{5}}=\alpha \left(\begin{array}{cc}0.7& 0.3\\ 0.3& 0.7\end{array}\right)\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right)\left(\begin{array}{c}1.0000\\ 1.0000\end{array}\right)=\alpha \left(\begin{array}{c}0.6900\\ 0.4100\end{array}\right)=\left(\begin{array}{c}0.6273\\ 0.3727\end{array}\right)$

${\hat{\mathbf{b}}}_{\mathbf{3}\mathbf{:}\mathbf{5}}=\alpha \left(\begin{array}{cc}0.7& 0.3\\ 0.3& 0.7\end{array}\right)\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right)\left(\begin{array}{c}0.6273\\ 0.3727\end{array}\right)=\alpha \left(\begin{array}{c}0.4175\\ 0.2215\end{array}\right)=\left(\begin{array}{c}0.6533\\ 0.3467\end{array}\right)$

${\hat{\mathbf{b}}}_{\mathbf{2}\mathbf{:}\mathbf{5}}=\alpha \left(\begin{array}{cc}0.7& 0.3\\ 0.3& 0.7\end{array}\right)\left(\begin{array}{cc}0.1& 0.0\\ 0.0& 0.8\end{array}\right)\left(\begin{array}{c}0.6533\\ 0.3467\end{array}\right)=\alpha \left(\begin{array}{c}0.1289\\ 0.2138\end{array}\right)=\left(\begin{array}{c}0.3763\\ 0.6237\end{array}\right)$

${\hat{\mathbf{b}}}_{\mathbf{1}\mathbf{:}\mathbf{5}}=\alpha \left(\begin{array}{cc}0.7& 0.3\\ 0.3& 0.7\end{array}\right)\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right)\left(\begin{array}{c}0.3763\\ 0.6237\end{array}\right)=\alpha \left(\begin{array}{c}0.2745\\ 0.1889\end{array}\right)=\left(\begin{array}{c}0.5923\\ 0.4077\end{array}\right)$

${\hat{\mathbf{b}}}_{\mathbf{0}\mathbf{:}\mathbf{5}}=\alpha \left(\begin{array}{cc}0.7& 0.3\\ 0.3& 0.7\end{array}\right)\left(\begin{array}{cc}0.9& 0.0\\ 0.0& 0.2\end{array}\right)\left(\begin{array}{c}0.5923\\ 0.4077\end{array}\right)=\alpha \left(\begin{array}{c}0.3976\\ 0.2170\end{array}\right)=\left(\begin{array}{c}0.6469\\ 0.3531\end{array}\right)$

Finally, we will compute the smoothed probability values. These result also must be scaled so that its entries sum to 1 because we did not scale the backward probabilities with the $c_t$'s found earlier. The backward probability vectors above thus actually represent the likelihood of each state at time t given the future observations. Because these vectors are proportional to the actual backward probabilities, the result has to be scaled an additional time.

$({\mathit{\gamma }}_{\mathbf{0}}{)}^T=\alpha \left(\begin{array}{c}0.5000\\ 0.5000\end{array}\right)\circ \left(\begin{array}{c}0.6469\\ 0.3531\end{array}\right)=\alpha \left(\begin{array}{c}0.3235\\ 0.1765\end{array}\right)=\left(\begin{array}{c}0.6469\\ 0.3531\end{array}\right)$

$({\mathit{\gamma }}_{\mathbf{1}}{)}^T=\alpha \left(\begin{array}{c}0.8182\\ 0.1818\end{array}\right)\circ \left(\begin{array}{c}0.5923\\ 0.4077\end{array}\right)=\alpha \left(\begin{array}{c}0.4846\\ 0.0741\end{array}\right)=\left(\begin{array}{c}0.8673\\ 0.1327\end{array}\right)$

$({\mathit{\gamma }}_{\mathbf{2}}{)}^T=\alpha \left(\begin{array}{c}0.8834\\ 0.1166\end{array}\right)\circ \left(\begin{array}{c}0.3763\\ 0.6237\end{array}\right)=\alpha \left(\begin{array}{c}0.3324\\ 0.0728\end{array}\right)=\left(\begin{array}{c}0.8204\\ 0.1796\end{array}\right)$

$({\mathit{\gamma }}_{\mathbf{3}}{)}^T=\alpha \left(\begin{array}{c}0.1907\\ 0.8093\end{array}\right)\circ \left(\begin{array}{c}0.6533\\ 0.3467\end{array}\right)=\alpha \left(\begin{array}{c}0.1246\\ 0.2806\end{array}\right)=\left(\begin{array}{c}0.3075\\ 0.6925\end{array}\right)$

$({\mathit{\gamma }}_{\mathbf{4}}{)}^T=\alpha \left(\begin{array}{c}0.7308\\ 0.2692\end{array}\right)\circ \left(\begin{array}{c}0.6273\\ 0.3727\end{array}\right)=\alpha \left(\begin{array}{c}0.4584\\ 0.1003\end{array}\right)=\left(\begin{array}{c}0.8204\\ 0.1796\end{array}\right)$

$({\mathit{\gamma }}_{\mathbf{5}}{)}^T=\alpha \left(\begin{array}{c}0.8673\\ 0.1327\end{array}\right)\circ \left(\begin{array}{c}1.0000\\ 1.0000\end{array}\right)=\alpha \left(\begin{array}{c}0.8673\\ 0.1327\end{array}\right)=\left(\begin{array}{c}0.8673\\ 0.1327\end{array}\right)$

Notice that the value of ${\mathit{\gamma }}_{\mathbf{0}}$ is equal to ${\hat{\mathbf{b}}}_{\mathbf{0}\mathbf{:}\mathbf{5}}$ and that ${\mathit{\gamma }}_{\mathbf{5}}$ is equal to ${\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{5}}$. This follows naturally because both ${\hat{\mathbf{f}}}_{\mathbf{0}\mathbf{:}\mathbf{5}}$ and ${\hat{\mathbf{b}}}_{\mathbf{0}\mathbf{:}\mathbf{5}}$ begin with uniform priors over the initial and final state vectors (respectively) and take into account all of the observations. However, ${\mathit{\gamma }}_{\mathbf{0}}$ will only be equal to ${\hat{\mathbf{b}}}_{\mathbf{0}\mathbf{:}\mathbf{5}}$ when our initial state vector represents a uniform prior (i.e. all entries are equal). When this is not the case ${\hat{\mathbf{b}}}_{\mathbf{0}\mathbf{:}\mathbf{5}}$ needs to be combined with the initial state vector to find the most likely initial state. We thus find that the forward probabilities by themselves are sufficient to calculate the most likely final state. Similarly, the backward probabilities can be combined with the initial state vector to provide the most probable initial state given the observations. The forward and backward probabilities need only be combined to infer the most probable states between the initial and final points.

The calculations above reveal that the most probable weather state on every day except for the third one was "rain." They tell us more than this, however, as they now provide a way to quantify the probabilities of each state at different times. Perhaps most importantly, our value at ${\mathit{\gamma }}_{\mathbf{5}}$ quantifies our knowledge of the state vector at the end of the observation sequence. We can then use this to predict the probability of the various weather states tomorrow as well as the probability of observing an umbrella.

Performance

The brute-force procedure for the solution of this problem is the generation of all possible $N^T$ state sequences and calculating the joint probability of each state sequence with the observed series of events. This approach has time complexity $O(T\cdot N^T)$, where $T$ is the length of sequences and $N$ is the number of symbols in the state alphabet. This is intractable for realistic problems, as the number of possible hidden node sequences typically is extremely high. However, the forward–backward algorithm has time complexity $O(N^{2}T)$.

An enhancement to the general forward-backward algorithm, called the Island algorithm, trades smaller memory usage for longer running time, taking $O(N^{2}T\log T)$ time and $O(N^2\log T)$ memory. On a computer with an unlimited number of processors, this can be reduced to $O(N^{2}T)$ total time, while still taking only $O(N^2\log T)$ memory.

In addition, algorithms have been developed to compute ${\mathbf{f}}_{\mathbf{0}\mathbf{:}\mathbf{t}+\mathbf{1}}$ efficiently through online smoothing such as the fixed-lag smoothing (FLS) algorithm Russell & Norvig 2010 Figure 15.6 pp. 580.

Pseudocode

ForwardBackward(guessState, sequenceIndex):
    if sequenceIndex is past the end of the sequence, return 1
    if (guessState, sequenceIndex) has been seen before, return saved result
    result = 0
    for each neighboring state n:
        result = result + (transition probability from guessState to n given observation element at sequenceIndex)
                        * ForwardBackward(n, sequenceIndex+1)
    save result for (guessState, sequenceIndex)
    return result

Python example

Given HMM (just like in Viterbi algorithm) represented in the Python programming language:

states = ('Healthy', 'Fever')
end_state = 'E'
 
observations = ('normal', 'cold', 'dizzy')
 
start_probability = {'Healthy': 0.6, 'Fever': 0.4}
 
transition_probability = {
   'Healthy' : {'Healthy': 0.69, 'Fever': 0.3, 'E': 0.01},
   'Fever' : {'Healthy': 0.4, 'Fever': 0.59, 'E': 0.01},
   }
 
emission_probability = {
   'Healthy' : {'normal': 0.5, 'cold': 0.4, 'dizzy': 0.1},
   'Fever' : {'normal': 0.1, 'cold': 0.3, 'dizzy': 0.6},
   }

We can write implementation like this:

def fwd_bkw(x, states, a_0, a, e, end_st):
    L = len(x)
 
    fwd = []
    f_prev = {}
    # forward part of the algorithm
    for i, x_i in enumerate(x):
        f_curr = {}
        for st in states:
            if i == 0:
                # base case for the forward part
                prev_f_sum = a_0[st]
            else:
                prev_f_sum = sum(f_prev[k]*a[k][st] for k in states)
 
            f_curr[st] = e[st][x_i] * prev_f_sum
 
        fwd.append(f_curr)
        f_prev = f_curr
 
    p_fwd = sum(f_curr[k]*a[k][end_st] for k in states)
 
    bkw = []
    b_prev = {}
    # backward part of the algorithm
    for i, x_i_plus in enumerate(reversed(x[1:]+(None,))):
        b_curr = {}
        for st in states:
            if i == 0:
                # base case for backward part
                b_curr[st] = a[st][end_st]
            else:
                b_curr[st] = sum(a[st][l]*e[l][x_i_plus]*b_prev[l] for l in states)
 
        bkw.insert(0,b_curr)
        b_prev = b_curr
 
    p_bkw = sum(a_0[l] * e[l][x[0]] * b_curr[l] for l in states)
 
    # merging the two parts
    posterior = {}
    for st in states:
        posterior[st] = [fwd[i][st]*bkw[i][st]/p_fwd for i in range(L)]
 
    assert p_fwd == p_bkw
    return fwd, bkw, posterior

The function fwd_bkw takes the following arguments: x is the sequence of observations, e.g. ['normal', 'cold', 'dizzy']; states is the set of hidden states; a_0 is the start probability; a are the transition probabilities; and e are the emission probabilities.

For simplicity of code, we assume that the observation sequence x is non-empty and that a[i][j] and e[i][j] is defined for all states i,j.

In the running example, the forward-backward algorithm is used as follows:

def example():
    return fwd_bkw(observations,
                   states,
                   start_probability,
                   transition_probability,
                   emission_probability,
                   end_state)

for line in example():
    print(' '.join(map(str, line)))

See also

• Baum-Welch algorithm
• Viterbi algorithm
• BCJR algorithm

References

43 year old Petroleum Engineer Harry from Deep River, usually spends time with hobbies and interests like renting movies, property developers in singapore new condominium and vehicle racing. Constantly enjoys going to destinations like Camino Real de Tierra Adentro.

• Lawrence R. Rabiner, A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. Proceedings of the IEEE, 77 (2), p. 257–286, February 1989. 10.1109/5.18626
• One of the biggest reasons investing in a Singapore new launch is an effective things is as a result of it is doable to be lent massive quantities of money at very low interest rates that you should utilize to purchase it. Then, if property values continue to go up, then you'll get a really high return on funding (ROI). Simply make sure you purchase one of the higher properties, reminiscent of the ones at Fernvale the Riverbank or any Singapore landed property Get Earnings by means of Renting
  
  In its statement, the singapore property listing - website link, government claimed that the majority citizens buying their first residence won't be hurt by the new measures. Some concessions can even be prolonged to chose teams of consumers, similar to married couples with a minimum of one Singaporean partner who are purchasing their second property so long as they intend to promote their first residential property. Lower the LTV limit on housing loans granted by monetary establishments regulated by MAS from 70% to 60% for property purchasers who are individuals with a number of outstanding housing loans on the time of the brand new housing purchase. Singapore Property Measures - 30 August 2010 The most popular seek for the number of bedrooms in Singapore is 4, followed by 2 and three. Lush Acres EC @ Sengkang
  
  Discover out more about real estate funding in the area, together with info on international funding incentives and property possession. Many Singaporeans have been investing in property across the causeway in recent years, attracted by comparatively low prices. However, those who need to exit their investments quickly are likely to face significant challenges when trying to sell their property – and could finally be stuck with a property they can't sell. Career improvement programmes, in-house valuation, auctions and administrative help, venture advertising and marketing, skilled talks and traisning are continuously planned for the sales associates to help them obtain better outcomes for his or her shoppers while at Knight Frank Singapore. No change Present Rules
  
  Extending the tax exemption would help. The exemption, which may be as a lot as $2 million per family, covers individuals who negotiate a principal reduction on their existing mortgage, sell their house short (i.e., for lower than the excellent loans), or take part in a foreclosure course of. An extension of theexemption would seem like a common-sense means to assist stabilize the housing market, but the political turmoil around the fiscal-cliff negotiations means widespread sense could not win out. Home Minority Chief Nancy Pelosi (D-Calif.) believes that the mortgage relief provision will be on the table during the grand-cut price talks, in response to communications director Nadeam Elshami. Buying or promoting of blue mild bulbs is unlawful.
  
  A vendor's stamp duty has been launched on industrial property for the primary time, at rates ranging from 5 per cent to 15 per cent. The Authorities might be trying to reassure the market that they aren't in opposition to foreigners and PRs investing in Singapore's property market. They imposed these measures because of extenuating components available in the market." The sale of new dual-key EC models will even be restricted to multi-generational households only. The models have two separate entrances, permitting grandparents, for example, to dwell separately. The vendor's stamp obligation takes effect right this moment and applies to industrial property and plots which might be offered inside three years of the date of buy. JLL named Best Performing Property Brand for second year running
  
  The data offered is for normal info purposes only and isn't supposed to be personalised investment or monetary advice. Motley Fool Singapore contributor Stanley Lim would not personal shares in any corporations talked about. Singapore private home costs increased by 1.eight% within the fourth quarter of 2012, up from 0.6% within the earlier quarter. Resale prices of government-built HDB residences which are usually bought by Singaporeans, elevated by 2.5%, quarter on quarter, the quickest acquire in five quarters. And industrial property, prices are actually double the levels of three years ago. No withholding tax in the event you sell your property. All your local information regarding vital HDB policies, condominium launches, land growth, commercial property and more
  
  There are various methods to go about discovering the precise property. Some local newspapers (together with the Straits Instances ) have categorised property sections and many local property brokers have websites. Now there are some specifics to consider when buying a 'new launch' rental. Intended use of the unit Every sale begins with 10 p.c low cost for finish of season sale; changes to 20 % discount storewide; follows by additional reduction of fiftyand ends with last discount of 70 % or extra. Typically there is even a warehouse sale or transferring out sale with huge mark-down of costs for stock clearance. Deborah Regulation from Expat Realtor shares her property market update, plus prime rental residences and houses at the moment available to lease Esparina EC @ Sengkang
• 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
  
  My blog: http://www.primaboinca.com/view_profile.php?userid=5889534

• 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
  
  My blog: http://www.primaboinca.com/view_profile.php?userid=5889534

External links

• An interactive spreadsheet for teaching the forward–backward algorithm (spreadsheet and article with step-by-step walk-through)
• Tutorial of hidden Markov models including the forward–backward algorithm
• Collection of AI algorithms implemented in Java (including HMM and the forward–backward algorithm)