|
|
| Line 1: |
Line 1: |
| In [[linear algebra]], an '''orthogonal matrix''' is a [[square matrix]] with [[real number|real]] entries whose columns and rows are [[orthogonal]] [[unit vector]]s (i.e., [[orthonormality|orthonormal]] vectors). | | In addition to the above, certain kinds of allergies can also trigger Psoriasis. About 80 percent people have this type of psoriasis. Juice fasting present adequate power to carry on the fasting at the very same time nourishes the entire body and eliminate harmful toxins. In the warmer months, we wear less clothing and this allows our skin to breath. Psoriasis can occur on any part of the body and is associated with other serious health conditions, such as diabetes, heart disease and depression. <br><br>The normal cell growth of skin cells is twenty-eight days, which is how long it takes the skin to move from the bottom layer of skin to the top epidermis or outer layer of the skin. Such things happen because all of us really have some triggers which may result in a psoriasis break out. The causes can be - abnormality in the mechanism in which the skin grows and replaces itself; abnormality with the metabolism of amino acids; Use of certain medicines such as lithium, beta-blockers such as propranolol, quinidine (a heart medication) or antimalarial medications; Infections; Skin injury; Climatic change; Heredity factors and Physical and emotional stress. Scratching also injures the skin, which tends to worsen the psoriasis which causes many people to feel uncomfortable and embarrassed. Sometimes it will stay gone for a long long time, much longer than shaving or waxing. <br><br>Put the mixture in to a cup of sunflower oil and shake well. - on the place of the injury there appears a new psoriatic plaque. It has the capability to fulfill the deficiency of vitamins essential for the kidney and liver. - Excessive stress is another reason that may result in psoriasis. This herb may contain small amounts of pyrrolizidine alkaloids that can cause liver cancer. <br><br>However, with psoriasis, this happens in just few days, as cells rise quickly and pile up on the surface. A vastly crucial region of the book is detoxifying and the book supplies a step by step program for creating and applying all-natural home treatments that are able to assist get rid of the symptoms of the skin condition. In conditions of dehydration, your skin is not usually given biological importance under conditions that are extreme. Different studies show insulin requirement reductions of between 20% and 50% for those who take five grams of dried neem leaf capsules. Once the scale is reduced, other treatments can get to the psoriasis-affected skin much more effectively. <br><br>Produce a lotion by boiling 4 marigold heads in 4 cups of water and allowing it to cool. If you are addicted to cigarettes and alcohol, you may have pronounced symptoms of psoriasis. Drink teas or take capsules of sarsaparilla, milk thistle or nettle leaves. Everyone is at risk of getting psoriasis, especially young adults between the ages of fifteen to thirty. Article Source: for more information about treating common male organ health problems, including soreness, redness and loss of male organ sensation.<br><br>In case you have almost any issues relating to where by as well as the way to use treatment for psoriasis - [http://www.dominionradio.info/ www.dominionradio.info],, it is possible to e-mail us with the web-site. |
| | |
| Equivalently, a matrix ''Q'' is orthogonal if its [[transpose]] is equal to its [[inverse matrix|inverse]]:
| |
| :<math>Q^\mathrm{T}=Q^{-1}, \,</math>
| |
| which entails
| |
| :<math>Q^\mathrm{T} Q = Q Q^\mathrm{T} = I, \,</math>
| |
| where ''I'' is the [[identity matrix]].
| |
| | |
| An orthogonal matrix ''Q'' is necessarily [[Invertible matrix|invertible]] (with inverse {{nowrap|1=''Q''<sup>−1</sup> = ''Q''<sup>T</sup>}}), [[Unitary matrix|unitary]] ({{nowrap|1=''Q''<sup>−1</sup> = ''Q''*}}) and therefore [[Normal matrix|normal]] ({{nowrap|1=''Q''*''Q'' = ''QQ''*}}). The [[determinant]] of any orthogonal matrix is either +1 or −1. As a [[linear transformation]], an orthogonal matrix preserves the [[dot product]] of vectors, and therefore acts as an [[isometry]] of [[Euclidean space]], such as a [[Rotation (mathematics)|rotation]] or [[reflection (mathematics)|reflection]]. In other words, it is a [[unitary transformation]].
| |
| | |
| The set of ''n'' × ''n'' orthogonal matrices forms a [[group (mathematics)|group]] ''O''(''n''), known as the [[orthogonal group]]. The [[subgroup]] ''SO''(''n'') consisting of orthogonal matrices with [[determinant]] +1 is called the [[special orthogonal group]], and each of its elements is a '''special orthogonal matrix'''. As a linear transformation, every special orthogonal matrix acts as a rotation.
| |
| | |
| The [[complex number|complex]] analogue of an orthogonal matrix is a [[unitary matrix]].
| |
| | |
| ==Overview==
| |
| An orthogonal matrix is the real specialization of a [[unitary matrix]], and thus always a [[normal matrix]]. Although we consider only real matrices here, the definition can be used for matrices with entries from any [[field (mathematics)|field]]. However, orthogonal matrices arise naturally from [[dot product]]s, and for matrices of complex numbers that leads instead to the unitary requirement. Orthogonal matrices preserve the dot product,<ref>[http://tutorial.math.lamar.edu/Classes/LinAlg/OrthogonalMatrix.aspx "Paul's online math notes"]{{Citation broken|date=January 2013|note=See talk page.}}, Paul Dawkins, [[Lamar University]], 2008. Theorem 3(c)</ref> so, for vectors '''u''', '''v''' in an ''n''-dimensional real [[Euclidean space]]
| |
| | |
| :<math>{\bold u} \cdot {\bold v} = \left(Q {\bold u}\right) \cdot \left(Q {\bold v}\right) \, </math>
| |
| | |
| where ''Q'' is an orthogonal matrix. To see the inner product connection, consider a vector '''v''' in an ''n''-dimensional real [[Euclidean space]]. Written with respect to an orthonormal basis, the squared length of '''v''' is '''v'''<sup>T</sup>'''v'''. If a linear transformation, in matrix form ''Q'''''v''', preserves vector lengths, then
| |
| | |
| :<math>{\bold v}^\mathrm{T}{\bold v} = (Q{\bold v})^\mathrm{T}(Q{\bold v}) = {\bold v}^\mathrm{T} Q^\mathrm{T} Q {\bold v} .</math>
| |
| | |
| Thus [[dimension (vector space)|finite-dimensional]] linear [[isometry|isometries]]—rotations, reflections, and their combinations—produce orthogonal matrices. The converse is also true: orthogonal matrices imply orthogonal transformations. However, [[linear algebra]] includes orthogonal transformations between spaces which may be neither finite-dimensional nor of the same dimension, and these have no orthogonal matrix equivalent.
| |
| | |
| Orthogonal matrices are important for a number of reasons, both theoretical and practical. The ''n''×''n'' orthogonal matrices form a [[group (mathematics)|group]] under matrix multiplication, the [[orthogonal group]] denoted by ''O''(''n''), which—with its subgroups—is widely used in mathematics and the physical sciences. For example, the [[point group]] of a molecule is a subgroup of ''O''(3). Because floating point versions of orthogonal matrices have advantageous properties, they are key to many algorithms in numerical [[linear algebra]], such as [[QR decomposition]]. As another example, with appropriate normalization the [[discrete cosine transform]] (used in [[MP3]] compression) is represented by an orthogonal matrix.
| |
| | |
| ==Examples==
| |
| Below are a few examples of small orthogonal matrices and possible interpretations.
| |
| | |
| *<math>
| |
| \begin{bmatrix}
| |
| 1 & 0 \\
| |
| 0 & 1 \\
| |
| \end{bmatrix} \qquad (\text{identity transformation})</math>
| |
| | |
| An instance of a 2×2 [[rotation matrix]]:
| |
| | |
| *<math>
| |
| R(16.26^\circ) =
| |
| \begin{bmatrix}
| |
| \cos \theta & -\sin \theta \\
| |
| \sin \theta & \cos \theta \\
| |
| \end{bmatrix} = \begin{bmatrix}
| |
| 0.96 & -0.28 \\
| |
| 0.28 & \;\;\,0.96 \\
| |
| \end{bmatrix} \qquad (\text{rotation by }16.26^\circ )</math>
| |
| | |
| *<math>
| |
| \begin{bmatrix}
| |
| 1 & 0 \\
| |
| 0 & -1 \\
| |
| \end{bmatrix} \qquad (\text{reflection across }x\text{-axis})</math>
| |
| | |
| *<math>
| |
| \begin{bmatrix}
| |
| 0 & -0.80 & -0.60 \\
| |
| 0.80 & -0.36 & \;\;\,0.48 \\
| |
| 0.60 & \;\;\,0.48 & -0.64
| |
| \end{bmatrix} \qquad \left( \begin{align}&\text{rotoinversion:} \\&\text{axis }(0,-3/5,4/5),\text{ angle }90^{\circ}\end{align}\right)</math>
| |
| | |
| *<math>
| |
| \begin{bmatrix}
| |
| 0 & 0 & 0 & 1 \\
| |
| 0 & 0 & 1 & 0 \\
| |
| 1 & 0 & 0 & 0 \\
| |
| 0 & 1 & 0 & 0
| |
| \end{bmatrix} \qquad (\text{permutation of coordinate axes})</math>
| |
| | |
| ==Elementary constructions==
| |
| | |
| ===Lower dimensions===
| |
| The simplest orthogonal matrices are the 1×1 matrices [1] and [−1] which we can interpret as the identity and a reflection of the real line across the origin.
| |
| | |
| The 2×2 matrices have the form
| |
| | |
| :<math>\begin{bmatrix}
| |
| p & t\\
| |
| q & u
| |
| \end{bmatrix},</math>
| |
| | |
| which orthogonality demands satisfy the three equations
| |
| | |
| : <math>
| |
| \begin{align}
| |
| 1 & = p^2+t^2, \\
| |
| 1 & = q^2+u^2, \\
| |
| 0 & = pq+tu.
| |
| \end{align}
| |
| </math>
| |
| | |
| In consideration of the first equation, without loss of generality let ''p'' = cos ''θ'', ''q'' = sin ''θ''; then either ''t'' = −''q'', ''u'' = ''p'' or ''t'' = ''q'', ''u'' = −''p''. We can interpret the first case as a rotation by ''θ'' (where ''θ'' = 0 is the identity), and the second as a reflection across a line at an angle of ''θ''/2.
| |
| | |
| :<math>
| |
| \begin{bmatrix}
| |
| \cos \theta & -\sin \theta \\
| |
| \sin \theta & \cos \theta \\
| |
| \end{bmatrix}\text{ (rotation), }\qquad
| |
| \begin{bmatrix}
| |
| \cos \theta & \sin \theta \\
| |
| \sin \theta & -\cos \theta \\
| |
| \end{bmatrix}\text{ (reflection)}
| |
| </math>
| |
| | |
| The special case of the reflection matrix with ''θ''=90° generates a reflection about the line 45° line ''y=x'' and therefore exchanges ''x'' and ''y''; it is a [[permutation matrix]], with a single 1 in each column and row (and otherwise 0):
| |
| | |
| :<math>\begin{bmatrix}
| |
| 0 & 1\\
| |
| 1 & 0
| |
| \end{bmatrix}.</math>
| |
| | |
| The identity is also a permutation matrix.
| |
| | |
| A reflection is its own inverse, which implies that a reflection matrix is [[symmetric matrix|symmetric]] (equal to its transpose) as well as orthogonal. The product of two rotation matrices is a rotation matrix, and the product of two reflection matrices is also a rotation matrix.
| |
| | |
| ===Higher dimensions===
| |
| Regardless of the dimension, it is always possible to classify orthogonal matrices as purely rotational or not, but for 3×3 matrices and larger the non-rotational matrices can be more complicated than reflections. For example,
| |
| | |
| :<math>
| |
| \begin{bmatrix}
| |
| -1 & 0 & 0\\ | |
| 0 & -1 & 0\\
| |
| 0 & 0 & -1
| |
| \end{bmatrix}\text{ and }
| |
| \begin{bmatrix}
| |
| 0 & -1 & 0\\
| |
| 1 & 0 & 0\\
| |
| 0 & 0 & -1
| |
| \end{bmatrix}</math>
| |
| | |
| represent an ''[[Inversion in a point|inversion]]'' through the origin and
| |
| a ''[[improper rotation|rotoinversion]]'' about the ''z'' axis.
| |
| | |
| Rotations also become more complicated; they can no longer be completely characterized by an angle, and may affect more than one planar subspace. While it is common to describe a 3×3 rotation matrix in terms of an axis and angle, the existence of an axis is an accidental property of this dimension that applies in no other.
| |
| | |
| However, we have elementary building blocks for permutations, reflections, and rotations that apply in general.
| |
| | |
| ===Primitives===
| |
| The most elementary permutation is a transposition, obtained from the identity matrix by exchanging two rows. Any ''n''×''n'' permutation matrix can be constructed as a product of no more than ''n'' − 1 transpositions.
| |
| | |
| A [[Householder reflection]] is constructed from a non-null vector '''v''' as
| |
| | |
| :<math>Q = I - 2 {{\bold v}{\bold v}^\mathrm{T} \over {\bold v}^\mathrm{T}{\bold v}} .</math>
| |
| | |
| Here the numerator is a symmetric matrix while the denominator is a number, the squared magnitude of '''v'''. This is a reflection in the hyperplane perpendicular to '''v''' (negating any vector component parallel to '''v'''). If '''v''' is a unit vector, then ''Q'' = ''I'' − 2'''vv'''<sup>T</sup> suffices. A Householder reflection is typically used to simultaneously zero the lower part of a column. Any orthogonal matrix of size ''n''×''n'' can be constructed as a product of at most ''n'' such reflections.
| |
| | |
| A [[Givens rotation]] acts on a two-dimensional (planar) subspace spanned by two coordinate axes, rotating by a chosen angle. It is typically used to zero a single subdiagonal entry. Any rotation matrix of size ''n''×''n'' can be constructed as a product of at most ''n''(''n'' − 1)/2 such rotations. In the case of 3×3 matrices, three such rotations suffice; and by fixing the sequence we can thus describe all 3×3 rotation matrices (though not uniquely) in terms of the three angles used, often called [[Euler angles]].
| |
| | |
| A [[Jacobi rotation]] has the same form as a Givens rotation, but is used to zero both off-diagonal entries of a 2×2 symmetric submatrix.
| |
| | |
| ==Properties==
| |
| | |
| ===Matrix properties===
| |
| A real square matrix is orthogonal [[if and only if]] its columns form an [[orthonormal basis]] of the [[Euclidean space]] '''R'''<sup>''n''</sup> with the ordinary Euclidean [[dot product]], which is the case if and only if its rows form an orthonormal basis of '''R'''<sup>''n''</sup>. It might be tempting to suppose a matrix with orthogonal (not orthonormal) columns would be called an orthogonal matrix, but such matrices have no special interest and no special name; they only satisfy ''M''<sup>T</sup>''M'' = ''D'', with ''D'' a [[diagonal matrix]].
| |
| | |
| The [[determinant]] of any orthogonal matrix is +1 or −1. This follows from basic facts about determinants, as follows:
| |
| | |
| :<math>1=\det(I)=\det(Q^\mathrm{T}Q)=\det(Q^\mathrm{T})\det(Q)=(\det(Q))^2\,\! .</math>
| |
| | |
| The converse is not true; having a determinant of +1 is no guarantee of orthogonality, even with orthogonal columns, as shown by the following counterexample.
| |
| | |
| :<math>\begin{bmatrix}
| |
| 2 & 0 \\
| |
| 0 & \frac{1}{2}
| |
| \end{bmatrix}</math>
| |
| | |
| With permutation matrices the determinant matches the [[even and odd permutations|signature]], being +1 or −1 as the parity of the permutation is even or odd, for the determinant is an alternating function of the rows.
| |
| | |
| Stronger than the determinant restriction is the fact that an orthogonal matrix can always be [[diagonalizable matrix|diagonalized]] over the [[complex number]]s to exhibit a full set of [[Eigenvalues and eigenvectors|eigenvalues]], all of which must have (complex) [[absolute value|modulus]] 1.
| |
| | |
| ===Group properties===
| |
| The inverse of every orthogonal matrix is again orthogonal, as is the matrix product of two orthogonal matrices. In fact, the set of all ''n''×''n'' orthogonal matrices satisfies all the axioms of a [[group (mathematics)|group]]. It is a [[compact space|compact]] [[Lie group]] of dimension ''n''(''n'' − 1)/2, called the [[orthogonal group]] and denoted by ''O''(''n'').
| |
| | |
| The orthogonal matrices whose determinant is +1 form a [[connected space|path-connected]] [[normal subgroup]] of ''O''(''n'') of [[index of a subgroup|index]] 2, the [[special orthogonal group]] ''SO''(''n'') of [[rotation]]s. The [[quotient group]] ''O''(''n'')/''SO''(''n'') is isomorphic to ''O''(1), with the projection map choosing [+1] or [−1] according to the determinant. Orthogonal matrices with determinant −1 do not include the identity, and so do not form a subgroup but only a [[coset]]; it is also (separately) connected. Thus each orthogonal group falls into two pieces; and because the projection map [[exact sequence|splits]], ''O''(''n'') is a [[semidirect product]] of ''SO''(''n'') by ''O''(1). In practical terms, a comparable statement is that any orthogonal matrix can be produced by taking a rotation matrix and possibly negating one of its columns, as we saw with 2×2 matrices. If ''n'' is odd, then the semidirect product is in fact a [[direct product of groups|direct product]], and any orthogonal matrix can be produced by taking a rotation matrix and possibly negating all of its columns. This follows from the property of determinants that negating a column negates the determinant, and thus negating an odd (but not even) number of columns negates the determinant.
| |
| | |
| Now consider (''n''+1)×(''n''+1) orthogonal matrices with bottom right entry equal to 1. The remainder of the last column (and last row) must be zeros, and the product of any two such matrices has the same form. The rest of the matrix is an ''n''×''n'' orthogonal matrix; thus ''O''(''n'') is a subgroup of ''O''(''n'' + 1) (and of all higher groups).
| |
| | |
| :<math>\begin{bmatrix}
| |
| & & & 0\\
| |
| & O(n) & & \vdots\\
| |
| & & & 0\\
| |
| 0 & \cdots & 0 & 1
| |
| \end{bmatrix}
| |
| </math> | |
| | |
| Since an elementary reflection in the form of a Householder matrix can reduce any orthogonal matrix to this constrained form, a series of such reflections can bring any orthogonal matrix to the identity; thus an orthogonal group is a [[reflection group]]. The last column can be fixed to any unit vector, and each choice gives a different copy of ''O''(''n'') in ''O''(''n''+1); in this way ''O''(''n''+1) is a [[fiber bundle|bundle]] over the unit sphere ''S''<sup>''n''</sup> with fiber ''O''(''n'').
| |
| | |
| Similarly, ''SO''(''n'') is a subgroup of ''SO''(''n''+1); and any special orthogonal matrix can be generated by Givens plane rotations using an analogous procedure. The bundle structure persists: ''SO''(''n'') ↪ ''SO''(''n''+1) → ''S''<sup>''n''</sup>. A single rotation can produce a zero in the first row of the last column, and series of ''n''−1 rotations will zero all but the last row of the last column of an ''n''×''n'' rotation matrix. Since the planes are fixed, each rotation has only one degree of freedom, its angle. By induction, ''SO''(''n'') therefore has
| |
| | |
| :<math>(n-1) + (n-2) + \cdots + 1 = n(n-1)/2</math>
| |
| | |
| degrees of freedom, and so does ''O''(''n'').
| |
| | |
| Permutation matrices are simpler still; they form, not a Lie group, but only a finite group, the order ''n''! [[symmetric group]] ''S''<sub>''n''</sub>. By the same kind of argument, ''S''<sub>''n''</sub> is a subgroup of ''S''<sub>''n''+1</sub>. The even permutations produce the subgroup of permutation matrices of determinant +1, the order ''n''!/2 [[alternating group]].
| |
| | |
| ===Canonical form===
| |
| More broadly, the effect of any orthogonal matrix separates into independent actions on orthogonal two-dimensional subspaces. That is, if ''Q'' is special orthogonal then one can always find an orthogonal matrix ''P'', a (rotational) change of basis, that brings ''Q'' into block diagonal form:
| |
| | |
| :<math>P^{T}QP = \begin{bmatrix}
| |
| R_1 & & \\ & \ddots & \\ & & R_k
| |
| \end{bmatrix}\ (n\text{ even}),\ P^{T}QP = \begin{bmatrix}
| |
| R_1 & & & \\ & \ddots & & \\ & & R_k & \\ & & & 1
| |
| \end{bmatrix}\ (n\text{ odd}).</math>
| |
| | |
| where the matrices ''R''<sub>1</sub>,...,''R''<sub>''k''</sub> are 2×2 rotation matrices, and with the remaining entries zero. Exceptionally, a rotation block may be diagonal, ±''I''. Thus, negating one column if necessary, and noting that a 2×2 reflection diagonalizes to a +1 and −1, any orthogonal matrix can be brought to the form
| |
| | |
| :<math>P^{T}QP = \begin{bmatrix}
| |
| \begin{matrix}R_1 & & \\ & \ddots & \\ & & R_k\end{matrix} & 0 \\
| |
| 0 & \begin{matrix}\pm 1 & & \\ & \ddots & \\ & & \pm 1\end{matrix} \\
| |
| \end{bmatrix},</math>
| |
| | |
| The matrices ''R''<sub>1</sub>,...,''R''<sub>''k''</sub> give conjugate pairs of eigenvalues lying on the unit circle in the [[complex number|complex plane]]; so this decomposition confirms that all [[Eigenvalues and eigenvectors|eigenvalues]] have [[absolute value]] 1. If ''n'' is odd, there is at least one real eigenvalue, +1 or −1; for a 3×3 rotation, the eigenvector associated with +1 is the rotation axis.
| |
| | |
| ===Lie algebra===
| |
| Suppose the entries of ''Q'' are differentiable functions of ''t'', and that ''t'' = 0 gives ''Q'' = ''I''. Differentiating the orthogonality condition
| |
| | |
| :<math>Q^\mathrm{T} Q = I \,\!</math>
| |
| | |
| yields
| |
| | |
| :<math>\dot{Q}^\mathrm{T} Q + Q^\mathrm{T} \dot{Q} = 0</math>
| |
| | |
| Evaluation at ''t'' = 0 (''Q'' = ''I'') then implies
| |
| | |
| :<math>\dot{Q}^\mathrm{T} = -\dot{Q} .</math>
| |
| | |
| In Lie group terms, this means that the [[Lie algebra]] of an orthogonal matrix group consists of [[skew-symmetric matrix|skew-symmetric matrices]]. Going the other direction, the [[matrix exponential]] of any skew-symmetric matrix is an orthogonal matrix (in fact, special orthogonal).
| |
| | |
| For example, the three-dimensional object physics calls [[angular velocity]] is a differential rotation, thus a vector in the Lie algebra <math>\mathfrak{so}(3)</math> tangent to ''SO''(3). Given '''ω''' = (''x''θ,''y''θ,''z''θ), with '''v''' = (''x'',''y'',''z'') a unit vector, the correct skew-symmetric matrix form of '''ω''' is
| |
| | |
| :<math>
| |
| \Omega = \begin{bmatrix}
| |
| 0 & -z\theta & y\theta \\
| |
| z\theta & 0 & -x\theta \\
| |
| -y\theta & x\theta & 0
| |
| \end{bmatrix} .</math>
| |
| | |
| The exponential of this is the orthogonal matrix for rotation around axis '''v''' by angle θ; setting ''c'' = cos θ/2, ''s'' = sin θ/2,
| |
| | |
| :<math>
| |
| \exp(\Omega) =
| |
| \begin{bmatrix}
| |
| 1 - 2s^2 + 2x^2 s^2 & 2xy s^2 - 2z sc & 2xz s^2 + 2y sc\\
| |
| 2xy s^2 + 2z sc & 1 - 2s^2 + 2y^2 s^2 & 2yz s^2 - 2x sc\\
| |
| 2xz s^2 - 2y sc & 2yz s^2 + 2x sc & 1 - 2s^2 + 2z^2 s^2
| |
| \end{bmatrix}
| |
| .</math>
| |
| | |
| ==Numerical linear algebra==
| |
| | |
| ===Benefits===
| |
| [[Numerical analysis]] takes advantage of many of the properties of orthogonal matrices for numerical [[linear algebra]], and they arise naturally. For example, it is often desirable to compute an orthonormal basis for a space, or an orthogonal change of bases; both take the form of orthogonal matrices. Having determinant ±1 and all eigenvalues of magnitude 1 is of great benefit for [[numeric stability]]. One implication is that the [[condition number]] is 1 (which is the minimum), so errors are not magnified when multiplying with an orthogonal matrix. Many algorithms use orthogonal matrices like [[Householder reflection]]s and [[Givens rotation]]s for this reason. It is also helpful that, not only is an orthogonal matrix invertible, but its inverse is available essentially free, by exchanging indices.
| |
| | |
| Permutations are essential to the success of many algorithms, including the workhorse [[Gaussian elimination]] with [[Pivot element#Partial and complete pivoting |partial pivoting]] (where permutations do the pivoting). However, they rarely appear explicitly as matrices; their special form allows more efficient representation, such as a list of ''n'' indices.
| |
| | |
| Likewise, algorithms using Householder and Givens matrices typically use specialized methods of multiplication and storage. For example, a Givens rotation affects only two rows of a matrix it multiplies, changing a full [[matrix multiplication|multiplication]] of order ''n''<sup>3</sup> to a much more efficient order ''n''. When uses of these reflections and rotations introduce zeros in a matrix, the space vacated is enough to store sufficient data to reproduce the transform, and to do so robustly. (Following {{harvtxt|Stewart|1976}}, we do ''not'' store a rotation angle, which is both expensive and badly behaved.)
| |
| | |
| ===Decompositions===
| |
| A number of important [[matrix decomposition]]s {{harv|Golub|Van Loan|1996}} involve orthogonal matrices, including especially:
| |
| | |
| :;[[QR decomposition]]: ''M'' = ''QR'', ''Q'' orthogonal, ''R'' upper triangular.
| |
| :;[[Singular value decomposition]]: ''M'' = ''UΣV''<sup>T</sup>, ''U'' and ''V'' orthogonal, ''Σ'' non-negative diagonal.
| |
| :;[[Eigendecomposition of a matrix|Eigendecomposition of a symmetric matrix]] (Decomposition according to [[Spectral theorem]]): ''S'' = ''QΛQ''<sup>T</sup>, ''S'' symmetric, ''Q'' orthogonal, ''Λ'' diagonal.
| |
| :;[[Polar decomposition]]: ''M'' = ''QS'', ''Q'' orthogonal, ''S'' symmetric non-negative definite. | |
| | |
| ====Examples====
| |
| Consider an [[overdetermined system of linear equations]], as might occur with repeated measurements of a physical phenomenon to compensate for experimental errors. Write ''A'''''x''' = '''b''', where ''A'' is ''m''×''n'', ''m'' > ''n''.
| |
| A QR decomposition reduces ''A'' to upper triangular ''R''. For example, if ''A'' is 5×3 then ''R'' has the form
| |
| | |
| :<math>R = \begin{bmatrix}
| |
| \star & \star & \star \\
| |
| 0 & \star & \star \\
| |
| 0 & 0 & \star \\
| |
| 0 & 0 & 0 \\
| |
| 0 & 0 & 0
| |
| \end{bmatrix}.</math>
| |
| | |
| The [[linear least squares (mathematics)|linear least squares]] problem is to find the '''x''' that minimizes ‖''A'''''x''' − '''b'''‖, which is equivalent to projecting '''b''' to the subspace spanned by the columns of ''A''. Assuming the columns of ''A'' (and hence ''R'') are independent, the projection solution is found from ''A''<sup>T</sup>''A'''''x''' = ''A''<sup>T</sup>'''b'''. Now ''A''<sup>T</sup>''A'' is square (''n''×''n'') and invertible, and also equal to ''R''<sup>T</sup>''R''. But the lower rows of zeros in ''R'' are superfluous in the product, which is thus already in lower-triangular upper-triangular factored form, as in [[Gaussian elimination]] ([[Cholesky decomposition]]). Here orthogonality is important not only for reducing ''A''<sup>T</sup>''A'' = (''R''<sup>T</sup>''Q''<sup>T</sup>)''QR'' to ''R''<sup>T</sup>''R'', but also for allowing solution without magnifying numerical problems.
| |
| | |
| In the case of a linear system which is underdetermined, or an otherwise non-[[invertible matrix]], singular value decomposition (SVD) is equally useful. With ''A'' factored as ''UΣV''<sup>T</sup>, a satisfactory solution uses the Moore-Penrose [[pseudoinverse]], ''VΣ''<sup>+</sup>''U''<sup>T</sup>, where ''Σ''<sup>+</sup> merely replaces each non-zero diagonal entry with its reciprocal. Set '''x''' to ''VΣ''<sup>+</sup>''U''<sup>T</sup>'''b'''. | |
| | |
| The case of a square invertible matrix also holds interest. Suppose, for example, that ''A'' is a 3×3 rotation matrix which has been computed as the composition of numerous twists and turns. Floating point does not match the mathematical ideal of real numbers, so ''A'' has gradually lost its true orthogonality. A [[Gram-Schmidt process]] could [[orthogonalization|orthogonalize]] the columns, but it is not the most reliable, nor the most efficient, nor the most invariant method. The [[polar decomposition]] factors a matrix into a pair, one of which is the unique ''closest'' orthogonal matrix to the given matrix, or one of the closest if the given matrix is singular. (Closeness can be measured by any [[matrix norm]] invariant under an orthogonal change of basis, such as the spectral norm or the Frobenius norm.) For a near-orthogonal matrix, rapid convergence to the orthogonal factor can be achieved by a "[[Newton's method]]" approach due to {{harvtxt|Higham|1986}} ([[#CITEREFHigham1990|1990]]), repeatedly averaging the matrix with its inverse transpose. {{harvtxt|Dubrulle|1994}} has published an accelerated method with a convenient convergence test.
| |
| | |
| For example, consider a non-orthogonal matrix for which the simple averaging algorithm takes seven steps
| |
| | |
| :<math>\begin{bmatrix}3 & 1\\7 & 5\end{bmatrix}
| |
| \rightarrow
| |
| \begin{bmatrix}1.8125 & 0.0625\\3.4375 & 2.6875\end{bmatrix}
| |
| \rightarrow \cdots \rightarrow
| |
| \begin{bmatrix}0.8 & -0.6\\0.6 & 0.8\end{bmatrix}</math>
| |
| | |
| and which acceleration trims to two steps (with γ = 0.353553, 0.565685).
| |
| | |
| :<math>\begin{bmatrix}3 & 1\\7 & 5\end{bmatrix}
| |
| \rightarrow
| |
| \begin{bmatrix}1.41421 & -1.06066\\1.06066 & 1.41421\end{bmatrix}
| |
| \rightarrow
| |
| \begin{bmatrix}0.8 & -0.6\\0.6 & 0.8\end{bmatrix}</math>
| |
| | |
| Gram-Schmidt yields an inferior solution, shown by a Frobenius distance of 8.28659 instead of the minimum 8.12404.
| |
| | |
| :<math>\begin{bmatrix}3 & 1\\7 & 5\end{bmatrix}
| |
| \rightarrow
| |
| \begin{bmatrix}0.393919 & -0.919145\\0.919145 & 0.393919\end{bmatrix}</math>
| |
| | |
| ===Randomization===
| |
| Some numerical applications, such as [[Monte Carlo method]]s and exploration of high-dimensional data spaces, require generation of [[uniform distribution (continuous)|uniformly distributed]] random orthogonal matrices. In this context, "uniform" is defined in terms of [[Haar measure]], which essentially requires that the distribution not change if multiplied by any freely chosen orthogonal matrix. Orthogonalizing matrices with [[statistical independence|independent]] uniformly distributed random entries does not result in uniformly distributed orthogonal matrices{{Citation needed|date=June 2009}}, but the [[QR decomposition]] of independent [[normal distribution|normally distributed]] random entries does, as long as the diagonal of ''R'' contains only positive entries. {{harvtxt|Stewart|1980}} replaced this with a more efficient idea that {{harvtxt|Diaconis|Shahshahani|1987}} later generalized as the "subgroup algorithm" (in which form it works just as well for permutations and rotations). To generate an (''n'' + 1)×(''n'' + 1) orthogonal matrix, take an ''n''×''n'' one and a uniformly distributed unit vector of dimension ''n'' + 1. Construct a Householder reflection from the vector, then apply it to the smaller matrix (embedded in the larger size with a 1 at the bottom right corner).
| |
| | |
| ===Nearest orthogonal matrix===
| |
| | |
| The problem of finding the orthogonal matrix <math>Q</math> nearest a given matrix <math>M</math> is related to the [[Orthogonal Procrustes problem]]. There are several different ways to get the unique solution, the simplest of which is taking the [[singular value decomposition]] of <math>M</math> and replacing the singular values with ones. Another method expresses the <math>R</math> explicitly but requires the use of a [[matrix square root]]:<ref>[http://people.csail.mit.edu/bkph/articles/Nearest_Orthonormal_Matrix.pdf "Finding the Nearest Orthonormal Matrix"], Berthold K. P. Horn, [[MIT]].</ref>
| |
| | |
| :<math>Q = M (M^\mathrm{T} M)^{-\frac 1 2}</math>
| |
| | |
| This may be combined with the Babylonian method for extracting the square root of a matrix to give a recurrence which converges to an orthogonal matrix quadratically:
| |
| | |
| :<math>Q_{n + 1} = 2 M (Q_n^{-1} M + M^\mathrm{T} Q_n)^{-1}</math>
| |
| | |
| where <math>Q_0 = M</math>. These iterations are stable provided the [[condition number]] of <math>M</math> is less than three.<ref>[http://www.maths.manchester.ac.uk/~nareports/narep91.pdf "Newton's Method for the Matrix Square Root"], Nicholas J. Higham, Mathematics of Computation, Volume 46, Number 174, 1986.</ref>
| |
| | |
| ==Spin and Pin==
| |
| A subtle technical problem afflicts some uses of orthogonal matrices. Not only are the group components with determinant +1 and −1 not [[Connected space|connected]] to each other, even the +1 component, ''SO''(''n''), is not [[simply connected space|simply connected]] (except for ''SO''(1), which is trivial). Thus it is sometimes advantageous, or even necessary, to work with a [[covering map|covering group]] of ''SO''(''n''), the [[spinor group|spin group]], Spin(''n''). Likewise, ''O''(''n'') has covering groups, the [[pin group]]s, Pin(''n''). For ''n'' > 2, Spin(''n'') is simply connected, and thus the universal covering group for ''SO''(''n''). By far the most famous example of a spin group is Spin(3), which is nothing but SU(2), or the group of unit [[quaternion]]s.
| |
| | |
| The Pin and Spin groups are found within [[Clifford algebra]]s, which themselves can be built from orthogonal matrices.
| |
| | |
| ==Rectangular matrices==
| |
| If ''Q'' is not a square matrix, then the conditions ''Q''<sup>T</sup>''Q'' = ''I'' and ''QQ''<sup>T</sup> = ''I'' are not equivalent. The condition ''Q''<sup>T</sup>''Q'' = ''I'' says that the columns of ''Q'' are orthonormal. This can only happen if ''Q'' is an ''m''×''n'' matrix with ''n'' ≤ ''m''. Similarly, ''QQ''<sup>T</sup> = ''I'' says that the rows of ''Q'' are orthonormal, which requires ''n'' ≥ ''m''.
| |
| | |
| There is no standard terminology for these matrices. They are sometimes called "orthonormal matrices", sometimes "orthogonal matrices", and sometimes simply "matrices with orthonormal rows/columns".
| |
| | |
| ==See also==
| |
| *[[Orthogonal group]]
| |
| *[[Coordinate rotation]]
| |
| *[[Unitary matrix]]
| |
| *[[Symplectic matrix]]
| |
| *[[Skew-symmetric matrix]], a matrix whose transpose is its negative
| |
| | |
| ==Notes==
| |
| {{Reflist}}
| |
| | |
| ==References==
| |
| <!-- Using [[WP:CITET]] -->
| |
| * {{citation
| |
| | last1 = Diaconis
| |
| | first1 = Persi
| |
| | authorlink1 = Persi Diaconis
| |
| | first2 = Mehrdad |last2= Shahshahani
| |
| | title = The subgroup algorithm for generating uniform random variables
| |
| | journal = Prob. In Eng. And Info. Sci.
| |
| | volume = 1
| |
| | pages = 15–32
| |
| | year = 1987
| |
| | issn = 0269-9648
| |
| | doi = 10.1017/S0269964800000255 }}
| |
| * {{citation
| |
| | last= Dubrulle
| |
| | first=Augustin A.
| |
| | title = An Optimum Iteration for the Matrix Polar Decomposition
| |
| | journal = Elect. Trans. Num. Anal.
| |
| | volume = 8
| |
| | pages = 21–25
| |
| | year = 1999
| |
| | url = http://etna.mcs.kent.edu/}}
| |
| * {{citation
| |
| | last1 = Golub
| |
| | first1 = Gene H.
| |
| | authorlink1 = Gene H. Golub
| |
| | first2 = Charles F.|last2=Van Loan|authorlink2=Charles F. Van Loan
| |
| | title = Matrix Computations
| |
| | edition = 3/e
| |
| | publisher = Johns Hopkins University Press
| |
| | year = 1996
| |
| | location = Baltimore
| |
| | isbn = 978-0-8018-5414-9 }}
| |
| * {{citation
| |
| | last = Higham
| |
| | first = Nicholas
| |
| | authorlink = Nicholas Higham
| |
| | title = Computing the Polar Decomposition—with Applications
| |
| | journal = SIAM Journal on Scientific and Statistical Computing
| |
| | volume = 7
| |
| | issue = 4
| |
| | pages = 1160–1174
| |
| | year = 1986
| |
| | url = http://locus.siam.org/SISC/volume-07/art_0907079.html
| |
| | issn = 0196-5204
| |
| | doi = 10.1137/0907079 }}
| |
| * {{citation
| |
| | last1 = Higham
| |
| | first1 = Nicholas
| |
| | authorlink1 = Nicholas Higham
| |
| | first2 = Robert |last2=Schreiber
| |
| | title = Fast polar decomposition of an arbitrary matrix
| |
| | journal = SIAM Journal on Scientific and Statistical Computing
| |
| | volume = 11
| |
| | issue = 4
| |
| | pages = 648–655
| |
| | date = July 1990
| |
| | url = http://locus.siam.org/SISC/volume-11/art_0911038.html
| |
| | issn = 0196-5204
| |
| | doi = 10.1137/0911038 }} [http://www.ma.man.ac.uk/~higham/pap-mf.html]
| |
| * {{citation
| |
| | last = Stewart
| |
| | first = G. W.
| |
| | authorlink = G. W. Stewart
| |
| | title = The Economical Storage of Plane Rotations
| |
| | journal = Numerische Mathematik
| |
| | volume = 25
| |
| | issue = 2
| |
| | pages = 137–138
| |
| | year = 1976
| |
| | doi = 10.1007/BF01462266
| |
| | issn = 0029-599X }}
| |
| * {{citation
| |
| | last = Stewart
| |
| | first = G. W.
| |
| | authorlink = G. W. Stewart
| |
| | title = The Efficient Generation of Random Orthogonal Matrices with an Application to Condition Estimators
| |
| | journal = SIAM J. Numer. Anal.
| |
| | volume = 17
| |
| | issue = 3
| |
| | pages = 403–409
| |
| | year = 1980
| |
| | issn = 0036-1429
| |
| | doi = 10.1137/0717034 }}
| |
| <!--
| |
| * [[Persi Diaconis]], Mehrdad Shahshahani. The subgroup algorithm for generating uniform random variables. '' Prob. in Eng. and Info. Sci.'', vol. 1, 15–32, 1987. ISSN 0269-9648.
| |
| * Augustin A. Dubrulle. ''Frobenius Iteration for the Matrix Polar Decomposition''. HP Labs Technical Report HPL-94-117. December 16, 1994. [http://www.hpl.hp.com/techreports/94/HPL-94-117.html]
| |
| * [[Gene H. Golub]], [[Charles F. Van Loan]]. ''Matrix Computations, 3/e''. Johns Hopkins University Press, Baltimore, 1996. ISBN 978-0-8018-5414-9.
| |
| * [[Nicholas Higham]]. Computing the Polar Decomposition—with Applications. ''SIAM Journal on Scientific and Statistical Computing'', 7(4):1160–1174, 1986. ISSN 0196-5204. [http://locus.siam.org/SISC/volume-07/art_0907079.html]
| |
| * {{citation|first1=Nicholas|last1=Higham|authorlink2=Nicholas Higham|first2=Robert|last2=Schreiber|title=Fast polar decomposition of an arbitrary matrix|journal=SIAM Journal on Scientific and Statistical Computing|volume=11|issue=4|pages=648–655|year=1990|url=http://locus.siam.org/SISC/volume-11/art_0911038.html|doi=10.1137/0911038}}; [http://www.ma.man.ac.uk/~higham/pap-mf.html].
| |
| * {{citation|first=G. W.|last=Stewart|title=The Economical Storage of Plane Rotations|journal=Numerische Mathematik|volume=25|issue=2|pages=137–138|year=1976|doi=10.1007/BF01462266}}.
| |
| * {{citation|first=G. W.|last=Stewart|title=The Efficient Generation of Random Orthogonal Matrices with an Application to Condition Estimation|journal=SIAM J. Numer. Anal.|volume=17|issue=3|pages=403–409|year=1980|doi=10.1137/0717034}}.
| |
| -->
| |
| | |
| ==External links==
| |
| * {{springer|title=Orthogonal matrix|id=p/o070320}}
| |
| * [http://people.revoledu.com/kardi/tutorial/LinearAlgebra/MatrixOrthogonal.html Tutorial and Interactive Program on Orthogonal Matrix]
| |
| | |
| [[Category:Matrices]]
| |