[Go to site: main page, start]

TOPICS
Search

Singular Value Decomposition


The singular value decomposition of an m×n real matrix A is a factorization

 A=UDV^T.
(1)

In the full decomposition, U is an m×m orthogonal matrix, V is an n×n orthogonal matrix, and D is an m×n diagonal matrix whose diagonal entries are the nonnegative singular values of A.

There are several notational conventions in use. A reduced decomposition uses p=min(m,n) and takes U to be m×p, D to be p×p, and V to be n×p. In either convention, the columns retained in U and V are orthonormal, so that

 U^TU=I
(2)

and

 V^TV=I
(3)

for the appropriate identity matrices (Golub and Van Loan 1996, pp. 70-71).

For a complex matrix A, the singular value decomposition is a decomposition into the form

 A=UDV^H,
(4)

where U and V are unitary matrices, V^H is the conjugate transpose of V, and D again has nonnegative singular values on its diagonal. Such a decomposition exists for every real or complex rectangular matrix.

When A is the coefficient matrix of a vector in a tensor product of two Hilbert spaces, its singular value decomposition gives the Schmidt decomposition of that vector.

Singular value decomposition is implemented in the Wolfram Language as SingularValueDecomposition[m], which returns a list {U, D, V}, where U and V are matrices and D is a diagonal matrix made up of the singular values of m.


See also

Cholesky Decomposition, Eigen Decomposition, Eigen Decomposition Theorem, Eigenvalue, Eigenvector, LU Decomposition, Matrix Decomposition, QR Decomposition, Schmidt Decomposition, Singular Value, Unitary Matrix

Explore with Wolfram|Alpha

References

Gentle, J. E. "Singular Value Factorization." §3.2.7 in Numerical Linear Algebra for Applications in Statistics. Berlin: Springer-Verlag, pp. 102-103, 1998.Golub, G. H. and Van Loan, C. F. "The Singular Value Decomposition" and "Unitary Matrices." §2.5.3 and 2.5.6 in Matrix Computations, 3rd ed. Baltimore, MD: Johns Hopkins University Press, pp. 70-71 and 73, 1996.Nash, J. C. "The Singular-Value Decomposition and Its Use to Solve Least-Squares Problems." Ch. 3 in Compact Numerical Methods for Computers: Linear Algebra and Function Minimisation, 2nd ed. Bristol, England: Adam Hilger, pp. 30-48, 1990.Press, W. H.; Flannery, B. P.; Teukolsky, S. A.; and Vetterling, W. T. "Singular Value Decomposition." §2.6 in Numerical Recipes in FORTRAN: The Art of Scientific Computing, 2nd ed. Cambridge, England: Cambridge University Press, pp. 51-63, 1992.

Referenced on Wolfram|Alpha

Singular Value Decomposition

Cite this as:

Weisstein, Eric W. "Singular Value Decomposition." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/SingularValueDecomposition.html

Subject classifications