PlanetMath (more info)
 Math for the people, by the people. Sponsor PlanetMath
Encyclopedia | Requests | Forums | Docs | Wiki | Random | RSS  
Login
create new user
name:
pass:
forget your password?
Main Menu
Owner confidence rating: Low Entry average rating: No information on entry rating
[parent] proof of existence and uniqueness of singular value decomposition (Proof)
Proof. To prove existence of the SVD, we isolate the direction of the largest action of $A \in \C^{m \times n}$ , and then proceed by induction on the dimension of $A$ . We will denote hermitian conjugation by $^T$ . Norms for vectors in $\C^n$ will be the usual euclidean 2-norm $\norm{\cdot }=\norm{\cdot}_2$ and for matrix the induced by norm of vectors.

Let $\sigma_1=\norm{A}$ . By a compactness argument, there must be vectors $v_1 \in \C^n, u^*_1 \in \C^m$ with $\norm{v_1}=1, \norm{u^*_1}=\sigma_1$ and $u^*_1=Av_1$ . Normalize $u^*_1$ by setting $u_1=u^*_1 / \norm{u^*_1}$ and consider any extensions of $v_1$ to an orthonormal basis $\{v_i\}$ of $\C^n$ and of $u_1$ to an orthonormal basis $\{u_j\}$ of $\C^m$ ; let $U_1$ and $V_1$ denote the unitary matrices with columns $\{v_i\}$ and $\{u_j\}$ respectively. Then we have

$\displaystyle U^T_1AV_1=S=\left( \begin{array}{cc} \sigma_1 & w^T \ 0 & B \ \end{array} \right)$

where $0$ is a column vector of dimension $m-1$ , $w^T$ is a row vector of dimension $n-1$ , and $B$ is a matrix of dimension $(m-1) \times (n-1)$ . Now,

$\displaystyle \left\Vert\left( \begin{array}{cc} \sigma_1 & w^T \ 0 & B \ \... ...\left\Vert\left( \begin{array}{c} \sigma_1 \\ w \end{array} \right)\right\Vert $

so that $\norm{S} \geq (\sigma_1^2+w^2)^{1/2}$ . But $U_1$ and $V_1$ are unitary matrix, hence $\norm{S}=\sigma_1$ ; it therefore implies $w=0$ .

If $n=1$ or $m=1$ we are done. Otherwise the submatrix $B$ describes the action of $A$ on the subspace orthogonal to $v_1$ . By the induction hypothesis $B$ has an SVD $B=U_2 \Sigma_2 V^T_2$ . Now it is easily verified that

$\displaystyle A=U_1 \left( \begin{array}{cc} 1 & 0 \\ 0 & U_2 \\ \end{array} \r... ...\right) \left( \begin{array}{cc} 1 & 0 \\ 0 & V_2 \\ \end{array}\right)^T V_1^T$

is an SVD of $A$ . completing the proof of existence.

For the uniqueness let $A=U \Sigma V^T$ a SVD for $A$ and let $e_i$ denote the i-th, $i=1 \cdots min(m,n)$ vector of the canonical base of $\C^n$ . As $U$ and $V$ are unitary, $\norm{Ae_i}=\sigma_i^2$ , so each $\sigma_i$ is uniquely determined.

$ \qedsymbol$




"proof of existence and uniqueness of singular value decomposition" is owned by fernsanz.
(view preamble | get metadata)

View style:


This object's parent.
Log in to rate this entry.
(view current ratings)

Cross-references: unitary, base, canonical, proof, induction hypothesis, orthogonal, subspace, submatrix, implies, row vector, column vector, columns, unitary matrices, orthonormal basis, extensions, normalize, argument, compactness, induced, matrix, Euclidean, vectors, norms, conjugation, Hermitian, dimension, induction, action, SVD

This is version 9 of proof of existence and uniqueness of singular value decomposition, born on 2007-05-22, modified 2007-12-07.
Object id is 9434, canonical name is ProofOfExistenceAndUniquenessOfSVD.
Accessed 1942 times total.

Classification:
AMS MSC15-00 (Linear and multilinear algebra; matrix theory :: General reference works )
 65-00 (Numerical analysis :: General reference works )

Pending Errata and Addenda
None.
[ View all 4 ]
Discussion
Style: Expand: Order:
forum policy

No messages.

Interact
post | correct | update request | add example | add (any)