Linear algebraLesson 1 of 2 in the course Eigenvalues and eigenvectors

Singular Value Decomposition: Geometry, Rank, and Applications

5 flashcards · 5 quiz questions · 5 match pairs · 4 fill-in sentences · English

Lesson progress
0 / 5

Your progress is kept in this browser only.Sign up to save it

Summary

For an m×nm \times n complex matrix MM, the SVD has the form

Here, UU is an m×mm \times m unitary matrix, VV is an n×nn \times n unitary matrix, and V∗V^* is the conjugate transpose of VV. The matrix Σ\Sigma is an m×nm \times n rectangular diagonal matrix: its only potentially nonzero entries lie on its main diagonal, and those entries are non-negative real numbers.

All flashcards

How can a matrix be expressed as a sum of rank-one terms using its SVD?
For rank rr, M=∑i=1rσiuivi∗M=\sum_{i=1}^{r}\sigma_i u_i v_i^*, where each term is a weighted outer product.
How are singular values related to M∗MM^*M?
The nonzero singular values of MM are the non-negative square roots of the nonzero eigenvalues of M∗MM^*M.
How is the pseudoinverse constructed from an SVD?
For M=UΣV∗M=U\Sigma V^*, M+=VΣ+U∗M^+=V\Sigma^+U^*; nonzero singular values are reciprocated and zero values stay zero.
Which SVD vectors span the null space of a matrix?
Right-singular vectors associated with zero singular values span the null space of MM.
What does numerical rank estimate?
It estimates rank by treating singular values below a scale- and precision-informed tolerance as zero.

Quiz questions

  1. For an m×nm\times n matrix, what are the dimensions of UU and VV in the full SVD?Answer: UU is m×mm\times m and VV is n×nn\times n.
  2. Which statement describes the scope of the singular value decomposition?Answer: It exists for every rectangular or square matrix.
  3. What are the nonzero eigenvalues of M∗MM^*M in terms of the singular values of MM?Answer: They are the squares of the nonzero singular values.
  4. What does the Eckart–Young theorem say about truncating an SVD?Answer: The truncated SVD gives a best rank-tt approximation in the Frobenius norm.
  5. For a full-rank matrix, what is the usual SVD expression for its condition number?Answer: κ=σmax⁡/σmin⁡\kappa=\sigma_{\max}/\sigma_{\min}.

Based on the Wikipedia article Singular value decomposition, licensed CC BY-SA 4.0. Adapted into a summary, flashcards and quizzes.

All Linear algebra lessons