Understading the Geometry of \(A\in \mathbb{R}^{m\times n}\)

\[ A\in \mathbb{R}^{m\times n} \\ x\in \mathbb{R}^n \mapsto Ax \in \mathbb{R}^m \]

Assumption: \(A \in \mathbb{R}^{n \times n}\) is symmetric, no repeated eigenvalues \(\lambda\)s.

Two basic Properties

Lemma: Every matrix \(A \in \mathbb{R}^{n \times n}\) has at least one (complex) eigenvalue.

很多时候需要把已有问题转化为特征值问题。

1. 有一个对称矩阵（有时候是对称半正定矩阵），我们想要找一个方便的基。
2. 具体的优化问题。

High-Level Idea

Why QR?

\[ \begin{aligned} cond A^T A &= ||A^T A|| \cdot ||(A^T A)^{-1}||\\ &\approx ||A^T|| \cdot ||A|| \cdot ||A^{-1}|| \cdot ||A^{-T}|| &= cond A^2 \end{aligned} \]

为了避免计算\(A^T A\)，我们可以使用QR分解。

Linear Systems

\[ \begin{aligned} Ax &= b \\ A &\in \mathbb{R}^{n \times n} \\ x &\in \mathbb{R}^n \\ b &\in \mathbb{R}^n \end{aligned} \]

Mathematically correct != numerically sound. Using Tolerance:

1
2
3
4
5
6
7

double x = 1.0;
double y = x / 3.0;
if(fabs(x-y*3.0) < numeric_limits<double>::epsilon()){
    cout << "They are equal" << endl;
}
else
    cout << "They are not equal" << endl;