Recap of SVD and related concepts

• SVD demo with low-rank plus noise matrix
• Connections between SVD and (regularized) least squares
• Connection between SVD and the pseudoinverse of a matrix
• Relation between SVD and PCA, PCA demo
• Eigen demo, eigen-SVD connection

Back to classification using linear discriminants

• The Perceptron algorithm for separable data