Date |
Content of the Lecture |
Assignments/Readings/Notes |
| Lecture 1: 5/1 (Mon) |
- Course overview
- Intro to compressed sensing, tomography, dictionary learning, low rank matrix recovery
|
|
| Lecture 2: 8/1 (Thu) |
- Compressed sensing (CS): introduction and motivation
- Review of DFT and DCT, Review of JPEG, representation of a signal/image as a linear combination of basis vectors
- Sparsity of natural images in transform bases
- Candes, Romberg, Tao: puzzling experiment; Basic optimization problem for CS involving the total variation (i.e. sum total gradient magnitude of the image)
|
|
| Lecture 3: 12/1 (Mon) |
- Whittaker-Shannon sampling theorem
- Concept of incoherence between sensing matrix and representation basis
- L0 and L1 norm optimization problems for compressed sensing; proof of uniqueness of the solution of the L0 problem
|
|
| Lecture 4: 15/1 (Thu) |
- Theorem 1 and its relation to Shannon's sampling theorem; examples of bad/incompatible pairs of signal-support and measurement-subset
- Intuition behind incoherence
- Concept of restricted isometry property (RIP) and its relation to the nullspace property
|
|
| Lecture 5: 19/1 (Mon) |
- Theorems 2 and 3 and comments on them
- Motivation for use of L1 norm instead of L2 norm for compressed sensing
- Interpretation of L1 norm optimization as a linear programming problem
|
|
| Lecture 6: 22/1 (Thu) |
- Sample results for compressed sensing
- CS for piecewise constant signals: Theorem 4
- Algorithms for compressed sensing: matching pursuit (MP) and orthogonal matching pursuit (OMP)
- Iterative Shrinkage and Thresholding Algorithm (ISTA)
|
|
| Lecture 7: 29/1 (Thu) |
- Algorithms for compressed sensing: iterated shrinkage and thresholding algorithm (ISTA)
- Rice single pixel camera, and its block-based version
|
|
| Lecture 8: 2/2 (Mon) |
- Rice single pixel camera in video mode: separate frame-by-frame reconstruction, coupled reconstruction
- CASSI camera for compressive hyperspectral imaging
- Color filter arrays and color image demosaicing
|
|
| Lecture 9: 7/2 (Sat) |
- Concept of tradeoff between spatial and temporal resolution in image acquisition
- Video snapshot compressive sensing: concept, hardware description, results
- Introduction to compressed sensing for pooled testing: noise model in RTPCR
|
|
| Lecture 10: 9/2 (Mon) |
- Introduction to compressed sensing for pooled testing: Dorfman's algorithm, design of pooling matrices, use of family and contact tracing information, group sparsity
|
|
| Lecture 11: 12/2 (Thu) |
- Proof sketch for theorem 3: use of Cauchy Schwartz Inequality, Triangle Inequality, Reverse Triangle Inequality, relationship between different norms
- Theorem 6: use of RIC of order s, instead of order 2s
- Theorem 5: problem P1 analyzed using mutual coherence
- Mutual coherence versus RIC; Gershgorin's disc theorem to derive the relationship between them
- Logan's result regarding recovery of a bandlimited signal given impulse noise
|
|
| Lecture 12: 16/2 (Mon) |
- Sensing matrix design
- Compressive classification
- CS in MRI
|
|
| Lecture 13: 19/2 (Thu) |
Dictionary Learning
- Concept of dictionary learning and dictionary coefficients
- Orthonormal and overcomplete dictionaries; overcompleteness and sparsity; sparse coding for orthonormal and overcomplete dictionaries
- KMeans as a special case of dictionary learning
- Dictionary learning using Olshausen's method, Method of optimal directions
- Introduction to KSVD method for dictionary learning
|
|