Week |
Day |
Date |
Notes and readings |
HW |
1 |
Mon, |
Jan 23 |
Introduction
[NB (Julia)][NB (HTML)]
|
|
|
Wed, |
Jan 25 |
Matrix manipulations
[NB (Julia)][NB (HTML)]
|
|
|
Fri, |
Jan 27 |
Vector spaces, norms, singular values
|
|
2 |
Mon, |
Jan 30 |
Matrices, norms, canonical forms
|
|
|
Wed, |
Feb 01 |
Neumann series, sensitivity, conditioning
|
|
|
Fri, |
Feb 03 |
Floating point
[NB (Julia)][NB (HTML)]
|
|
3 |
Mon, |
Feb 06 |
Floating point
[NB (Julia)][NB (HTML)]
|
|
|
Wed, |
Feb 08 |
Gaussian elimination
[NB (Julia)][NB (HTML)]
|
|
|
Fri, |
Feb 10 |
Blocking
[NB (Julia)][NB (HTML)]
|
|
4 |
Mon, |
Feb 13 |
Perturbation theory, refinement, Cholesky, project 1 intro
[NB (Julia)][NB (HTML)][P1 (Julia)][P1 (HTML)]
|
|
|
Wed, |
Feb 15 |
Pivoting, conditioning, error estimation
|
|
|
Fri, |
Feb 17 |
Sparse, banded, and structured solves
|
|
5 |
Mon, |
Feb 20 |
Intro to least squares
[NB (Julia)][NB (HTML)]
|
|
|
Wed, |
Feb 22 |
Least squares and QR
[NB (Julia)][NB (HTML)]
|
|
|
Fri, |
Feb 24 |
Ill-posedness and regularization
[NB (Julia)][NB (HTML)]
|
|
6 |
Mon, |
Feb 27 |
February break |
|
|
Wed, |
Mar 01 |
Ill-posedness and regularization
(Bindel away)
|
|
|
Fri, |
Mar 03 |
Applications of eigenvalue problems
(Bindel away)
|
|
7 |
Mon, |
Mar 06 |
Power iteration
[NB (Julia)][NB (HTML)]
|
|
|
Wed, |
Mar 08 |
From power methods to QR iteration
[NB (Julia)][NB (HTML)]
|
|
|
Fri, |
Mar 10 |
Hessenberg, tridiagonal, and bidiagonal
|
|
8 |
Mon, |
Mar 13 |
Stationary iterations
[NB (Julia)][NB (HTML)]
|
|
|
Wed, |
Mar 15 |
Gauss-Seidel convergence, extrapolation
|
|
|
Fri, |
Mar 17 |
Krylov subspace iterations
|
|
9 |
Mon, |
Mar 20 |
Nonlinear equations in 1D
(Bindel away)
[NB (Julia)][NB (HTML)][P2 (Julia)][P2 (HTML)]
|
|
|
Wed, |
Mar 22 |
Nonlinear equations in 1D
(Bindel away)
[NB (Julia)][NB (HTML)]
|
|
|
Fri, |
Mar 24 |
Optimization in 1D
(Bindel away)
[NB (Julia)][NB (HTML)]
|
|
10 |
Mon, |
Mar 27 |
Nonlinear equations and optimization
[NB (Julia)][NB (HTML)]
|
|
|
Wed, |
Mar 29 |
Newton in many dimensions
[NB (Julia)][NB (HTML)]
|
|
|
Fri, |
Mar 31 |
Gradient descent and Newton for optimization
[NB (Julia)][NB (HTML)]
|
|
11 |
Mon, |
Apr 03 |
Spring break |
|
|
Wed, |
Apr 05 |
Spring break |
|
|
Fri, |
Apr 07 |
Spring break |
|
12 |
Mon, |
Apr 10 |
Gauss-Newton and nonlinear least squares
[NB (Julia)][NB (HTML)]
|
|
|
Wed, |
Apr 12 |
Modified Newton iterations
[NB (Julia)][NB (HTML)]
|
|
|
Fri, |
Apr 14 |
Quasi-Newton and other iterations
[NB (Julia)][NB (HTML)]
|
|
13 |
Mon, |
Apr 17 |
Line search and globalization
[NB (Julia)][NB (HTML)]
|
|
|
Wed, |
Apr 19 |
Trust regions
[NB (Julia)][NB (HTML)]
|
|
|
Fri, |
Apr 21 |
Homotopy and continuation
[NB (Julia)][NB (HTML)]
|
|
14 |
Mon, |
Apr 24 |
Constraints and multipliers
[NB (Julia)][NB (HTML)]
|
|
|
Wed, |
Apr 26 |
Methods for equality constraints
[NB (Julia)][NB (HTML)]
|
|
|
Fri, |
Apr 28 |
Methods for inequality constraints
[NB (Julia)][NB (HTML)]
|
|
15 |
Mon, |
May 01 |
Derivative free methods
[NB (Julia)][NB (HTML)]
|
|
|
Wed, |
May 03 |
Stochastic optimizers
|
|
|
Fri, |
May 05 |
Review
|
|
16 |
Mon, |
May 08 |
Review
|
|