This schedule should be considered tentative and subject to change, at least until it actually takes place! In addition to class notes, I have compiled some background notes that may be helpful.

Week Day Date Notes and readings HW
1 Mon, Jan 23

Introduction

[NB (Julia)][NB (HTML)]

Wed, Jan 25

Matrix manipulations

[NB (Julia)][NB (HTML)]

Fri, Jan 27

Vector spaces, norms, singular values

2 Mon, Jan 30

Matrices, norms, canonical forms

Wed, Feb 01

Neumann series, sensitivity, conditioning

Fri, Feb 03

Floating point

[NB (Julia)][NB (HTML)]

3 Mon, Feb 06

Floating point

[NB (Julia)][NB (HTML)]

Wed, Feb 08

Gaussian elimination

[NB (Julia)][NB (HTML)]

Fri, Feb 10

Blocking

[NB (Julia)][NB (HTML)]

4 Mon, Feb 13

Perturbation theory, refinement, Cholesky, project 1 intro

[NB (Julia)][NB (HTML)][P1 (Julia)][P1 (HTML)]

Wed, Feb 15

Pivoting, conditioning, error estimation

Fri, Feb 17

Sparse, banded, and structured solves

5 Mon, Feb 20

Intro to least squares

[NB (Julia)][NB (HTML)]

Wed, Feb 22

Least squares and QR

[NB (Julia)][NB (HTML)]

Fri, Feb 24

Ill-posedness and regularization

[NB (Julia)][NB (HTML)]

6 Mon, Feb 27 February break
Wed, Mar 01

Ill-posedness and regularization

(Bindel away)

Fri, Mar 03

Applications of eigenvalue problems

(Bindel away)

7 Mon, Mar 06

Power iteration

[NB (Julia)][NB (HTML)]

Wed, Mar 08

From power methods to QR iteration

[NB (Julia)][NB (HTML)]

Fri, Mar 10

Hessenberg, tridiagonal, and bidiagonal

8 Mon, Mar 13

Stationary iterations

[NB (Julia)][NB (HTML)]

Wed, Mar 15

Gauss-Seidel convergence, extrapolation

Fri, Mar 17

Krylov subspace iterations

9 Mon, Mar 20

Nonlinear equations in 1D

(Bindel away)

[NB (Julia)][NB (HTML)][P2 (Julia)][P2 (HTML)]

Wed, Mar 22

Nonlinear equations in 1D

(Bindel away)

[NB (Julia)][NB (HTML)]

Fri, Mar 24

Optimization in 1D

(Bindel away)

[NB (Julia)][NB (HTML)]

10 Mon, Mar 27

Nonlinear equations and optimization

[NB (Julia)][NB (HTML)]

Wed, Mar 29

Newton in many dimensions

[NB (Julia)][NB (HTML)]

Fri, Mar 31

Gradient descent and Newton for optimization

[NB (Julia)][NB (HTML)]

11 Mon, Apr 03 Spring break
Wed, Apr 05 Spring break
Fri, Apr 07 Spring break
12 Mon, Apr 10

Gauss-Newton and nonlinear least squares

[NB (Julia)][NB (HTML)]

Wed, Apr 12

Modified Newton iterations

[NB (Julia)][NB (HTML)]

Fri, Apr 14

Quasi-Newton and other iterations

[NB (Julia)][NB (HTML)]

13 Mon, Apr 17

Line search and globalization

[NB (Julia)][NB (HTML)]

Wed, Apr 19

Trust regions

[NB (Julia)][NB (HTML)]

Fri, Apr 21

Homotopy and continuation

[NB (Julia)][NB (HTML)]

14 Mon, Apr 24

Constraints and multipliers

[NB (Julia)][NB (HTML)]

Wed, Apr 26

Methods for equality constraints

[NB (Julia)][NB (HTML)]

Fri, Apr 28

Methods for inequality constraints

[NB (Julia)][NB (HTML)]

15 Mon, May 01

Derivative free methods

[NB (Julia)][NB (HTML)]

Wed, May 03

Stochastic optimizers

Fri, May 05

Review

16 Mon, May 08

Review