Unconstrained convex optimization
- Convex sets and functions
- Differentiable functions, convexity, and optimization
- Gradient descent
- Convergence analysis of gradient descent
- Accelerated gradient descent: Heavy ball method and Nesterov's method
- Newton's method
- Quasi-Newton methods: BFGS
- Subgradients and subgradient descent
- Proximal methods