A first course in optimization theory.

**Instructor:**Elad Yarkony- yarkony2 [at] illinois [dot] edu
- Office hours: Tuesday 2pm–4pm, 167 CSL

**Teaching assistant:**Haoxiang Wang- hwang264 [at] illinois [dot] edu
- Office hours: Wed 1-3pm, ECEB3013

**Meetings:**Tuesday and Thursday, 11:00–12:20pm, 2017 ECEB**Schedule:***Midterm:*3/12/20 in class.*Final:*TBD

*1/21/20*: Welcome Students !*1/31/20*: Homework 1 released. Due 2/13 8PM CDT. Submit through Compass2g.*2/3/20*: TA Office Hours announced.

*2/3/20*: TA Office Hours of 2/5/20 moved to Mon. 2/10/20 ECEB4034, same hours*2/5/20*: Instructor’s additional office hours on Fri. 2/7/20 3-4pm, ECEB lobby

- Week 1 (1/20–1/24):
- Lecture 1: Introduction PDF
- Lecture 2: Mathematical Refresher PDF Jupyter notebook
- Reading assignment: Boyd, Appendix A

- Week 2 (1/27–1/31):
- Lecture 3: Positive Semi-Definite Matrices, Multivariate Calculus Refresher PDF Jupyter notebook
- Lecture 4: Affine Sets, Convex Sets, Cones PDF Jupyter notebook
- Homework 1 released. Due 2/13 8PM CDT. Submit through Compass2g.

- Week 3 (2\3–2/7):
- Week 4 (2\10–2/14):
- Lecture 7: Convex Cones Wrap up, Convex Functions PDF Jupyter notebook
- Lecture 8: First and Second Order Convexity Conditions, Minima of Convex Functions, Jensen’s Inequality, Convexity Preserving Operations PDF Jupyter notebook
- Reading assignment: Boyd, Chapter 3.1-3.2

- Introduction
- Mathematical Background (BV, Appendix A)
- Convex Sets, Cones (BV, Chapter 2)
- Convex Functions, Optimality Conditions (BV Chapter 3)

- Anatomy of Optimization Problems
- Optimization Problems Prototypes (BV, Chapter 4)
- Lagrange Duality (BV, Chapter 5)

- Common Applications
- Data Fitting, Approximation (BV, Chapter 6)
- Estimation (BV, Chapter 7)
- Geometric Problems (BV, Chapter 8)

- Standard Algorithms
- Unconstrained Optimization (BV, Chapter 9)
- Equality constraints (BV, Chapter 10)
- Inequalities (interior point methods, barrier methods) (BV, Chapter 11)

- 40% homeworks (submission instructions)
- 25% midterm

- 35% final exam
- 4 credits: final project (binary)
- Grades will be distributed on Compass 2g

- Stephen Boyd and Lieven Vandenberghe,
*“Convex Optimization”*, book (online version) - Osman Güler,
*“Foundations of Optimization”*, available as PDF through UIUC online library catalog (click “SpringerLink - Full text online” at the bottom of the page)

- Python/NumPy tutorials literally all over such as this beautiful lecture
- Plenty of Jupyter references such as this and this
- Download Python 3 here

- Elementary set theory e.g. \(A\subset B,x\in A\).
- Vector spaces
- Multivariate Calculus
- Partial Derivative, Gradient, Hessian
- Convex Function and Convex Set