Optimization (ACM 40990 and ACM 41030)
Current modules (Spring 2026)
Description: For Optimization in Machine Learning (ACM 40990, Spring 2026), refer to this page for the first seven weeks. For Optimization Algorithms (ACM 41030, Spring 2026), refer to this page for all weeks.
Lecture Notes:
- Complete set of typed notes, v1: January 2026
Course Documents:
- Introduction to ACM 40990 (January 2026)
- Introduction to ACM 41030 (January 2026)
- Side note Section 1.3 (Convexity of Polyhedra)
Examinable results - Part 1:
- Week 1: Theorems / Results in Section 1.3 (Convex Sets)
- Week 1: Results in Section 1.4 (Convex Functions)
Exercises #1: Line-search methods.
Code repository:
Exercises #2: Newton iteration and the Strong Wolfe Conditions.
Code repository:
Exercises #3: BFGS revisited and the Trust-Region Method.
Exercises #4: Global Optimization and Simulated Annealing
Code repository:
Exercises #5: Constraints (ACM 41030 only)
Exercises #6: More Constraints (ACM 41030 only)
Foundations of Data Science: Materials for Short Course on 8/12/2023:
Special Lectures on Optimization KIUT, 29th April 2025