Optimization (ACM 40990 and ACM 41030)
Current modules (Spring 2026)
Description: For Optimization in Machine Learning (ACM 40990, Spring 2026), refer to this page for the first seven weeks. For Optimization Algorithms (ACM 41030, Spring 2026), refer to this page for all weeks.
Course Documents:
- Complete set of typed notes, v1: January 2026
- Side note Section 1.3 (Convexity of Polyhedra)
- Introduction to ACM 40990 (January 2026)
- Introduction to ACM 41030 (January 2026)
Exam Guidelines
Lecture Notes:
- Week 1, all lectures
- Week 2, Lecture 1: Lecture notes and video
- Week 2, Lectures 2-3
- Week 3, Lecture 1: Lecture notes and video
- Week 3, Lectures 2-3
- Week 4, Lecture 1: Lecture notes and video
- Week 4, Lectures 2-3
- Week 5, Lecture 1: Lecture notes and video
- Week 5, Lectures 2-3
- Week 6, Lecture 1: Lecture notes and video
- Week 6, Lectures 2-3
- Week 7, Lecture 1: Lecture notes and video
- Week 7, Lecture 1: Lecture notes (face-to-face)
- Week 7, Lectures 2-3
Exercises #1: Line-search methods.
Code repository:
Exercises #2: Newton iteration and the Strong Wolfe Conditions.
Code repository:
Exercises #3: BFGS revisited and the Trust-Region Method.
Exercises #4: Global Optimization and Simulated Annealing
Code repository:
Exercises #5: Constraints (ACM 41030 only)
Exercises #6: More Constraints (ACM 41030 only)
Foundations of Data Science: Materials for Short Course on 8/12/2023:
Special Lectures on Optimization KIUT, 29th April 2025