Lecture 12: Conditional Gradient, Gradient Projection, and Constrained Newton's Methods

In this video on Nonlinear Programming, we'll explore three important methods for solving constrained optimization problems: the Conditional Gradient Method, the Gradient Projection Method, and the Constrained Newton's Method. We'll cover the basics of each method, including how they work, their strengths and weaknesses, and how they can be applied to solve complex optimization problems with constraints. This lecture series is from the Nonlinear Programming course that ran at The Ohio State University under the course number ECE 5759. The course builds on linear algebra and calculus to derive various algorithms for optimization in static and dynamic systems. The course is aimed at first-year graduate students, though senior undergraduate students with advanced knowledge of mathematics can also grasp the concepts discussed in the course. If you are interested in other courses taught by him, you can view them here: Cybersecurity of Autonomous Systems (aimed at early graduate students): https://www.youtube.com/playlist?list=PL_Nk3YvgORJtMXvdpMD73okhm-MqQHqx0 Reinforcement Learning (aimed at very advanced PhD students): https://www.youtube.com/playlist?list=PL_Nk3YvgORJs1tCLQnlnSRsOJArj_cP9u Game Theory and Mechanism Design (aimed at early PhD students): https://www.youtube.com/playlist?list=PL_Nk3YvgORJtEJrafhk9tb3E5qQRGHvCK Signals and Systems (aimed at third year undergraduate students): https://www.youtube.com/playlist?list=PL_Nk3YvgORJuloGWq7YqhvQ9KV1ltwY8r Feedback Control Systems (aimed at fourth year undergraduate students): https://www.youtube.com/playlist?list=PL_Nk3YvgORJv1sgMhuKZ-mlcidfLDl4zy Prof. Abhishek Gupta is an Associate Professor in the Electrical and Computer Engineering department at The Ohio State University. He completed his Ph.D. in Aerospace Engineering (2014), MS in Applied Mathematics (2012), and MS in Aerospace Engineering (2011), all from University of Illinois at Urbana-Champaign (UIUC). Before coming to UIUC in 2009, he completed his undergraduate in Aerospace Engineering from Indian Institute of Technology, Bombay, India (2005-09). As part of his research, he contributes to probability theory, optimization methods, and practice of data-driven algorithms in various applications. He has developed theory to ascertain convergence of recursive stochastic algorithms. He has devised new algorithms to detect cyberattacks on autonomous systems, price transportation services, optimize fuel efficiency in vehicles, and optimize charging of electric vehicles using renewable energy. His research has resulted in over 60 peer reviewed publications, 1 patent, and 2 pending patents. You can find more information about him and his research at https://gupta706.github.io/.