Eskisehir Technical University Info Package Eskisehir Technical University Info Package
  • Info on the Institution
  • Info on Degree Programmes
  • Info for Students
  • Türkçe
About the Program Educational Objectives Key Learning Outcomes Course Structure Diagram with Credits Field Qualifications Matrix of Course& Program Qualifications Matrix of Program Outcomes&Field Qualifications
  • Faculty Of Computer And Information Technologies
  • Artificial Intelligence And Machine Learning Pr. (English)
  • Course Structure Diagram with Credits
  • Introduction to Optimization Theory
  • Description
  • Description
  • Learning Outcomes
  • Course's Contribution to Prog.
  • Learning Outcomes & Program Qualifications
  • ECTS Credit Load

Course Introduction Information

Code - Course Title YZM3005 - Introduction to Optimization Theory
Course Type Required Courses
Language of Instruction İngilizce
Laboratory + Practice 3+2
ECTS 6.0
Course Instructor(s) DOKTOR ÖĞRETİM ÜYESİ NİHAL İNCE
Mode of Delivery This course is offered exclusively in an in-person format.
Prerequisites There are no prerequisites or co-requisites for this course.
Courses Recomended There are no other recommended courses related to this one.
Required or Recommended Resources Boyd, S., & Vandenberghe, L. (2004). Convex Optimization. Cambridge University Press. Nocedal, J., & Wright, S. J. (2006). Numerical Optimization (2nd ed.). Springer. Deisenroth, M. P., Faisal, A. A., & Ong, C. S. (2020). Mathematics for Machine Learning. Cambridge University Press. Kiusalaas, J. (2013). Numerical Methods in Engineering with Python 3. Cambridge University Press.
Recommended Reading List Boyd, S., & Vandenberghe, L. (2004). Convex Optimization. Cambridge University Press. Nocedal, J., & Wright, S. J. (2006). Numerical Optimization (2nd ed.). Springer. Deisenroth, M. P., Faisal, A. A., & Ong, C. S. (2020). Mathematics for Machine Learning. Cambridge University Press. Kiusalaas, J. (2013). Numerical Methods in Engineering with Python 3. Cambridge University Press.
Assessment methods and criteria 1 midterm exam, 1 project, 1 final exam
Work Placement This is not suitable for this class.
Sustainability Development Goals

Content

Weeks Topics
Week - 1 What is Optimization? Its Role in ML.Gradient, Hessian Matrix.
Week - 2 Positive Definite Matrices. Convexity: Convex Sets and Convex Functions.
Week - 3 Unconstrained Optimization: Optimality Conditions (First and Second Order).
Week - 4 Gradient Descent and Convergence Analysis.
Week - 5 Learning Rate Selection. Stochastic Gradient Descent (SGD).
Week - 6 Advanced Gradient Methods.
Week - 7 Second-Order Methods: Newton's Method.
Week - 8 Applications of Unconstrained Optimization
Week - 9 Constrained Optimization. Equality Constraints and Lagrange Multipliers.
Week - 10 Lagrange Multipliers: Examples and Applications.
Week - 11 Inequality Constraints: The Karush-Kuhn-Tucker (KKT) Conditions.
Week - 12 KKT Conditions and their relation to SVMs
Week - 13 Duality: The Lagrangian Dual Problem.
Week - 14 Linear Programming: The Simplex Method.

Learning Activities and Teaching Methods

  • Teaching Methods
  • Lecture
  • Question & Answer
  • Drill - Practise
  • Brain Storming
  • Report Preparation and/or Presentation
  • Proje Design/Management
  • Competences
  • Productive
  • Rational
  • Questoning
  • Follow ethical and moral rules
  • Work in teams
  • Use time effectively
  • Respect differences
  • Abstract analysis and synthesis
  • Problem solving
  • Elementary computing skills
  • To work in interdisciplinary projects
  • Project Design and Management

Assessment Methods

Assessment Method and Passing Requirements
Quamtity Percentage (%)
Toplam (%) 0
  • Info on the Institution
  • Name and Adress
  • Academic Calendar
  • Academic Authorities
  • General Description
  • List of Programmes Offered
  • General Admission Requirements
  • Recognition of Prior Learning
  • Registration Procedures
  • ECTS Credit Allocation
  • Academic Guidance
  • Info on Degree Programmes
  • PhD / Proficiency in Art
  • Master's Degree
  • Bachelor's Degree
  • Associate Degree
  • Info for Students
  • Cost of living
  • Accommodation
  • Meals
  • Medical Facilities
  • Facilities for Special Needs Students ı
  • Insurance
  • Financial Support for Students
  • Student Affairs Office
  • Info for Students
  • Learning Facilities
  • International Programmes r
  • Practical Information for Mobile Students
  • Language courses
  • Internships
  • Sports and Leisure Facilities
  • Student Associations