Advanced Machine Learning

Undergraduate Courses
Computer Organization and Architecture
Principles and Methods of Machine Learning
Advanced Machine Learning
Graduate Courses

Department of Information and Electronic Engineering
International Hellenic University

Advanced Machine Learning [9th semester]

Course code 1947. Scientific area course - Elective.
Area: Data Management - Artificial Intelligence (DMAI).
Suggested prerequisite courses: (1802) Machine Learning Principles and Methods

The aim of this course is to give the student a spherical view of the area of machine learning by studying the most important models and learning methods with and without supervision. Moreover, elements of learning theory are offered so that the student can gain insight into the efficiency of the models, their capabilities and their limitations. With the successful completion of the course the student will be able to:

  • Know a wide range of machine learning methods and their application areas
  • Understand the types of problems solved by these methods
  • Analyze a problem that requires the use of machine learning and apply the appropriate method to it
  • Compose solutions in complicated problems by combining machine learning methods
  • Evaluate, using appropriate tools, the performance of a machine learning model or system
Topics covered:

Supervised Learning

  • Multilayer Neural Networks, methods and training issues
  • Deep Learning, Deep Belief Networks, Deep autoencoders, Convolutional Neural Networks
  • Probabilistic Bayesian models, Gaussian mixture models, the Expectation-Maximization (EM) algorithm
  • Combining  models, Bagging, Boosting, mixtures of experts
  • Recurrent Neural Networks, Time Delay Neural Networks, training using Backpropagation Through Time, LSTM model, GRU model
  • Bayesian networks, graphical inference models, directed and undirected graphs, Hidden Markov Models

Unsupervised Learning

  • Principal Component Analysis (PCA), Factor Analysis

Reinforcement Learning

  • The armed-bandit problem, Markovian Decision Processes, Dynamic Programming, Monte Carlo methods

Application examples

Course material:

IHU E-learning platform (Moodle)


  • Final written exam with a combination of multiple-choice questions, short answer questions, and problem-solving questions.
  • Optional exercises


  1. Κωνσταντίνος Διαμαντάρας, Δημήτρης Μπότσης, "Μηχανική Μάθηση", Εκδόσεις Κλειδάριθμος ΕΠΕ, Έκδοση: 1η/2019, ISBN: 978-960-461-995-5, Κωδικός Βιβλίου στον Εύδοξο: 86198212
  2. Κωνσταντίνος Διαμαντάρας, "Τεχνητά Νευρωνικά Δίκτυα", Εκδόσεις Κλειδάριθμος ΕΠΕ, Έκδοση: 1η/2007, ISBN: 978-960-461-080-8, Κωδικός Βιβλίου στον Εύδοξο: 13908
  3. Goodfellow Ian, Bengio Yoshua and Courville Aaron, Deep Learning, MIT Press, 2016,
  4. Theodoridis, Sergios, "Machine learning: a Bayesian and optimization perspective", Academic Press, 2015.
  5. Bishop, Christopher M., "Pattern recognition and machine learning", Springer, 2006.
  6. Related Scientific Journals

[Main] [CV] [Research] [Publications] [Undergraduate Courses] [Graduate Courses]