Advanced Machine Learning

Advanced Machine Learning [9th semester]

Course code 1947. Scientific area course - Elective.
Area: Data Management - Artificial Intelligence (DMAI).
Suggested prerequisite courses: (1802) Machine Learning Principles and Methods

The aim of this course is to give the student a spherical view of the area of machine learning by studying the most important models and learning methods with and without supervision. Moreover, elements of learning theory are offered so that the student can gain insight into the efficiency of the models, their capabilities and their limitations. With the successful completion of the course the student will be able to:

• Know a wide range of machine learning methods and their application areas
• Understand the types of problems solved by these methods
• Analyze a problem that requires the use of machine learning and apply the appropriate method to it
• Compose solutions in complicated problems by combining machine learning methods
• Evaluate, using appropriate tools, the performance of a machine learning model or system

Supervised Learning

• Multilayer Neural Networks, methods and training issues
• Deep Learning, Deep Belief Networks, Deep autoencoders, Convolutional Neural Networks
• Probabilistic Bayesian models, Gaussian mixture models, the Expectation-Maximization (EM) algorithm
• Combining  models, Bagging, Boosting, mixtures of experts
• Recurrent Neural Networks, Time Delay Neural Networks, training using Backpropagation Through Time, LSTM model, GRU model
• Bayesian networks, graphical inference models, directed and undirected graphs, Hidden Markov Models

Unsupervised Learning

• Principal Component Analysis (PCA), Factor Analysis

Reinforcement Learning

• The armed-bandit problem, Markovian Decision Processes, Dynamic Programming, Monte Carlo methods

Application examples

Course material:

Evaluation:

• Final written exam with a combination of multiple-choice questions, short answer questions, and problem-solving questions.
• Optional exercises

Bibliography

1. Êùíóôáíôßíïò ÄéáìáíôÜñáò, ÄçìÞôñçò Ìðüôóçò, "Ìç÷áíéêÞ ÌÜèçóç", Åêäüóåéò ÊëåéäÜñéèìïò ÅÐÅ, ¸êäïóç: 1ç/2019, ISBN: 978-960-461-995-5, Êùäéêüò Âéâëßïõ óôïí Åýäïîï: 86198212
2. Êùíóôáíôßíïò ÄéáìáíôÜñáò, "Ôå÷íçôÜ ÍåõñùíéêÜ Äßêôõá", Åêäüóåéò ÊëåéäÜñéèìïò ÅÐÅ, ¸êäïóç: 1ç/2007, ISBN: 978-960-461-080-8, Êùäéêüò Âéâëßïõ óôïí Åýäïîï: 13908
3. Goodfellow Ian, Bengio Yoshua and Courville Aaron, Deep Learning, MIT Press, 2016,
4. Theodoridis, Sergios, "Machine learning: a Bayesian and optimization perspective", Academic Press, 2015.
5. Bishop, Christopher M., "Pattern recognition and machine learning", Springer, 2006.
6. Related Scientific Journals
   • Neurocomputing, Elsevier
   • IEEE Transactions on Neural Networks and Learning Systems
   • Pattern Recognition, Elsevier
   • IEEE Transactions on Pattern Analysis and Machine Intelligence