Advanced Machine Learning [9th semester]

Course code 1947.
Scientific area course - Elective.

Area: Data Management - Artificial Intelligence (DMAI).

Suggested prerequisite courses:
(1802) Machine Learning Principles and Methods

The aim of this course is to give the student a spherical view of the area of machine learning by studying the most important models and learning methods with and without supervision. Moreover, elements of learning theory are offered so that the student can gain insight into the efficiency of the models, their capabilities and their limitations. With the successful completion of the course the student will be able to:

- Know a wide range of machine learning methods and their application areas
- Understand the types of problems solved by these methods
- Analyze a problem that requires the use of machine learning and apply the appropriate method to it
- Compose solutions in complicated problems by combining machine learning methods
- Evaluate, using appropriate tools, the performance of a machine learning model or system

**Supervised Learning**

- Multilayer Neural Networks, methods and training issues
- Deep Learning, Deep Belief Networks, Deep autoencoders, Convolutional Neural Networks
- Probabilistic Bayesian models, Gaussian mixture models, the Expectation-Maximization (EM) algorithm
- Combining models, Bagging, Boosting, mixtures of experts
- Recurrent Neural Networks, Time Delay Neural Networks, training using Backpropagation Through Time, LSTM model, GRU model
- Bayesian networks, graphical inference models, directed and undirected graphs, Hidden Markov Models

**Unsupervised Learning**

- Principal Component Analysis (PCA), Factor Analysis

**Reinforcement Learning**

- The armed-bandit problem, Markovian Decision Processes, Dynamic Programming, Monte Carlo methods

**Application examples**

Course material:

IHU E-learning platform (Moodle)Evaluation:

- Final written exam with a combination of multiple-choice questions, short answer questions, and problem-solving questions.
- Optional exercises

Bibliography

- Κωνσταντίνος Διαμαντάρας, Δημήτρης Μπότσης, "Μηχανική Μάθηση", Εκδόσεις Κλειδάριθμος ΕΠΕ, Έκδοση: 1η/2019, ISBN: 978-960-461-995-5, Κωδικός Βιβλίου στον Εύδοξο: 86198212
- Κωνσταντίνος Διαμαντάρας, "Τεχνητά Νευρωνικά Δίκτυα", Εκδόσεις Κλειδάριθμος ΕΠΕ, Έκδοση: 1η/2007, ISBN: 978-960-461-080-8, Κωδικός Βιβλίου στον Εύδοξο: 13908
- Goodfellow Ian, Bengio Yoshua and Courville Aaron, Deep Learning, MIT Press, 2016,
- Theodoridis, Sergios, "Machine learning: a Bayesian and optimization perspective", Academic Press, 2015.
- Bishop, Christopher M., "Pattern recognition and machine learning", Springer, 2006.
- Related Scientific Journals
- Neurocomputing, Elsevier
- IEEE Transactions on Neural Networks and Learning Systems
- Pattern Recognition, Elsevier
- IEEE Transactions on Pattern Analysis and Machine Intelligence