Genetic Algorithms and Neural Networks
Objectives
- To understand the way Genetic Algorithms (GA) work as a optimizing method.
- To be able to apply GA to simple problems using some software implementation of GA.
- To understand the neural networks basic types: feedforward, convolution and recurrent.
- To know the different Cost functions. To understand the usual optimization method used in neural networks: gradient descent. To understand the role of the different hyperparameters used in neural networks: number of layers, number of units on each layer and learning rate. To understand the different types of regularization and the situations that require the use of regularization.
General characterization
Code
12530
Credits
6.0
Responsible teacher
Rui Alberto Pimenta Rodrigues
Hours
Weekly - 4
Total - 52
Teaching language
Português
Prerequisites
We''''ll use the Python programing language but if the student has experience with some programing language he will be able to learn the necessary Python.
Bibliography
-Deep Learning, Ian Goodfellow and Yoshua Bengio and Aaron Courville, MIT Press, 2016
- Deep Learning with Python, Francois Chollet, Manning, 2018
Teaching method
Short theoretical presentations will be followed by examples that include computational implementation.
Evaluation method
There will be two tests. The final note is the average of the tests.
Subject matter
Genetic Algorithms:
-An optimization method
-Basic Concepts: fitness measure, population, selection, mutation, recombination.
-Practical examples using software.
Neural networks:
-Basic concepts: neural network types (feed forward, convolution, recurrent), activation functions and cost functions.
- Parameter optimization methods and regularization methods.
-Practical examples using software
Will use the Python programming language and some of its packages. No previous knowledge will be assumed.
Programs
Programs where the course is taught: