Robotics and Autonomous Systems

Objectives

  1. .        Understanding
    1.       Perception for Autonomous Systems basic concepts
    2.       Main Robot Sensors and their characteristics
    3.       Robot 2D and 3D Vision
    4.       Perception using and fusing diverse modalities
    5.        Active vs Passive Perception
    6.        Probabilistic Robot Localisation methods
  2. .        Able to Do
    1.        Addressing new problems and implementing perception and localisation strategies in   the domain of robotized heterogeneous autonomous systems
    2.         Increase the capacity to practically implement these systems in robotized autonomous platforms
    3.        Apply creativity and innovation
  3.         Non-Technical Competences
    1.         Develop synthesis critical thinking
    2.         Team working and increasing oral and writing communication skills
    3.         Improve time keeping and compliance with meeting deadlines

General characterization

Code

10991

Credits

6.0

Responsible teacher

José António Barata de Oliveira, Luís Manuel Camarinha de Matos

Hours

Weekly - 4

Total - 56

Teaching language

Português

Prerequisites

  • Programming Skills

Bibliography

  • Thrun, S,  M., Burgard, Fox D  (2006). Probabilistic Robotics. MIT Press,668
  • Siegwart, R., Nourbakhsh, I. R., & Scaramuzza, D. (2011). Introduction to autonomous mobile robots. MIT press.
  • Chatterjee, A., Rakshit, A., & Singh, N. N. (2012). Vision based autonomous robot navigation: algorithms and implementations (Vol. 455). Springer.
  • Ferreira, J. F., & Dias, J. M. (2014). Probabilistic approaches to robotic perception. Springer International Publishing.
  • Kaehler, A., & Bradski, G. (2016). Learning OpenCV 3: computer vision in C++ with the OpenCV library. " O''Reilly Media, Inc.".

Teaching method

Theoretical-practical classes (TP) are directed so that students, through their active participation, understand each of the topics listed in the learning objectives.

In laboratory classes (PL) students focus on the experimentation of the concepts exposed in theoretical-practical classes in order to know how to do.

For each practical work:

  • Presentation of the work,
  • tutorial on the technology / tools to use,
  • discussion of the work method,
  • realization of the work by the students accompanied by teachers, and
  • preparation of report.

Evaluation Components

  • 2 Mini-Tests
  • 3 Practical Works

Evaluation Rules

  • Theoretical Mark = (Mini-Test 1 + Mini-Test 2) / 2
  • Theoretical Mark >= 9.5
  • Each Practical Work >= 9.5
  • Practical Mark = TP1 * Weight1 + TP2 * Weight2 + TP3*Peso3 ; Weights to be announced at the beginning of UC
  • Final Mark = Practical Mark * 0.7 + Theoretical Mark * 0.3

Evaluation method

Evaluation Components

  • 2 Mini-Tests
  • 3 Practical Works

Evaluation Rules

  • Theoretical Mark = (Mini-Test 1 + Mini-Test 2) / 2
  • Theoretical Mark >= 9.5
  • Each Practical Work >= 9.5
  • Practical Mark = TP1 * Weight1 + TP2 * Weight2 + TP3*Peso3 ; Weights to be announced at the beginning of UC
  • Final Mark = Practical Mark * 0.7 + Theoretical Mark * 0.3

Subject matter

1.      INTRODUCTION

o   Perception for Robotics: Measurement vs. Perception ( 2D, 3D, Sound, etc)

2.      VISION BASED SENSORS:

o   Monocular Camera, Binocular Camera

o   Omnidirectional, Mutlispectral Imagery

3.      THREE-DIMENSIONAL DATA:

o    Streoscopic  Pair, Structured Light

o   LiDAR, SONAR, Time of Flight

4.      THREE-DIMENSIONAL OCCUPANCY REPRESENTATION:

o    Point clouds, Voxel Grids, Octrees

5.      THREE-DIMENSIONAL REGISTRATION

o   Iterative Closest Point

o   Scan Matching

6.      THREE-DIMENSIONAL FILTERING THREE-DIMENSIONAL SEGMENTATION

o   Sample Consensus

o   Euclidean & Conditional Clustering

o   KdTrees"

7.      MULTIMODAL PERCEPTION AND DATA FUSION

8.      MULTIMODAL BASED OBJECT TRACKING

9.      ACTIVE PERCEPTION

10.   MOBILE ROBOTS LOCALISATION AND MAPPING

o   The challenge of Localisation

o   Dead Reckoning

o   Basic Localisation Sensors"

o   Global Localisation

o   Map based Localisation

o   SLAM  techniques

Programs

Programs where the course is taught: