Projects vvv2014

From Wiki for iCub and Friends
Revision as of 10:30, 26 July 2014 by VVV14 (talk | contribs)
Jump to: navigation, search

Please populate this page with the name of the project, the name of the people that participate in the project and a short description of what the project aims to do and what individual people are planning to do within the group. A group can be made by an individual person or more.

It is important that everybody works towards something, no matter how simple or complex.

Wysiwyd EU Project (What you say is what you did)

See here or here for a complete list of tasks.


  • Stephane, Matej : sensorimotor contingencies using SOMs that match other SOMs (e.g. see subtask 2.5 here)
  • Grégoire Pointeau.: learning through language. semantic bootstrapping. (see subtask 2.2). Detecting the object of focus, and through language associate several name to one object, or several objects to one name, and learning to use it according to the context.
  • Martina : online predictions of motion (see subtask 2.3)
  • Maxime : Reactable game for Semantic Bootstrapping (see subtask 2.3)
  • ...

Goal of the project:


Exploration of tools and objects affordances (in the context of Poeticon++)

People: Afonso, Lorenzo, Tanis, Vadim

Goal: Perform a set of actions on objects using tools, recording visual descriptors of tools, objects, and effects of the action.

Incremental Learning applications on iCub using the GURLS++ package

People: Raffaello

The main goals of the project are the following:

  1. Implement a numerically stable incremental RLS update rule (cholupdate) in the GURLS++ framework. The functionality has already been tested in MATLAB, replicating the work by Gijsberts et al.: ‘Incremental Learning of Robot Dynamics using Random Features’
  2. Design and develop a simple prototypical YARP module to serve as an interface with the robot
  3. Run an on-line inverse dynamics learner on the real robot


Optimal control for COM motion

People involved: Yue, thanks to Francesco for the idea, Silvio and Daniele for the dynamics explanation and help

The project is about task 1.10. The objective is to use optimal control to generate optimized reference control inputs (torques) for the iCub robot such that it performs some motion at the COM (like swing left right and keep balancing). To reach the goal forward dynamics is needed and a simple version with the Whole Body Interface is developed.
The optimal control problem is solved with the softwre package MUSCOD-II of University of Heidelberg.

Learning action representations from experience (in the context of the Xperience EU project)

Goal: create a simple demo of learning action representations on the iCub. See here for a complete list of tasks.


  • Vadim: generate symbolic action/state descriptions from the iCub database (subtask 6.1)
  • Kira: learn planning representations from the action/state descriptions in offline batch mode (subtask 6.2) and incrementally online (subtask 6.3)

Eye Tracking for Human Robot Interaction

People involved: Oskar

Face detection, face tracking, feature extraction, gaze tracking.

Exploration of tools and objects affordances (in the context of Poeticon++)

People: Afonso, Lorenzo, Tanis, Vadim

Goal: Perform a set of actions on objects using tools, recording visual descriptors of tools, objects, and effects of the action.

YARP/ROS Integration with MoveIt!

People involved: Miguel

Be able to plan the arm trajectories of the iCub on MoveIt, and, to populate the environment in ROS with the info from the iCub stereo vision.
Manage to get Vizzy's (a robot from my lab) controlboards simulated on Gazebo, using the previous work on iCub/Gazebo.

3D reconstruction of an object from multiple views

Contributors: Alessio Mauro Franchi, Evgenii Koriagin, Ilaria Gori, Ugo Pattacini

The aim of the project is to build a 3D object model registering multiple views.

Whole body related tasks

Floating base rigid body dynamics estimation

Contributors: Jorhabib Eljaik, Francesco Nori

We will consider the problem of estimating the dynamics of a floating base system. We will start with the simple problem of estimating the dynamics of a single rigid body with distributed force/torque sensors, accelerometers and gyroscopes. Adopted techniques will include Kalman filtering.

Balancing on a single foot

Contributors: Daniele Pucci, Silvio Traversaro

Test the balancing demo developed for the first year of the CoDyCo project with the robot standing on a single foot.

Graphical tools for ZMP and stability region visualizers

Contributors: Morteza Azad.

This module will be a graphical visualization tool for ZMP, balance etc. It will essentially be a 2D plot visualizing the feet (shape can be extracted from CAD drawings), the support polygon, the stability region, the ZMP, the COP, etc. It will integrate information provided by the dynamics modules, the skin information, etc.

Floating base forward dynamics

Contributors: Naveen Kuppuswamy, Daniele Pucci, Jorhabib Eljaik

In this task we aim at computing the floating base forward dynamics. The idea is to provide some preliminary implementations that assume a floating base system subject to a number of rigid constraints. The implementation could make use of the formulae presented by Aghili, 2005 and reported in formula (6.18) of Andrea Del Prete PhD thesis.

Matlab API to the whole body interface

Contributors: Naveen Kuppuswamy, Jorhabib Eljaik

The WBI-Toolbox offers a Simulink interface to the whole body interface. Certain parts of the WBI can offer some important functionalities in Matlab. As an example, the wholeBodyModel should have a Matlab interface to allow inverse and forward dynamics computations in Matlab.