Recurrent Neural Network for syntax learning with flexible predicates for robotic architectures

We present a Recurrent Neural Network (RNN), namely an Echo State Network (ESN), that performs sentence comprehension and can be used for Human-Robot Interaction (HRI). The RNN is trained to map sentence structures to meanings (i.e. predicates). We have previously shown that this ESN is able to generalize to unknown sentence structures. Moreover, it is able to learn English, French or both at the same time. The are two novelties presented here: (1) the encapsulation of this RNN in a ROS module enables one to use it in a robotic architecture like the Nao humanoid robot, and (2) the flexibility of the predicates it can learn to produce (e.g. extracting adjectives) enables one to use the model to explore language acquisition in a developmental approach.

@InProceedings{HTW16, 
 	 author =  {Hinaut, Xavier and Twiefel, Johannes and Wermter, Stefan},  
 	 title = {Recurrent Neural Network for syntax learning with flexible predicates for robotic architectures}, 
 	 booktitle = {2016 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob)},
 	 number = {},
 	 volume = {},
 	 pages = {},
 	 year = {2016},
 	 month = {Sep},
 	 publisher = {IEEE},
 	 doi = {10.1109/DEVLRN.2016.7846807}, 
 }