Go Ahead and Do not Forget: Modular Lifelong Learning from Event-based Data

Vadym Gryshchuk , Cornelius Weber , Chu Kiong Loo , Stefan Wermter
Neurocomputing Volume 500, pages 1063-1074, doi: 10.1016/j.neucom.2022.05.101 - Jun 2022 Open Access
Associated documents :  
Lifelong learning is a long-standing aim for artificial agents that act in dynamic environments in which an agent needs to accumulate knowledge incrementally without forgetting previously learned representations. Contemporary methods for incremental learning from images are predominantly based on frame-based data recorded by conventional shutter cameras. We investigate methods for learning from data produced by event cameras and compare techniques to mitigate forgetting while learning incrementally. We propose a model that is composed of both, feature extraction and incremental learning. The feature extractor is utilized as a self-supervised sparse convolutional neural network that processes event-based data. The incremental learner uses a habituation-based method that works in tandem with other existing techniques. Our experimental results show that the combination of different existing techniques with our proposed habituation-based method can help avoid catastrophic forgetting even more, while learning incrementally from the features provided by the extraction module.


 	 author =  {Gryshchuk, Vadym and Weber, Cornelius and Loo, Chu Kiong and Wermter, Stefan},  
 	 title = {Go Ahead and Do not Forget: Modular Lifelong Learning from Event-based Data}, 
 	 journal = {Neurocomputing},
 	 number = {},
 	 volume = {500},
 	 pages = {1063-1074},
 	 year = {2022},
 	 month = {Jun},
 	 publisher = {Elsevier},
 	 doi = {10.1016/j.neucom.2022.05.101},