Title :
Transfer learning across heterogeneous tasks using behavioural genetic principles
Author :
Kohli, Maitrei ; Magoulas, George D. ; Thomas, Michael S. C.
Author_Institution :
Dept. of Comput. Sci. & Inf. Syst., Birkbeck Univ. of London, London, UK
Abstract :
We explore the use of Artificial Neural Networks (ANNs) as computational models capable of sharing, retaining and reusing knowledge when they are combined via Behavioural Genetic principles. In behavioural genetics, the performance and the variability in performance (in case of population studies) stems from structure (intrinsic factors or genes) and environment (training dataset). We simulate the effects of genetic influences via variations in the neuro-computational parameters of the ANNs, and the effects of environmental influences via a filter applied to the training set. Our approach uses the twin method to disentangle genetic and environmental influences on performance, capturing transfer effects via changes to the heritability measure. Our model captures the wide range of variability exhibited by population members as they are trained on five different tasks. Preliminary experiments produced encouraging results as to the utility of this method. Results provide a foundation for future work in using a computational framework to capture population-level variability, optimising performance on multiple tasks, and establishing a relationship between selective pressure on cognitive skills and the change in the heritability of these skills across generations.
Keywords :
genetic algorithms; learning (artificial intelligence); neural nets; ANN; artificial neural networks; behavioural genetic principles; cognitive skills; computational models; environmental influences; genetic influences; heritability measure; heterogeneous tasks; knowledge reuse; neurocomputational parameters; population-level variability; transfer learning; Accuracy; Correlation; Genetics; Learning systems; Sociology; Training; artificial neural networks; behavioural genetics; genetic algorithms; heritability; transfer learning;
Conference_Titel :
Computational Intelligence (UKCI), 2013 13th UK Workshop on
Conference_Location :
Guildford
Print_ISBN :
978-1-4799-1566-8
DOI :
10.1109/UKCI.2013.6651300