Abstract
Previous words in the sentence can influence the processing of the current word in the timescale of hundreds of milliseconds. The current research provides a possible explanation of how certain aspects of this on-line language processing can occur, based on the dynamics of recurrent cortical networks. We simulate prefrontal area BA47 as a recurrent network that receives on-line input of “grammatical” words during sentence processing, with plastic connections between cortex and striatum (homology with Reservoir Computing). The system is trained on sentence-meaning pairs, where meaning is coded as activation in the striatum corresponding to the roles that different “semantic words” play in the sentences. The model learns an extended set of grammatical constructions, and demonstrates the ability to generalize to novel constructions. This demonstrates that a RNN can decode grammatical structure from sentences in an on-line manner in order to generate a predictive representation of the meaning of the sentences.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Friederici, A.D., Mecklinger, A., Spencer, K.M., Steinhauer, K., Donchin, E.: Syntactic parsing preferences and their on-line revisions: a spatio-temporal analysis of event-related brain potentials. Brain Res. Cogn. Brain Res. 11, 305–323 (2001)
Hagoort, P.: The fractionation of spoken language understanding by measuring electrical and magnetic brain signals. Philos. Trans. R Soc. Lond. B Biol. Sci. 363, 1055–1069 (2008)
Frisch, S., Kotz, S.A., von Cramon, D.Y., Friederici, A.D.: Why the P600 is not just a P300: the role of the basal ganglia. Clin. Neurophysiol. 114, 336–340 (2003)
Dominey, P.F., Hoen, M., Blanc, J.M., Lelekov-Boissard, T.: Neurological basis of language and sequential cognition: evidence from simulation, aphasia, and ERP studies. Brain Lang. 86, 207–225 (2003)
Dominey, P.F., Hoen, M.: Structure mapping and semantic integration in a construction-based neurolinguistic model of sentence processing. Cortex 42, 476–479 (2006)
Dominey, P.F., Hoen, M., Inui, T.: A neurolinguistic model of grammatical construction processing. J. Cogn. Neurosci. 18, 2088–2107 (2006)
Dominey, P.F., Inui, T.: Cortico-striatal function in sentence comprehension: insights from neurophysiology and modeling. Cortex 45, 1012–1018 (2009)
Dominey, P.F., Inui, T., Hoen, M.: Neural network processing of natural language: II. Towards a unified model of corticostriatal function in learning sentence comprehension and non-linguistic sequencing. Brain Lang. 109, 80–92 (2009)
Bates, E., Wulfeck, B., MacWhinney, B.: Cross-linguistic research in aphasia: an overview. Brain Lang. 41, 123–148 (1991)
Lukoševičius, M., Jaeger, H.: Reservoir computing approaches to recurrent neural network training. Computer Science Review 3(3), 127–149 (2009)
Elman, J.L.: Learning and development in neural networks: the importance of starting small. Cognition 48, 71–99 (1993)
Tong, M.H., Bicket, A.D., Christiansen, E.M., Cottrell, G.W.: Learning grammatical structure with Echo State Networks. Neural Networks 20(3), 424–432 (2007)
van der Velde, F., de Kamps, M.: Neural blackboard architectures of combinatorial structures in cognition. Behavioral and Brain Sciences 29(1), 37–70; discussion 70–108 (2006)
Pascanu, R., Jaeger, H.: A neurodynamical model for working memory. Neural Networks 24(2), 199–207 (2011)
Friederici, A.D., Bahlmann, J., Heim, S., Schubotz, R.I., Anwander, A.: The brain differentiates human and non-human grammars: functional localization and structural connectivity. Proc. Natl. Acad. Sci. USA 103, 2458–2463 (2006)
Oger toolbox, http://organic.elis.ugent.be/oger
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hinaut, X., Dominey, P.F. (2012). On-Line Processing of Grammatical Structure Using Reservoir Computing. In: Villa, A.E.P., Duch, W., Érdi, P., Masulli, F., Palm, G. (eds) Artificial Neural Networks and Machine Learning – ICANN 2012. ICANN 2012. Lecture Notes in Computer Science, vol 7552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33269-2_75
Download citation
DOI: https://doi.org/10.1007/978-3-642-33269-2_75
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33268-5
Online ISBN: 978-3-642-33269-2
eBook Packages: Computer ScienceComputer Science (R0)