Connectionism: Difference between revisions

Content deleted Content added
Fc2046 (talk | contribs)
add examples of models that use variable binding to simulate symbolic abilities
Fc2046 (talk | contribs)
m reuse reference
Line 78:
* Computationalists often posit [[domain specificity|domain specific]] symbolic sub-systems designed to support learning in specific areas of cognition (e.g., language, intentionality, number), whereas connectionists posit one or a small set of very general learning-mechanisms.
 
Despite these differences, some theorists have proposed that the connectionist architecture is simply the manner in which organic brains happen to implement the symbol-manipulation system. This is logically possible, as it is well known that connectionist models can implement symbol-manipulation systems of the kind used in computationalist models<ref name=":3">{{Cite journal|last=Chang|first=Franklin|date=2002|title=Symbolically speaking: a connectionist model of sentence production|url=https://onlinelibrary.wiley.com/doi/abs/10.1207/s15516709cog2605_3|journal=Cognitive Science|language=en|volume=26|issue=5|pages=609–651|doi=10.1207/s15516709cog2605_3|issn=1551-6709}}</ref>, as indeed they must be able if they are to explain the human ability to perform symbol-manipulation tasks. Several cognitive models combining both symbol-manipulative and connectionist architectures have been proposed, notably among them [[Paul Smolensky]]'s Integrated Connectionist/Symbolic Cognitive Architecture (ICS).<ref name=":0" /><ref>{{Cite journal|last=Smolensky|first=Paul|date=1990|title=Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems|url=http://www.lscp.net/persons/dupoux/teaching/AT1_2012/papers/Smolensky_1990_TensorProductVariableBinding.AI.pdf|journal=Artificial Intelligence|volume=46|pages=159-216|via=}}</ref> But the debate rests on whether this symbol manipulation forms the foundation of cognition in general, so this is not a potential vindication of computationalism. Nonetheless, computational descriptions may be helpful high-level descriptions of cognition of logic, for example.
 
The debate was largely centred on logical arguments about whether connectionist networks could produce the syntactic structure observed in this sort of reasoning. This was later achieved although using fast-variable binding abilities outside of those standardly assumed in connectionist models<ref>{{Cite journal|lastname=Chang|first=Franklin|date=2002|title=Symbolically speaking":3" a connectionist model of sentence production|url=https://onlinelibrary.wiley.com/doi/abs/10.1207/s15516709cog2605_3|journal=Cognitive Science|language=en|volume=26|issue=5|pages=609–651|doi=10.1207/s15516709cog2605_3|issn=1551-6709}}</ref><ref>{{Cite journal|last=Shastri|first=Lokendra|last2=Ajjanagadde|first2=Venkat|date=1993/09|title=From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony|url=https://www.cambridge.org/core/journals/behavioral-and-brain-sciences/article/from-simple-associations-to-systematic-reasoning-a-connectionist-representation-of-rules-variables-and-dynamic-bindings-using-temporal-synchrony/A00CC41AFE06B361E644DAC5ED8F65A3|journal=Behavioral and Brain Sciences|language=en|volume=16|issue=3|pages=417–451|doi=10.1017/S0140525X00030910|issn=1469-1825}}</ref>. {{As of | 2016}}, progress in neurophysiology and general advances in the understanding of neural networks have led to the successful modelling of a great many of these early problems, and the debate about fundamental cognition has, thus, largely been decided among neuroscientists in favour of connectionism.{{citation needed|date=March 2012}} However, these fairly recent developments have yet to reach consensus acceptance among those working in other fields, such as psychology or philosophy of mind.
 
Part of the appeal of computational descriptions is that they are relatively easy to interpret, and thus may be seen as contributing to our understanding of particular mental processes, whereas connectionist models are in general more opaque, to the extent that they may be describable only in very general terms (such as specifying the learning algorithm, the number of units, etc.), or in unhelpfully low-level terms. In this sense connectionist models may instantiate, and thereby provide evidence for, a broad theory of cognition (i.e., connectionism), without representing a helpful theory of the particular process that is being modelled. In this sense the debate might be considered as to some extent reflecting a mere difference in the level of analysis in which particular theories are framed. Some researchers suggest that the analysis gap is the consequence of connectionist mechanisms giving rise to [[Emergence|emergent phenomena]] that may be describable in computational terms.<ref>{{Cite journal|last=Ellis|first=Nick C.|date=1998|title=Emergentism, Connectionism and Language Learning|url=http://www-personal.umich.edu/~ncellis/NickEllis/Publications_files/Emergentism.pdf|journal=Language Learning|volume=48:4|pages=631-664|via=}}</ref>