dorsal/arxiv
View SchemaSelf-Sustained Thought Processes in a Dense Associative Network
| Authors | Claudius Gros |
|---|---|
| Categories | |
| ArXiv ID | q-bio/0508032 |
| URL | https://arxiv.org/abs/q-bio/0508032 |
| Journal | Proceedings of the 28th Annual German Conference on Artificial Intelligence (KI 2005), U. Furbach (Eds.): KI 2005, Springer Lecture Notes in Artificial Intelligence 3698, pp. 366-379, 2005 |
Abstract
Several guiding principles for thought processes are proposed and a neural-network-type model implementing these principles is presented and studied. We suggest to consider thinking within an associative network built-up of overlapping memory states. We consider a homogeneous associative network as biological considerations rule out distinct conjunction units between the information (the memories) stored in the brain. We therefore propose that memory states have a dual functionality: They represent on one side the stored information and serve, on the other side, as the associative links in between the different dynamical states of the network which consists of transient attractors. We implement these principles within a generalized winners-take-all neural network with sparse coding and an additional coupling to local reservoirs. We show that this network is capable to generate autonomously a self-sustained time-series of memory states which we identify with a thought process. Each memory state is associatively connected with its predecessor. This system shows several emerging features, it is able (a) to recognize external patterns in a noisy background, (b) to focus attention autonomously and (c) to represent hierarchical memory states with an internal structure.
{
"annotation_id": "55fcd7e7-1bc8-4241-8c9e-d2116e8cdbf7",
"date_created": "2026-03-02T18:01:31.358000Z",
"date_modified": "2026-03-02T18:01:31.358000Z",
"file_hash": "b5de9d2f358a6d50917e112bf687550ef52df74a7a5870ac7fa8c6c70214dff8",
"private": false,
"record": {
"abstract": "Several guiding principles for thought processes are proposed and a\nneural-network-type model implementing these principles is presented and\nstudied. We suggest to consider thinking within an associative network built-up\nof overlapping memory states. We consider a homogeneous associative network as\nbiological considerations rule out distinct conjunction units between the\ninformation (the memories) stored in the brain. We therefore propose that\nmemory states have a dual functionality: They represent on one side the stored\ninformation and serve, on the other side, as the associative links in between\nthe different dynamical states of the network which consists of transient\nattractors.\n We implement these principles within a generalized winners-take-all neural\nnetwork with sparse coding and an additional coupling to local reservoirs. We\nshow that this network is capable to generate autonomously a self-sustained\ntime-series of memory states which we identify with a thought process. Each\nmemory state is associatively connected with its predecessor.\n This system shows several emerging features, it is able (a) to recognize\nexternal patterns in a noisy background, (b) to focus attention autonomously\nand (c) to represent hierarchical memory states with an internal structure.",
"arxiv_id": "q-bio/0508032",
"authors": [
"Claudius Gros"
],
"categories": [
"q-bio.NC",
"nlin.AO",
"physics.bio-ph"
],
"journal_ref": "Proceedings of the 28th Annual German Conference on Artificial\n Intelligence (KI 2005), U. Furbach (Eds.): KI 2005, Springer Lecture Notes in\n Artificial Intelligence 3698, pp. 366-379, 2005",
"title": "Self-Sustained Thought Processes in a Dense Associative Network",
"url": "https://arxiv.org/abs/q-bio/0508032"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "10ecdc2c-a9d9-40da-8dcd-ce4d6c91ddc8",
"id": "arXiv Dataset IDs",
"type": "Model",
"variant": "snapshot-2026-03-01",
"version": "0.1.0"
},
"user_id": 1000002
}