dorsal/arxiv
View SchemaUsing Adaptive Dynamic Programming to Understand and Replicate Brain Intelligence: the Next Level Design
| Authors | Paul J. Werbos |
|---|---|
| Categories | |
| ArXiv ID | q-bio/0612045 |
| URL | https://arxiv.org/abs/q-bio/0612045 |
Abstract
Since the 1960s I proposed that we could understand and replicate the highest level of intelligence seen in the brain, by building ever more capable and general systems for adaptive dynamic programming (ADP), which is like reinforcement learning but based on approximating the Bellman equation and allowing the controller to know its utility function. Growing empirical evidence on the brain supports this approach. Adaptive critic systems now meet tough engineering challenges and provide a kind of first-generation model of the brain. Lewis, Prokhorov and myself have early second-generation work. Mammal brains possess three core capabilities, creativity/imagination and ways to manage spatial and temporal complexity, even beyond the second generation. This paper reviews previous progress, and describes new tools and approaches to overcome the spatial complexity gap.
{
"annotation_id": "6ad82813-14ed-4ee7-90e9-160402e13f01",
"date_created": "2026-03-02T18:01:34.738000Z",
"date_modified": "2026-03-02T18:01:34.738000Z",
"file_hash": "8fda87d7ea44aacde186ba9fab5849d29220bfbeb56220b29c4d3169b383a739",
"private": false,
"record": {
"abstract": "Since the 1960s I proposed that we could understand and replicate the highest\nlevel of intelligence seen in the brain, by building ever more capable and\ngeneral systems for adaptive dynamic programming (ADP), which is like\nreinforcement learning but based on approximating the Bellman equation and\nallowing the controller to know its utility function. Growing empirical\nevidence on the brain supports this approach. Adaptive critic systems now meet\ntough engineering challenges and provide a kind of first-generation model of\nthe brain. Lewis, Prokhorov and myself have early second-generation work.\nMammal brains possess three core capabilities, creativity/imagination and ways\nto manage spatial and temporal complexity, even beyond the second generation.\nThis paper reviews previous progress, and describes new tools and approaches to\novercome the spatial complexity gap.",
"arxiv_id": "q-bio/0612045",
"authors": [
"Paul J. Werbos"
],
"categories": [
"q-bio.NC"
],
"title": "Using Adaptive Dynamic Programming to Understand and Replicate Brain Intelligence: the Next Level Design",
"url": "https://arxiv.org/abs/q-bio/0612045"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "101c3135-168e-44fb-8697-8cd8077d1483",
"id": "arXiv Dataset IDs",
"type": "Model",
"variant": "snapshot-2026-03-01",
"version": "0.1.0"
},
"user_id": 1000002
}