dorsal/arxiv
View SchemaNetwork information and connected correlations
| Authors | Elad Schneidman, Susanne Still, Michael J. Berry II, William Bialek |
|---|---|
| Categories | |
| ArXiv ID | physics/0307072 |
| URL | https://arxiv.org/abs/physics/0307072 |
| DOI | 10.1103/PhysRevLett.91.238701 |
| Journal | Phys. Rev. Lett. 91, 238701:1-4 (2003) |
Abstract
Entropy and information provide natural measures of correlation among elements in a network. We construct here the information theoretic analog of connected correlation functions: irreducible $N$--point correlation is measured by a decrease in entropy for the joint distribution of $N$ variables relative to the maximum entropy allowed by all the observed $N-1$ variable distributions. We calculate the ``connected information'' terms for several examples, and show that it also enables the decomposition of the information that is carried by a population of elements about an outside source.
{
"annotation_id": "9a00c850-74a3-4a4d-a1d1-6104314291b9",
"date_created": "2026-03-02T18:00:46.101000Z",
"date_modified": "2026-03-02T18:00:46.101000Z",
"file_hash": "5b765c2c2b3962c9bee53cb698d6a8d7673bcad6a67f7d3721273d9604245753",
"private": false,
"record": {
"abstract": "Entropy and information provide natural measures of correlation among\nelements in a network. We construct here the information theoretic analog of\nconnected correlation functions: irreducible $N$--point correlation is measured\nby a decrease in entropy for the joint distribution of $N$ variables relative\nto the maximum entropy allowed by all the observed $N-1$ variable\ndistributions. We calculate the ``connected information\u0027\u0027 terms for several\nexamples, and show that it also enables the decomposition of the information\nthat is carried by a population of elements about an outside source.",
"arxiv_id": "physics/0307072",
"authors": [
"Elad Schneidman",
"Susanne Still",
"Michael J. Berry II",
"William Bialek"
],
"categories": [
"physics.bio-ph",
"cond-mat.dis-nn",
"cond-mat.stat-mech",
"q-bio.NC"
],
"doi": "10.1103/PhysRevLett.91.238701",
"journal_ref": "Phys. Rev. Lett. 91, 238701:1-4 (2003)",
"title": "Network information and connected correlations",
"url": "https://arxiv.org/abs/physics/0307072"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "84d66a3b-6cc5-45c5-bcb3-5bb3121399ed",
"id": "arXiv Dataset IDs",
"type": "Model",
"variant": "snapshot-2026-03-01",
"version": "0.1.0"
},
"user_id": 1000002
}