dorsal/arxiv
View SchemaInference of entropies of discrete random variables with unknown cardinalities
| Authors | Ilya Nemenman |
|---|---|
| Categories | |
| ArXiv ID | physics/0207009 |
| URL | https://arxiv.org/abs/physics/0207009 |
| DOI | 10.3390/e13122013 |
| Journal | Entropy 2011, 13, 2013-2023 |
Abstract
We examine the recently introduced NSB estimator of entropies of severely undersampled discrete variables and devise a procedure for calculating the involved integrals. We discover that the output of the estimator has a well defined limit for large cardinalities of the variables being studied. Thus one can estimate entropies with no a priori assumptions about these cardinalities, and a closed form solution for such estimates is given.
{
"annotation_id": "e6365e41-c6d7-4e11-a3d7-745275df1c66",
"date_created": "2026-03-02T18:00:39.875000Z",
"date_modified": "2026-03-02T18:00:39.875000Z",
"file_hash": "86b00fa817672e5dafa7495f6724c3cdc8b2b693a70922cfe354c09ca0148b42",
"private": false,
"record": {
"abstract": "We examine the recently introduced NSB estimator of entropies of severely\nundersampled discrete variables and devise a procedure for calculating the\ninvolved integrals. We discover that the output of the estimator has a well\ndefined limit for large cardinalities of the variables being studied. Thus one\ncan estimate entropies with no a priori assumptions about these cardinalities,\nand a closed form solution for such estimates is given.",
"arxiv_id": "physics/0207009",
"authors": [
"Ilya Nemenman"
],
"categories": [
"physics.data-an"
],
"doi": "10.3390/e13122013",
"journal_ref": "Entropy 2011, 13, 2013-2023",
"title": "Inference of entropies of discrete random variables with unknown cardinalities",
"url": "https://arxiv.org/abs/physics/0207009"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "bc68e596-2e2d-4624-93ae-b6d943bcf387",
"id": "arXiv Dataset IDs",
"type": "Model",
"variant": "snapshot-2026-03-01",
"version": "0.1.0"
},
"user_id": 1000002
}