dorsal/arxiv
View SchemaAn Application of Renormalization Group Techniques to Classical Information Theory
| Authors | Robert R. Tucci |
|---|---|
| Categories | |
| ArXiv ID | quant-ph/0303154 |
| URL | https://arxiv.org/abs/quant-ph/0303154 |
Abstract
We apply Renormalization Group (RG) techniques to Classical Information Theory, in the limit of large codeword size $n$. In particular, we apply RG techniques to (1) noiseless coding (i.e., a coding used for compression) and (2) noisy coding (i.e., a coding used for channel transmission). Shannon's "first" and "second" theorems refer to (1) and (2), respectively. Our RG technique uses composition class (CC) ideas, so we call our technique Composition Class Renormalization Group (CCRG). Often, CC's are called "types" instead of CC's, and their theory is referred to as the "Method of Types". For (1) and (2), we find that the probability of error can be expressed as an Error Function whose argument contains variables that obey renormalization group equations. We describe a computer program called WimpyRG-C1.0 that implements the ideas of this paper. C++ source code for WimpyRG-C1.0 is publicly available.
{
"annotation_id": "cf07becb-4c29-42c0-9d5a-c64747052d34",
"date_created": "2026-03-02T18:01:59.561000Z",
"date_modified": "2026-03-02T18:01:59.561000Z",
"file_hash": "b0365a5444908cb15cd2336f8057682e9dcf47c4b824cb4b1b12d65a74fb8438",
"private": false,
"record": {
"abstract": "We apply Renormalization Group (RG) techniques to Classical Information\nTheory, in the limit of large codeword size $n$. In particular, we apply RG\ntechniques to (1) noiseless coding (i.e., a coding used for compression) and\n(2) noisy coding (i.e., a coding used for channel transmission). Shannon\u0027s\n\"first\" and \"second\" theorems refer to (1) and (2), respectively. Our RG\ntechnique uses composition class (CC) ideas, so we call our technique\nComposition Class Renormalization Group (CCRG). Often, CC\u0027s are called \"types\"\ninstead of CC\u0027s, and their theory is referred to as the \"Method of Types\". For\n(1) and (2), we find that the probability of error can be expressed as an Error\nFunction whose argument contains variables that obey renormalization group\nequations. We describe a computer program called WimpyRG-C1.0 that implements\nthe ideas of this paper. C++ source code for WimpyRG-C1.0 is publicly\navailable.",
"arxiv_id": "quant-ph/0303154",
"authors": [
"Robert R. Tucci"
],
"categories": [
"quant-ph"
],
"title": "An Application of Renormalization Group Techniques to Classical Information Theory",
"url": "https://arxiv.org/abs/quant-ph/0303154"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "30b7c601-adf6-4863-91f2-82e17b8d799d",
"id": "arXiv Dataset IDs",
"type": "Model",
"variant": "snapshot-2026-03-01",
"version": "0.1.0"
},
"user_id": 1000002
}