dorsal/arxiv
View SchemaConfidence Limits and their Robustness
| Authors | Rajendran Raja |
|---|---|
| Categories | |
| ArXiv ID | physics/0207058 |
| URL | https://arxiv.org/abs/physics/0207058 |
Abstract
Confidence limits are common place in physics analysis. Great care must be taken in their calculation and use, especially in cases of limited statistics when often one-sided limits are quoted. In order to estimate the stability of the confidence levels to addition of more data and/or change of cuts, we argue that the variance of their sampling distributions be calculated in addition to the limit itself. The square root of the variance of their sampling distribution can be thought of as a statistical error on the limit. We thus introduce the concept of statistical errors of confidence limits and argue that not only should limits be calculated but also their errors in order to represent the results of the analysis to the fullest. We show that comparison of two different limits from two different experiments becomes easier when their errors are also quoted. Use of errors of confidence limits will lead to abatement of the debate on which method is best suited to calculate confidence limits.
{
"annotation_id": "4c1dced9-0eea-4293-adec-f2f28bf8f1b8",
"date_created": "2026-03-02T18:00:39.649000Z",
"date_modified": "2026-03-02T18:00:39.649000Z",
"file_hash": "9fe560b22d0f1627ac4067712850b823db0fdeac990ccf7481d8dd621444b6f1",
"private": false,
"record": {
"abstract": "Confidence limits are common place in physics analysis. Great care must be\ntaken in their calculation and use, especially in cases of limited statistics\nwhen often one-sided limits are quoted. In order to estimate the stability of\nthe confidence levels to addition of more data and/or change of cuts, we argue\nthat the variance of their sampling distributions be calculated in addition to\nthe limit itself. The square root of the variance of their sampling\ndistribution can be thought of as a statistical error on the limit. We thus\nintroduce the concept of statistical errors of confidence limits and argue that\nnot only should limits be calculated but also their errors in order to\nrepresent the results of the analysis to the fullest. We show that comparison\nof two different limits from two different experiments becomes easier when\ntheir errors are also quoted. Use of errors of confidence limits will lead to\nabatement of the debate on which method is best suited to calculate confidence\nlimits.",
"arxiv_id": "physics/0207058",
"authors": [
"Rajendran Raja"
],
"categories": [
"physics.data-an",
"physics.gen-ph"
],
"title": "Confidence Limits and their Robustness",
"url": "https://arxiv.org/abs/physics/0207058"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "856c160f-336d-4fc4-b518-4268e60ed2cc",
"id": "arXiv Dataset IDs",
"type": "Model",
"variant": "snapshot-2026-03-01",
"version": "0.1.0"
},
"user_id": 1000002
}