dorsal/arxiv
View SchemaFrequentist Hypothesis Testing with Background Uncertainty
| Authors | Kyle S. Cranmer |
|---|---|
| Categories | |
| ArXiv ID | physics/0310108 |
| URL | https://arxiv.org/abs/physics/0310108 |
| Journal | ECONF C030908:WEMT004,2003 |
Abstract
We consider the standard Neyman-Pearson hypothesis test of a signal-plus-background hypothesis and background-only hypothesis in the presence of uncertainty on the background-only prediction. Surprisingly, this problem has not been addressed in the recent conferences on statistical techniques in high-energy physics -- although the its confidence-interval equivalent has been. We discuss the issues of power, similar tests, coverage, and ordering rules. The method presented is compared to the Cousins-Highland technique, the ratio of Poisson means, and ``profile'' method.
{
"annotation_id": "84dbc2e0-4dac-4cbf-9fd5-934305f2ec99",
"date_created": "2026-03-02T18:00:46.976000Z",
"date_modified": "2026-03-02T18:00:46.976000Z",
"file_hash": "6bc13756db898873c2bc535d62c61b2a356bcfcf8d7cd952324ea2add4ae1789",
"private": false,
"record": {
"abstract": "We consider the standard Neyman-Pearson hypothesis test of a\nsignal-plus-background hypothesis and background-only hypothesis in the\npresence of uncertainty on the background-only prediction. Surprisingly, this\nproblem has not been addressed in the recent conferences on statistical\ntechniques in high-energy physics -- although the its confidence-interval\nequivalent has been. We discuss the issues of power, similar tests, coverage,\nand ordering rules. The method presented is compared to the Cousins-Highland\ntechnique, the ratio of Poisson means, and ``profile\u0027\u0027 method.",
"arxiv_id": "physics/0310108",
"authors": [
"Kyle S. Cranmer"
],
"categories": [
"physics.data-an"
],
"journal_ref": "ECONF C030908:WEMT004,2003",
"title": "Frequentist Hypothesis Testing with Background Uncertainty",
"url": "https://arxiv.org/abs/physics/0310108"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "858d8827-4aa3-4d91-9da7-a755a7c17595",
"id": "arXiv Dataset IDs",
"type": "Model",
"variant": "snapshot-2026-03-01",
"version": "0.1.0"
},
"user_id": 1000002
}