dorsal/arxiv
View SchemaMeasures and Mismeasures of Scientific Quality
| Authors | Sune Lehmann, Andrew D. Jackson, Benny E. Lautrup |
|---|---|
| Categories | |
| ArXiv ID | physics/0512238 |
| URL | https://arxiv.org/abs/physics/0512238 |
Abstract
We present a general Bayesian method for quantifying the statistical reliability of one-dimensional measures of scientific quality based on citation data. Two quality measures used in practice -- ``papers per year'' and ``Hirsch's $h$'' -- are shown to lack the accuracy and precision necessary to be useful. The mean, median and maximum number of citations are on the other hand reliable and permit accurate predictions of future author performance on the basis of as few as 50 publications.
{
"annotation_id": "d4c65af1-b9af-4999-ad6d-bcaca53563d7",
"date_created": "2026-03-02T18:01:04.390000Z",
"date_modified": "2026-03-02T18:01:04.390000Z",
"file_hash": "39287d8a8cc448d5512e2e5675c0bcc3920611cb047441a02784d5b9c4b862ac",
"private": false,
"record": {
"abstract": "We present a general Bayesian method for quantifying the statistical\nreliability of one-dimensional measures of scientific quality based on citation\ndata. Two quality measures used in practice -- ``papers per year\u0027\u0027 and\n``Hirsch\u0027s $h$\u0027\u0027 -- are shown to lack the accuracy and precision necessary to\nbe useful. The mean, median and maximum number of citations are on the other\nhand reliable and permit accurate predictions of future author performance on\nthe basis of as few as 50 publications.",
"arxiv_id": "physics/0512238",
"authors": [
"Sune Lehmann",
"Andrew D. Jackson",
"Benny E. Lautrup"
],
"categories": [
"physics.soc-ph",
"physics.data-an"
],
"title": "Measures and Mismeasures of Scientific Quality",
"url": "https://arxiv.org/abs/physics/0512238"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "47a99802-065f-4f93-9d7f-4f04fcc7e68e",
"id": "arXiv Dataset IDs",
"type": "Model",
"variant": "snapshot-2026-03-01",
"version": "0.1.0"
},
"user_id": 1000002
}