dorsal/arxiv
View SchemaThe Need for a Socially-Grounded Persona Framework for User Simulation
| Authors | Pranav Narayanan Venkit, Yu Li, Yada Pruksachatkun, Chien-Sheng Wu |
|---|---|
| Categories | |
| ArXiv ID | 2601.07110vv1 |
| URL | https://arxiv.org/abs/2601.07110 |
| License | http://arxiv.org/licenses/nonexclusive-distrib/1.0/ |
Abstract
Synthetic personas are widely used to condition large language models (LLMs) for social simulation, yet most personas are still constructed from coarse sociodemographic attributes or summaries. We revisit persona creation by introducing SCOPE, a socially grounded framework for persona construction and evaluation, built from a 141-item, two-hour sociopsychological protocol collected from 124 U.S.-based participants. Across seven models, we find that demographic-only personas are a structural bottleneck: demographics explain only ~1.5% of variance in human response similarity. Adding sociopsychological facets improves behavioral prediction and reduces over-accentuation, and non-demographic personas based on values and identity achieve strong alignment with substantially lower bias. These trends generalize to SimBench (441 aligned questions), where SCOPE personas outperform default prompting and NVIDIA Nemotron personas, and SCOPE augmentation improves Nemotron-based personas. Our results indicate that persona quality depends on sociopsychological structure rather than demographic templates or summaries.
{
"annotation_id": "d8cbbf98-5d2f-4631-ac52-66146476a5e8",
"date_created": "2026-02-17T05:53:11.958000Z",
"date_modified": "2026-02-17T05:53:11.958000Z",
"file_hash": "ea98c7852dd08868841091bf668d0003e6a82d38f72a0ca377220ad468e02f21",
"private": false,
"record": {
"abstract": "Synthetic personas are widely used to condition large language models (LLMs) for social simulation, yet most personas are still constructed from coarse sociodemographic attributes or summaries. We revisit persona creation by introducing SCOPE, a socially grounded framework for persona construction and evaluation, built from a 141-item, two-hour sociopsychological protocol collected from 124 U.S.-based participants. Across seven models, we find that demographic-only personas are a structural bottleneck: demographics explain only ~1.5% of variance in human response similarity. Adding sociopsychological facets improves behavioral prediction and reduces over-accentuation, and non-demographic personas based on values and identity achieve strong alignment with substantially lower bias. These trends generalize to SimBench (441 aligned questions), where SCOPE personas outperform default prompting and NVIDIA Nemotron personas, and SCOPE augmentation improves Nemotron-based personas. Our results indicate that persona quality depends on sociopsychological structure rather than demographic templates or summaries.",
"arxiv_id": "2601.07110",
"authors": [
"Pranav Narayanan Venkit",
"Yu Li",
"Yada Pruksachatkun",
"Chien-Sheng Wu"
],
"categories": [
"cs.CL",
"cs.AI",
"cs.CY"
],
"license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
"title": "The Need for a Socially-Grounded Persona Framework for User Simulation",
"url": "https://arxiv.org/abs/2601.07110",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "c5b4c6fb-6803-4dac-b0b6-f0c875aa7eec",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}