dorsal/arxiv
View SchemaPersonaDual: Balancing Personalization and Objectivity via Adaptive Reasoning
| Authors | Xiaoyou Liu, Xinyi Mou, Shengbin Yue, Liang Wang, Yuqing Wang, Qiexiang Wang, Tianrui Qin, Wangchunshu Zhou, Zhongyu Wei |
|---|---|
| Categories | |
| ArXiv ID | 2601.08679vv1 |
| URL | https://arxiv.org/abs/2601.08679 |
| License | http://arxiv.org/licenses/nonexclusive-distrib/1.0/ |
Abstract
As users increasingly expect LLMs to align with their preferences, personalized information becomes valuable. However, personalized information can be a double-edged sword: it can improve interaction but may compromise objectivity and factual correctness, especially when it is misaligned with the question. To alleviate this problem, we propose PersonaDual, a framework that supports both general-purpose objective reasoning and personalized reasoning in a single model, and adaptively switches modes based on context. PersonaDual is first trained with SFT to learn two reasoning patterns, and then further optimized via reinforcement learning with our proposed DualGRPO to improve mode selection. Experiments on objective and personalized benchmarks show that PersonaDual preserves the benefits of personalization while reducing interference, achieving near interference-free performance and better leveraging helpful personalized signals to improve objective problem-solving.
{
"annotation_id": "79b48ed6-7374-442f-82a6-a78cf79d9081",
"date_created": "2026-02-17T05:53:16.132000Z",
"date_modified": "2026-02-17T05:53:16.132000Z",
"file_hash": "b43a8af4ac7849549a77d1b8f66fce8f627cd98ee04ee30e3691d365dfda3ce5",
"private": false,
"record": {
"abstract": "As users increasingly expect LLMs to align with their preferences, personalized information becomes valuable. However, personalized information can be a double-edged sword: it can improve interaction but may compromise objectivity and factual correctness, especially when it is misaligned with the question. To alleviate this problem, we propose PersonaDual, a framework that supports both general-purpose objective reasoning and personalized reasoning in a single model, and adaptively switches modes based on context. PersonaDual is first trained with SFT to learn two reasoning patterns, and then further optimized via reinforcement learning with our proposed DualGRPO to improve mode selection. Experiments on objective and personalized benchmarks show that PersonaDual preserves the benefits of personalization while reducing interference, achieving near interference-free performance and better leveraging helpful personalized signals to improve objective problem-solving.",
"arxiv_id": "2601.08679",
"authors": [
"Xiaoyou Liu",
"Xinyi Mou",
"Shengbin Yue",
"Liang Wang",
"Yuqing Wang",
"Qiexiang Wang",
"Tianrui Qin",
"Wangchunshu Zhou",
"Zhongyu Wei"
],
"categories": [
"cs.AI"
],
"license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
"title": "PersonaDual: Balancing Personalization and Objectivity via Adaptive Reasoning",
"url": "https://arxiv.org/abs/2601.08679",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "8753a29a-f6b6-495d-92f4-0dfbc0ced4e0",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}