dorsal/arxiv
View SchemaFrom SERPs to Agents: A Platform for Comparative Studies of Information Interaction
| Authors | Saber Zerhoudi, Michael Granitzer |
|---|---|
| Categories | |
| ArXiv ID | 2601.09937vv1 |
| URL | https://arxiv.org/abs/2601.09937 |
| DOI | 10.1145/3786304.3787948 |
| Journal | Proceedings of the 2026 ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR '26) |
| License | http://creativecommons.org/licenses/by/4.0/ |
Abstract
The diversification of information access systems, from RAG to autonomous agents, creates a critical need for comparative user studies. However, the technical overhead to deploy and manage these distinct systems is a major barrier. We present UXLab, an open-source system for web-based user studies that addresses this challenge. Its core is a web-based dashboard enabling the complete, no-code configuration of complex experimental designs. Researchers can visually manage the full study, from recruitment to comparing backends like traditional search, vector databases, and LLMs. We demonstrate UXLab's value via a micro case study comparing user behavior with RAG versus an autonomous agent. UXLab allows researchers to focus on experimental design and analysis, supporting future multi-modal interaction research.
{
"annotation_id": "5e0b0c9c-a87d-445d-8fc6-079d455f0e40",
"date_created": "2026-02-17T05:53:23.753000Z",
"date_modified": "2026-02-17T05:53:23.753000Z",
"file_hash": "642c865c357c522c4b1eb20ec87c64bd815a221dc066056dd756ea51cc078041",
"private": false,
"record": {
"abstract": "The diversification of information access systems, from RAG to autonomous agents, creates a critical need for comparative user studies. However, the technical overhead to deploy and manage these distinct systems is a major barrier. We present UXLab, an open-source system for web-based user studies that addresses this challenge. Its core is a web-based dashboard enabling the complete, no-code configuration of complex experimental designs. Researchers can visually manage the full study, from recruitment to comparing backends like traditional search, vector databases, and LLMs. We demonstrate UXLab\u0027s value via a micro case study comparing user behavior with RAG versus an autonomous agent. UXLab allows researchers to focus on experimental design and analysis, supporting future multi-modal interaction research.",
"arxiv_id": "2601.09937",
"authors": [
"Saber Zerhoudi",
"Michael Granitzer"
],
"categories": [
"cs.HC",
"cs.IR"
],
"doi": "10.1145/3786304.3787948",
"journal_ref": "Proceedings of the 2026 ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR \u002726)",
"license": "http://creativecommons.org/licenses/by/4.0/",
"title": "From SERPs to Agents: A Platform for Comparative Studies of Information Interaction",
"url": "https://arxiv.org/abs/2601.09937",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "bed3ee0d-36c7-4cb4-935a-4f55e39a53cd",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}