dorsal/arxiv
View SchemaSTEAMROLLER: A Multi-Agent System for Inclusive Automatic Speech Recognition for People who Stutter
| Authors | Ziqi Xu, Yi Liu, Yuekang Li, Ling Shi, Kailong Wang, Yongxin Zhao |
|---|---|
| Categories | |
| ArXiv ID | 2601.10223vv1 |
| URL | https://arxiv.org/abs/2601.10223 |
| License | http://creativecommons.org/licenses/by/4.0/ |
Abstract
People who stutter (PWS) face systemic exclusion in today's voice-driven society, where access to voice assistants, authentication systems, and remote work tools increasingly depends on fluent speech. Current automatic speech recognition (ASR) systems, trained predominantly on fluent speech, fail to serve millions of PWS worldwide. We present STEAMROLLER, a real time system that transforms stuttered speech into fluent output through a novel multi-stage, multi-agent AI pipeline. Our approach addresses three critical technical challenges: (1) the difficulty of direct speech to speech conversion for disfluent input, (2) semantic distortions introduced during ASR transcription of stuttered speech, and (3) latency constraints for real time communication. STEAMROLLER employs a three stage architecture comprising ASR transcription, multi-agent text repair, and speech synthesis, where our core innovation lies in a collaborative multi-agent framework that iteratively refines transcripts while preserving semantic intent. Experiments on the FluencyBank dataset and a user study demonstrates clear word error rate (WER) reduction and strong user satisfaction. Beyond immediate accessibility benefits, fine tuning ASR on STEAMROLLER repaired speech further yields additional WER improvements, creating a pathway toward inclusive AI ecosystems.
{
"annotation_id": "f43df0be-0fcf-40e8-ad56-87584f0ee6cf",
"date_created": "2026-02-17T05:53:23.604000Z",
"date_modified": "2026-02-17T05:53:23.604000Z",
"file_hash": "710e886a9a3942579784a8a1c39ce2cc1154c063c0a4fdcc24ee5444f1951638",
"private": false,
"record": {
"abstract": "People who stutter (PWS) face systemic exclusion in today\u0027s voice-driven society, where access to voice assistants, authentication systems, and remote work tools increasingly depends on fluent speech. Current automatic speech recognition (ASR) systems, trained predominantly on fluent speech, fail to serve millions of PWS worldwide. We present STEAMROLLER, a real time system that transforms stuttered speech into fluent output through a novel multi-stage, multi-agent AI pipeline. Our approach addresses three critical technical challenges: (1) the difficulty of direct speech to speech conversion for disfluent input, (2) semantic distortions introduced during ASR transcription of stuttered speech, and (3) latency constraints for real time communication. STEAMROLLER employs a three stage architecture comprising ASR transcription, multi-agent text repair, and speech synthesis, where our core innovation lies in a collaborative multi-agent framework that iteratively refines transcripts while preserving semantic intent. Experiments on the FluencyBank dataset and a user study demonstrates clear word error rate (WER) reduction and strong user satisfaction. Beyond immediate accessibility benefits, fine tuning ASR on STEAMROLLER repaired speech further yields additional WER improvements, creating a pathway toward inclusive AI ecosystems.",
"arxiv_id": "2601.10223",
"authors": [
"Ziqi Xu",
"Yi Liu",
"Yuekang Li",
"Ling Shi",
"Kailong Wang",
"Yongxin Zhao"
],
"categories": [
"cs.CY"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"title": "STEAMROLLER: A Multi-Agent System for Inclusive Automatic Speech Recognition for People who Stutter",
"url": "https://arxiv.org/abs/2601.10223",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "f56fe745-c845-491b-9c7e-aafc601b1e3d",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}