dorsal/arxiv
View SchemaResearch on Piano Timbre Transformation System Based on Diffusion Model
| Authors | Chun-Chieh Hsu, Tsai-Ling Hsu, Chen-Chen Yeh, Shao-Chien Lu, Cheng-Han Wu, Bing-Ze Liu, Timothy K. Shih, Yu-Cheng Lin |
|---|---|
| Categories | |
| ArXiv ID | 2601.09333vv1 |
| URL | https://arxiv.org/abs/2601.09333 |
| License | http://arxiv.org/licenses/nonexclusive-distrib/1.0/ |
Abstract
We propose a timbre conversion model based on the Diffusion architecture de-signed to precisely translate music played by various instruments into piano ver-sions. The model employs a Pitch Encoder and Loudness Encoder to extract pitch and loudness features of the music, which serve as conditional inputs to the Dif-fusion Model's decoder, generating high-quality piano timbres. Case analysis re-sults show that the model performs excellently in terms of pitch accuracy and timbral similarity, maintaining stable conversion across different musical styles (classical, jazz, pop) and lengths (from short clips to full pieces). Particularly, the model maintains high sound quality and accuracy even when dealing with rapidly changing notes and complex musical structures, demonstrating good generaliza-tion capability. Additionally, the model has the potential for real-time musical conversion and is suitable for live performances and digital music creation tools. Future research will focus on enhancing the handling of loudness dynamics and incorporating additional musical features (such as timbral variations and rhythmic complexity) to improve the model's adaptability and expressiveness. We plan to explore the model's application potential in other timbre conversion tasks, such as converting vocals to instrumental sounds or integration with MIDI digital pianos, further expanding the application scope of the Diffusion-based timbre conversion model in the field of music generation.
{
"annotation_id": "7763c1df-91f5-4ff6-8054-bf8ad4dcfaf3",
"date_created": "2026-02-17T05:53:19.898000Z",
"date_modified": "2026-02-17T05:53:19.898000Z",
"file_hash": "afc19d20531eb3c2c13710ce33990f08a21e9c7e64133e87932a5de85e81d7a3",
"private": false,
"record": {
"abstract": "We propose a timbre conversion model based on the Diffusion architecture de-signed to precisely translate music played by various instruments into piano ver-sions. The model employs a Pitch Encoder and Loudness Encoder to extract pitch and loudness features of the music, which serve as conditional inputs to the Dif-fusion Model\u0027s decoder, generating high-quality piano timbres. Case analysis re-sults show that the model performs excellently in terms of pitch accuracy and timbral similarity, maintaining stable conversion across different musical styles (classical, jazz, pop) and lengths (from short clips to full pieces). Particularly, the model maintains high sound quality and accuracy even when dealing with rapidly changing notes and complex musical structures, demonstrating good generaliza-tion capability. Additionally, the model has the potential for real-time musical conversion and is suitable for live performances and digital music creation tools. Future research will focus on enhancing the handling of loudness dynamics and incorporating additional musical features (such as timbral variations and rhythmic complexity) to improve the model\u0027s adaptability and expressiveness. We plan to explore the model\u0027s application potential in other timbre conversion tasks, such as converting vocals to instrumental sounds or integration with MIDI digital pianos, further expanding the application scope of the Diffusion-based timbre conversion model in the field of music generation.",
"arxiv_id": "2601.09333",
"authors": [
"Chun-Chieh Hsu",
"Tsai-Ling Hsu",
"Chen-Chen Yeh",
"Shao-Chien Lu",
"Cheng-Han Wu",
"Bing-Ze Liu",
"Timothy K. Shih",
"Yu-Cheng Lin"
],
"categories": [
"cs.SD",
"cs.MM"
],
"license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
"title": "Research on Piano Timbre Transformation System Based on Diffusion Model",
"url": "https://arxiv.org/abs/2601.09333",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "f7f8840e-68f3-4fb2-b99c-f576ae533ea1",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}