dorsal/arxiv
View SchemaHeterogeneous computing platform for real-time robotics
| Authors | Jakub Fil, Yulia Sandamirskaya, Hector Gonzalez, Loïc Azzalin, Stefan Glüge, Lukas Friedenstab, Friedrich Wolf, Tim Rosmeisl, Matthias Lohrmann, Mahmoud Akl, Khaleel Khan, Leonie Wolf, Kristin Richter, Holm Puder, Mazhar Ali Bari, Xuan Choo, Noha Alharthi, Michael Hopkins, Mansoor Hanif Christian Mayr, Jens Struckmeier, Steve Furber |
|---|---|
| Categories | |
| ArXiv ID | 2601.09755vv1 |
| URL | https://arxiv.org/abs/2601.09755 |
| License | http://creativecommons.org/licenses/by-nc-nd/4.0/ |
Abstract
After Industry 4.0 has embraced tight integration between machinery (OT), software (IT), and the Internet, creating a web of sensors, data, and algorithms in service of efficient and reliable production, a new concept of Society 5.0 is emerging, in which infrastructure of a city will be instrumented to increase reliability, efficiency, and safety. Robotics will play a pivotal role in enabling this vision that is pioneered by the NEOM initiative - a smart city, co-inhabited by humans and robots. In this paper we explore the computing platform that will be required to enable this vision. We show how we can combine neuromorphic computing hardware, exemplified by the Loihi2 processor used in conjunction with event-based cameras, for sensing and real-time perception and interaction with a local AI compute cluster (GPUs) for high-level language processing, cognition, and task planning. We demonstrate the use of this hybrid computing architecture in an interactive task, in which a humanoid robot plays a musical instrument with a human. Central to our design is the efficient and seamless integration of disparate components, ensuring that the synergy between software and hardware maximizes overall performance and responsiveness. Our proposed system architecture underscores the potential of heterogeneous computing architectures in advancing robotic autonomy and interactive intelligence, pointing toward a future where such integrated systems become the norm in complex, real-time applications.
{
"annotation_id": "a1600747-8dd6-4967-960c-970cda29aa21",
"date_created": "2026-02-17T05:53:24.048000Z",
"date_modified": "2026-02-17T05:53:24.048000Z",
"file_hash": "b9f4e6a60712b069b2b1651be27872a8141b592c0683bc7a2aa794ccea67ab59",
"private": false,
"record": {
"abstract": "After Industry 4.0 has embraced tight integration between machinery (OT), software (IT), and the Internet, creating a web of sensors, data, and algorithms in service of efficient and reliable production, a new concept of Society 5.0 is emerging, in which infrastructure of a city will be instrumented to increase reliability, efficiency, and safety. Robotics will play a pivotal role in enabling this vision that is pioneered by the NEOM initiative - a smart city, co-inhabited by humans and robots. In this paper we explore the computing platform that will be required to enable this vision. We show how we can combine neuromorphic computing hardware, exemplified by the Loihi2 processor used in conjunction with event-based cameras, for sensing and real-time perception and interaction with a local AI compute cluster (GPUs) for high-level language processing, cognition, and task planning. We demonstrate the use of this hybrid computing architecture in an interactive task, in which a humanoid robot plays a musical instrument with a human. Central to our design is the efficient and seamless integration of disparate components, ensuring that the synergy between software and hardware maximizes overall performance and responsiveness. Our proposed system architecture underscores the potential of heterogeneous computing architectures in advancing robotic autonomy and interactive intelligence, pointing toward a future where such integrated systems become the norm in complex, real-time applications.",
"arxiv_id": "2601.09755",
"authors": [
"Jakub Fil",
"Yulia Sandamirskaya",
"Hector Gonzalez",
"Lo\u00efc Azzalin",
"Stefan Gl\u00fcge",
"Lukas Friedenstab",
"Friedrich Wolf",
"Tim Rosmeisl",
"Matthias Lohrmann",
"Mahmoud Akl",
"Khaleel Khan",
"Leonie Wolf",
"Kristin Richter",
"Holm Puder",
"Mazhar Ali Bari",
"Xuan Choo",
"Noha Alharthi",
"Michael Hopkins",
"Mansoor Hanif Christian Mayr",
"Jens Struckmeier",
"Steve Furber"
],
"categories": [
"cs.NE",
"cs.AI",
"cs.RO"
],
"license": "http://creativecommons.org/licenses/by-nc-nd/4.0/",
"title": "Heterogeneous computing platform for real-time robotics",
"url": "https://arxiv.org/abs/2601.09755",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "189266e4-c214-4883-b01e-5e7f07a7b865",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}