dorsal/arxiv
View SchemaPerception Test 2025: Challenge Summary and a Unified VQA Extension
| Authors | Joseph Heyward, Nikhil Pathasarathy, Tyler Zhu, Aravindh Mahendran, João Carreira, Dima Damen, Andrew Zisserman, Viorica Pătrăucean |
|---|---|
| Categories | |
| ArXiv ID | 2601.06287vv1 |
| URL | https://arxiv.org/abs/2601.06287 |
| License | http://creativecommons.org/licenses/by/4.0/ |
Abstract
The Third Perception Test challenge was organised as a full-day workshop alongside the IEEE/CVF International Conference on Computer Vision (ICCV) 2025. Its primary goal is to benchmark state-of-the-art video models and measure the progress in multimodal perception. This year, the workshop featured 2 guest tracks as well: KiVA (an image understanding challenge) and Physic-IQ (a video generation challenge). In this report, we summarise the results from the main Perception Test challenge, detailing both the existing tasks as well as novel additions to the benchmark. In this iteration, we placed an emphasis on task unification, as this poses a more challenging test for current SOTA multimodal models. The challenge included five consolidated tracks: unified video QA, unified object and point tracking, unified action and sound localisation, grounded video QA, and hour-long video QA, alongside an analysis and interpretability track that is still open for submissions. Notably, the unified video QA track introduced a novel subset that reformulates traditional perception tasks (such as point tracking and temporal action localisation) as multiple-choice video QA questions that video-language models can natively tackle. The unified object and point tracking merged the original object tracking and point tracking tasks, whereas the unified action and sound localisation merged the original temporal action localisation and temporal sound localisation tracks. Accordingly, we required competitors to use unified approaches rather than engineered pipelines with task-specific models. By proposing such a unified challenge, Perception Test 2025 highlights the significant difficulties existing models face when tackling diverse perception tasks through unified interfaces.
{
"annotation_id": "5f583a1f-1af4-4a01-aed1-98d4ca5a49f1",
"date_created": "2026-02-17T05:53:08.811000Z",
"date_modified": "2026-02-17T05:53:08.811000Z",
"file_hash": "a9bdad924ed83d3deef5221bad76efeef4be91121558511f0ab75ed9bbb3cd1e",
"private": false,
"record": {
"abstract": "The Third Perception Test challenge was organised as a full-day workshop alongside the IEEE/CVF International Conference on Computer Vision (ICCV) 2025. Its primary goal is to benchmark state-of-the-art video models and measure the progress in multimodal perception. This year, the workshop featured 2 guest tracks as well: KiVA (an image understanding challenge) and Physic-IQ (a video generation challenge). In this report, we summarise the results from the main Perception Test challenge, detailing both the existing tasks as well as novel additions to the benchmark. In this iteration, we placed an emphasis on task unification, as this poses a more challenging test for current SOTA multimodal models. The challenge included five consolidated tracks: unified video QA, unified object and point tracking, unified action and sound localisation, grounded video QA, and hour-long video QA, alongside an analysis and interpretability track that is still open for submissions. Notably, the unified video QA track introduced a novel subset that reformulates traditional perception tasks (such as point tracking and temporal action localisation) as multiple-choice video QA questions that video-language models can natively tackle. The unified object and point tracking merged the original object tracking and point tracking tasks, whereas the unified action and sound localisation merged the original temporal action localisation and temporal sound localisation tracks. Accordingly, we required competitors to use unified approaches rather than engineered pipelines with task-specific models. By proposing such a unified challenge, Perception Test 2025 highlights the significant difficulties existing models face when tackling diverse perception tasks through unified interfaces.",
"arxiv_id": "2601.06287",
"authors": [
"Joseph Heyward",
"Nikhil Pathasarathy",
"Tyler Zhu",
"Aravindh Mahendran",
"Jo\u00e3o Carreira",
"Dima Damen",
"Andrew Zisserman",
"Viorica P\u0103tr\u0103ucean"
],
"categories": [
"cs.CV"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"title": "Perception Test 2025: Challenge Summary and a Unified VQA Extension",
"url": "https://arxiv.org/abs/2601.06287",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "196fdc44-5990-4151-b78d-05c17b1d5681",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}