dorsal/arxiv
View SchemaDanQing: An Up-to-Date Large-Scale Chinese Vision-Language Pre-training Dataset
| Authors | Hengyu Shen, Tiancheng Gu, Bin Qin, Lan Wu, Yuling Wu, Shuo Tan, Zelong Sun, Jun Wang, Nan Wu, Xiang An, Weidong Cai, Ziyong Feng, Kaicheng Yang |
|---|---|
| Categories | |
| ArXiv ID | 2601.10305vv1 |
| URL | https://arxiv.org/abs/2601.10305 |
| License | http://creativecommons.org/licenses/by/4.0/ |
Abstract
Vision-Language Pre-training (VLP) models demonstrate strong performance across various downstream tasks by learning from large-scale image-text pairs through contrastive pretraining. The release of extensive English image-text datasets (e.g., COYO-700M and LAION-400M) has enabled widespread adoption of models such as CLIP and SigLIP in tasks including cross-modal retrieval and image captioning. However, the advancement of Chinese vision-language pretraining has substantially lagged behind, due to the scarcity of high-quality Chinese image-text data. To address this gap, we develop a comprehensive pipeline for constructing a high-quality Chinese cross-modal dataset. As a result, we propose DanQing, which contains 100 million image-text pairs collected from Common Crawl. Different from existing datasets, DanQing is curated through a more rigorous selection process, yielding superior data quality. Moreover, DanQing is primarily built from 2024-2025 web data, enabling models to better capture evolving semantic trends and thus offering greater practical utility. We compare DanQing with existing datasets by continual pre-training of the SigLIP2 model. Experimental results show that DanQing consistently achieves superior performance across a range of Chinese downstream tasks, including zero-shot classification, cross-modal retrieval, and LMM-based evaluations. To facilitate further research in Chinese vision-language pre-training, we will open-source the DanQing dataset under the Creative Common CC-BY 4.0 license.
{
"annotation_id": "ac9b8974-80d8-4c88-bef1-389e566897d9",
"date_created": "2026-02-17T05:53:24.331000Z",
"date_modified": "2026-02-17T05:53:24.331000Z",
"file_hash": "74b6b67f112982289cef86f925f96bb6d80d52a4fa3e6f625a51dd9941d6e282",
"private": false,
"record": {
"abstract": "Vision-Language Pre-training (VLP) models demonstrate strong performance across various downstream tasks by learning from large-scale image-text pairs through contrastive pretraining. The release of extensive English image-text datasets (e.g., COYO-700M and LAION-400M) has enabled widespread adoption of models such as CLIP and SigLIP in tasks including cross-modal retrieval and image captioning. However, the advancement of Chinese vision-language pretraining has substantially lagged behind, due to the scarcity of high-quality Chinese image-text data. To address this gap, we develop a comprehensive pipeline for constructing a high-quality Chinese cross-modal dataset. As a result, we propose DanQing, which contains 100 million image-text pairs collected from Common Crawl. Different from existing datasets, DanQing is curated through a more rigorous selection process, yielding superior data quality. Moreover, DanQing is primarily built from 2024-2025 web data, enabling models to better capture evolving semantic trends and thus offering greater practical utility. We compare DanQing with existing datasets by continual pre-training of the SigLIP2 model. Experimental results show that DanQing consistently achieves superior performance across a range of Chinese downstream tasks, including zero-shot classification, cross-modal retrieval, and LMM-based evaluations. To facilitate further research in Chinese vision-language pre-training, we will open-source the DanQing dataset under the Creative Common CC-BY 4.0 license.",
"arxiv_id": "2601.10305",
"authors": [
"Hengyu Shen",
"Tiancheng Gu",
"Bin Qin",
"Lan Wu",
"Yuling Wu",
"Shuo Tan",
"Zelong Sun",
"Jun Wang",
"Nan Wu",
"Xiang An",
"Weidong Cai",
"Ziyong Feng",
"Kaicheng Yang"
],
"categories": [
"cs.CV",
"cs.AI"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"title": "DanQing: An Up-to-Date Large-Scale Chinese Vision-Language Pre-training Dataset",
"url": "https://arxiv.org/abs/2601.10305",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "ef120659-0914-4e2e-9bea-bec78a8c828e",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}