dorsal/arxiv
View SchemaQuantEval: A Benchmark for Financial Quantitative Tasks in Large Language Models
| Authors | Zhaolu Kang, Junhao Gong, Wenqing Hu, Shuo Yin, Kehan Jiang, Zhicheng Fang, Yingjie He, Chunlei Meng, Rong Fu, Dongyang Chen, Leqi Zheng, Eric Hanchen Jiang, Yunfei Feng, Yitong Leng, Junfan Zhu, Xiaoyou Chen, Xi Yang, Richeng Xuan |
|---|---|
| Categories | |
| ArXiv ID | 2601.08689vv1 |
| URL | https://arxiv.org/abs/2601.08689 |
| License | http://arxiv.org/licenses/nonexclusive-distrib/1.0/ |
Abstract
Large Language Models (LLMs) have shown strong capabilities across many domains, yet their evaluation in financial quantitative tasks remains fragmented and mostly limited to knowledge-centric question answering. We introduce QuantEval, a benchmark that evaluates LLMs across three essential dimensions of quantitative finance: knowledge-based QA, quantitative mathematical reasoning, and quantitative strategy coding. Unlike prior financial benchmarks, QuantEval integrates a CTA-style backtesting framework that executes model-generated strategies and evaluates them using financial performance metrics, enabling a more realistic assessment of quantitative coding ability. We evaluate some state-of-the-art open-source and proprietary LLMs and observe substantial gaps to human experts, particularly in reasoning and strategy coding. Finally, we conduct large-scale supervised fine-tuning and reinforcement learning experiments on domain-aligned data, demonstrating consistent improvements. We hope QuantEval will facilitate research on LLMs' quantitative finance capabilities and accelerate their practical adoption in real-world trading workflows. We additionally release the full deterministic backtesting configuration (asset universe, cost model, and metric definitions) to ensure strict reproducibility.
{
"annotation_id": "db8d4a9e-95d1-4b31-8d2a-6959faaaee21",
"date_created": "2026-02-17T05:53:15.888000Z",
"date_modified": "2026-02-17T05:53:15.888000Z",
"file_hash": "10a3ba8703c54d70d55961a2393f57a0e11b22f87f044d6534eccf1518ff6443",
"private": false,
"record": {
"abstract": "Large Language Models (LLMs) have shown strong capabilities across many domains, yet their evaluation in financial quantitative tasks remains fragmented and mostly limited to knowledge-centric question answering. We introduce QuantEval, a benchmark that evaluates LLMs across three essential dimensions of quantitative finance: knowledge-based QA, quantitative mathematical reasoning, and quantitative strategy coding. Unlike prior financial benchmarks, QuantEval integrates a CTA-style backtesting framework that executes model-generated strategies and evaluates them using financial performance metrics, enabling a more realistic assessment of quantitative coding ability. We evaluate some state-of-the-art open-source and proprietary LLMs and observe substantial gaps to human experts, particularly in reasoning and strategy coding. Finally, we conduct large-scale supervised fine-tuning and reinforcement learning experiments on domain-aligned data, demonstrating consistent improvements. We hope QuantEval will facilitate research on LLMs\u0027 quantitative finance capabilities and accelerate their practical adoption in real-world trading workflows. We additionally release the full deterministic backtesting configuration (asset universe, cost model, and metric definitions) to ensure strict reproducibility.",
"arxiv_id": "2601.08689",
"authors": [
"Zhaolu Kang",
"Junhao Gong",
"Wenqing Hu",
"Shuo Yin",
"Kehan Jiang",
"Zhicheng Fang",
"Yingjie He",
"Chunlei Meng",
"Rong Fu",
"Dongyang Chen",
"Leqi Zheng",
"Eric Hanchen Jiang",
"Yunfei Feng",
"Yitong Leng",
"Junfan Zhu",
"Xiaoyou Chen",
"Xi Yang",
"Richeng Xuan"
],
"categories": [
"cs.CL"
],
"license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
"title": "QuantEval: A Benchmark for Financial Quantitative Tasks in Large Language Models",
"url": "https://arxiv.org/abs/2601.08689",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "66b6b0d2-80e0-455d-a8c5-ffa16a804dd1",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}