dorsal/arxiv
View SchemaImagine-then-Plan: Agent Learning from Adaptive Lookahead with World Models
| Authors | Youwei Liu, Jian Wang, Hanlin Wang, Beichen Guo, Wenjie Li |
|---|---|
| Categories | |
| ArXiv ID | 2601.08955vv1 |
| URL | https://arxiv.org/abs/2601.08955 |
| License | http://creativecommons.org/licenses/by/4.0/ |
Abstract
Recent advances in world models have shown promise for modeling future dynamics of environmental states, enabling agents to reason and act without accessing real environments. Current methods mainly perform single-step or fixed-horizon rollouts, leaving their potential for complex task planning under-exploited. We propose Imagine-then-Plan (\texttt{ITP}), a unified framework for agent learning via lookahead imagination, where an agent's policy model interacts with the learned world model, yielding multi-step ``imagined'' trajectories. Since the imagination horizon may vary by tasks and stages, we introduce a novel adaptive lookahead mechanism by trading off the ultimate goal and task progress. The resulting imagined trajectories provide rich signals about future consequences, such as achieved progress and potential conflicts, which are fused with current observations, formulating a partially \textit{observable} and \textit{imaginable} Markov decision process to guide policy learning. We instantiate \texttt{ITP} with both training-free and reinforcement-trained variants. Extensive experiments across representative agent benchmarks demonstrate that \texttt{ITP} significantly outperforms competitive baselines. Further analyses validate that our adaptive lookahead largely enhances agents' reasoning capability, providing valuable insights into addressing broader, complex tasks.
{
"annotation_id": "94fb14a6-96d0-48a6-a428-b609f8a70c2c",
"date_created": "2026-02-17T05:53:20.007000Z",
"date_modified": "2026-02-17T05:53:20.007000Z",
"file_hash": "aadf43d4d497e79fecbed5f0b2bf2f89f247b9bb7654a331aa6a721b07982fc4",
"private": false,
"record": {
"abstract": "Recent advances in world models have shown promise for modeling future dynamics of environmental states, enabling agents to reason and act without accessing real environments. Current methods mainly perform single-step or fixed-horizon rollouts, leaving their potential for complex task planning under-exploited. We propose Imagine-then-Plan (\\texttt{ITP}), a unified framework for agent learning via lookahead imagination, where an agent\u0027s policy model interacts with the learned world model, yielding multi-step ``imagined\u0027\u0027 trajectories. Since the imagination horizon may vary by tasks and stages, we introduce a novel adaptive lookahead mechanism by trading off the ultimate goal and task progress. The resulting imagined trajectories provide rich signals about future consequences, such as achieved progress and potential conflicts, which are fused with current observations, formulating a partially \\textit{observable} and \\textit{imaginable} Markov decision process to guide policy learning. We instantiate \\texttt{ITP} with both training-free and reinforcement-trained variants. Extensive experiments across representative agent benchmarks demonstrate that \\texttt{ITP} significantly outperforms competitive baselines. Further analyses validate that our adaptive lookahead largely enhances agents\u0027 reasoning capability, providing valuable insights into addressing broader, complex tasks.",
"arxiv_id": "2601.08955",
"authors": [
"Youwei Liu",
"Jian Wang",
"Hanlin Wang",
"Beichen Guo",
"Wenjie Li"
],
"categories": [
"cs.CL",
"cs.AI",
"cs.LG"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"title": "Imagine-then-Plan: Agent Learning from Adaptive Lookahead with World Models",
"url": "https://arxiv.org/abs/2601.08955",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "97178cd4-cf39-4d18-9c80-ed37a8ee6d45",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}