dorsal/arxiv
View SchemaSissi: Zero-shot Style-guided Image Synthesis via Semantic-style Integration
| Authors | Yingying Deng, Xiangyu He, Fan Tang, Weiming Dong, Xucheng Yin |
|---|---|
| Categories | |
| ArXiv ID | 2601.06605vv1 |
| URL | https://arxiv.org/abs/2601.06605 |
| License | http://creativecommons.org/publicdomain/zero/1.0/ |
Abstract
Text-guided image generation has advanced rapidly with large-scale diffusion models, yet achieving precise stylization with visual exemplars remains difficult. Existing approaches often depend on task-specific retraining or expensive inversion procedures, which can compromise content integrity, reduce style fidelity, and lead to an unsatisfactory trade-off between semantic prompt adherence and style alignment. In this work, we introduce a training-free framework that reformulates style-guided synthesis as an in-context learning task. Guided by textual semantic prompts, our method concatenates a reference style image with a masked target image, leveraging a pretrained ReFlow-based inpainting model to seamlessly integrate semantic content with the desired style through multimodal attention fusion. We further analyze the imbalance and noise sensitivity inherent in multimodal attention fusion and propose a Dynamic Semantic-Style Integration (DSSI) mechanism that reweights attention between textual semantic and style visual tokens, effectively resolving guidance conflicts and enhancing output coherence. Experiments show that our approach achieves high-fidelity stylization with superior semantic-style balance and visual quality, offering a simple yet powerful alternative to complex, artifact-prone prior methods.
{
"annotation_id": "1305a002-3f2c-4958-9781-e279c06d5ee7",
"date_created": "2026-02-17T05:53:08.708000Z",
"date_modified": "2026-02-17T05:53:08.708000Z",
"file_hash": "73cb14abd6a3d1472476f9bada72c5cf24cb0ec6e4bcfa65fb08bcf801449f79",
"private": false,
"record": {
"abstract": "Text-guided image generation has advanced rapidly with large-scale diffusion models, yet achieving precise stylization with visual exemplars remains difficult. Existing approaches often depend on task-specific retraining or expensive inversion procedures, which can compromise content integrity, reduce style fidelity, and lead to an unsatisfactory trade-off between semantic prompt adherence and style alignment. In this work, we introduce a training-free framework that reformulates style-guided synthesis as an in-context learning task. Guided by textual semantic prompts, our method concatenates a reference style image with a masked target image, leveraging a pretrained ReFlow-based inpainting model to seamlessly integrate semantic content with the desired style through multimodal attention fusion. We further analyze the imbalance and noise sensitivity inherent in multimodal attention fusion and propose a Dynamic Semantic-Style Integration (DSSI) mechanism that reweights attention between textual semantic and style visual tokens, effectively resolving guidance conflicts and enhancing output coherence. Experiments show that our approach achieves high-fidelity stylization with superior semantic-style balance and visual quality, offering a simple yet powerful alternative to complex, artifact-prone prior methods.",
"arxiv_id": "2601.06605",
"authors": [
"Yingying Deng",
"Xiangyu He",
"Fan Tang",
"Weiming Dong",
"Xucheng Yin"
],
"categories": [
"cs.CV"
],
"license": "http://creativecommons.org/publicdomain/zero/1.0/",
"title": "Sissi: Zero-shot Style-guided Image Synthesis via Semantic-style Integration",
"url": "https://arxiv.org/abs/2601.06605",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "3ea25887-4a77-44ed-a9be-77306b5dc5eb",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}