The increasing complexity of modern software systems underscores the need for robust, automated modeling tools. Among Unified Modeling Language (UML) artifacts, Sequence Diagrams play a crucial role in depicting dynamic interactions between system components. However, their manual creation remains time-consuming and error-prone. This paper extends our framework, focusing specifically on the synthesis of Sequence Diagrams. We introduce a two-stage pipeline that combines a lightweight language model (LLaMA 3.2 1B-Instruct) for generating detailed technical specifications, with a reasoning-enhanced large language model (DeepSeek-R1-Distill-Qwen-32B) to produce corresponding PlantUML code. This approach yields a novel dataset of 1,000 high-quality samples, each containing a technical description, PlantUML code, and the resulting diagram. To validate semantic and structural fidelity, we employ an automated multimodal evaluation system using three vision-language models (Qwen2.5-VL-3B, LLaMA3.2-VL-11B, Aya-Vision-8B). Each model independently scores the alignment between the textual specification and the generated visual representation. Final quality scores are aggregated using a weighted method informed by each model’s performance on the MMMU benchmark. Our experiments demonstrate that the proposed framework successfully generates architecturally consistent and semantically aligned Sequence Diagrams. Furthermore, our multimodal scoring system proves to be a reliable method for automated quality assurance, establishing a scalable benchmark for future research in AI-driven software engineering.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Novel Pipeline for Automatic UML Sequence Diagram Synthesis and Multimodal Scoring

  • Van-Viet Nguyen,
  • Huu-Khanh Nguyen,
  • Kim-Son Nguyen,
  • Hue Luong Thi Minh,
  • The-Vinh Nguyen,
  • Duc-Quang Vu

摘要

The increasing complexity of modern software systems underscores the need for robust, automated modeling tools. Among Unified Modeling Language (UML) artifacts, Sequence Diagrams play a crucial role in depicting dynamic interactions between system components. However, their manual creation remains time-consuming and error-prone. This paper extends our framework, focusing specifically on the synthesis of Sequence Diagrams. We introduce a two-stage pipeline that combines a lightweight language model (LLaMA 3.2 1B-Instruct) for generating detailed technical specifications, with a reasoning-enhanced large language model (DeepSeek-R1-Distill-Qwen-32B) to produce corresponding PlantUML code. This approach yields a novel dataset of 1,000 high-quality samples, each containing a technical description, PlantUML code, and the resulting diagram. To validate semantic and structural fidelity, we employ an automated multimodal evaluation system using three vision-language models (Qwen2.5-VL-3B, LLaMA3.2-VL-11B, Aya-Vision-8B). Each model independently scores the alignment between the textual specification and the generated visual representation. Final quality scores are aggregated using a weighted method informed by each model’s performance on the MMMU benchmark. Our experiments demonstrate that the proposed framework successfully generates architecturally consistent and semantically aligned Sequence Diagrams. Furthermore, our multimodal scoring system proves to be a reliable method for automated quality assurance, establishing a scalable benchmark for future research in AI-driven software engineering.