An intelligent maintenance system for public buildings integrating digital twin and large language model

doi:10.11996/JG.j.2095-302X.2024061200

Journal of Graphics ›› 2024, Vol. 45 ›› Issue (6): 1200-1206.DOI: 10.11996/JG.j.2095-302X.2024061200

• Special Topic on “Large Models and Graphics Technology and Applications” • Previous Articles Next Articles

An intelligent maintenance system for public buildings integrating digital twin and large language model

XU Jinglin¹^,²(), PENG Yang², OU Jinwu², TAN Junjie², SHU Jiangpeng¹(), YU Fangqiang³

1. Polytechnic Institute, Zhejiang University, Hangzhou Zhejiang 310015, China
2. Shanghai Construction No.4 (Group) Co. LTD, Shanghai 201103, China
3. Shanghai Construction Group Co. LTD, Shanghai 200080, China

Received:2024-07-16 Accepted:2024-10-22 Online:2024-12-31 Published:2024-12-24
Contact: SHU Jiangpeng
About author:First author contact:
XU Jingnlin (1989-), PhD candidate. Her main research interests cover engineering digitization, digital twins, and large model applications. E-mail：jinglin.xu@qq.com
Supported by:
Shanghai State-Owned Assets Supervision and Administration Commission Level Promotion Project(2022008);Shanghai Science and Technology Innovation Action Plan Project(22dz1207102)

Abstract

Abstract:

To address the challenges encountered in smart building operations and maintenance based on digital twins, such as complex system operations, difficulties in accessing a vast amount of construction documentation, and limited decision support in complex scenarios, a smart building operations and maintenance system integrating large models and digital twins was constructed. Innovations include efficient retrieval technology for massive information based on Retrieval Augmented Generation, efficient invocation technology for building operations and maintenance services based on large models, and intelligent building adaptation technology based on swarm intelligence. The system was applied and verified in three typical operations and maintenance scenarios. The results demonstrated that integrating large models and digital twins in constructing a public building smart operations and maintenance system aided in providing personalized building operations and maintenance services, enhanced user experience, offered complex decision support, and enabled more convenient, comfortable, safe, and green smart operations and maintenance management for public buildings.

Key words: large language models, digital twin, public buildings, intelligent maintenance

CLC Number:

XU Jinglin, PENG Yang, OU Jinwu, TAN Junjie, SHU Jiangpeng, YU Fangqiang. An intelligent maintenance system for public buildings integrating digital twin and large language model[J]. Journal of Graphics, 2024, 45(6): 1200-1206.

Figures/Tables 10

Fig. 1 RAG process for maintenance LLM

Fig. 2 Data flow of file search service

Fig. 3 Maintenance service invocation using LLM

Fig. 4 Intelligent building adjustment based on group intelligence

Fig. 5 Methodology framework

Fig. 6 Document query about air-conditioners by LLM

Fig. 7 Meeting room reservation by LLM

Fig. 8 LLM receives voice command and adjust electric systems

Fig. 9 Intelligent adjustments by maintenance LLM

Table 1 Performance evaluation of maintenance scenarios

场景	交互次数	评价次数	好评数	满意率/%
建设过程文档检索	1043	274	240	87.6
数字孪生系统交互优化	207	207	193	93.2
楼宇智能调适	576	305	266	87.2

References 14

[1]	PENG Y, ZHANG M, YU F Q, et al. Digital twin hospital buildings: an exemplary case study through continuous lifecycle integration[J]. Advances in Civil Engineering, 2020, 2020: 8846667.
[2]	WANG H, MENG X H, ZHU X Y. Improving knowledge capture and retrieval in the BIM environment: combining case-based reasoning and natural language processing[J]. Automation in Construction, 2022, 139: 104317.
[3]	SHAHINMOGHADAM M, KAHOU S E, MOTAMEDI A. Neural semantic tagging for natural language-based search in building information models: implications for practice[J]. Computers in Industry, 2024, 155: 104063.
[4]	MO Y, ZHAO D, DU J, et al. Automated staff assignment for building maintenance using natural language processing[J]. Automation in Construction, 2020, 113: 103150.
[5]	LI M H, WANG R H, ZHOU X, et al. ChatTwin: toward automated digital twin generation for data center via large language models[C]// The 10th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation. New York: ACM, 2023: 208-211.
[6]	何庆, 荆传玉, 孙华坤, 等. 基于BIM和语义网的轨道智能运维管理方法[J]. 图学学报, 2024, 45(3): 601-612. DOI
	HE Q, JING C Y, SUN H K, et al. An intelligent railway operation and maintenance management approach based on BIM and semantic web[J]. Journal of Graphics, 2024, 45(3): 601-612. (in Chinese) DOI
[7]	KIM J, CHUNG S, CHI S. Cross-lingual information retrieval from multilingual construction documents using pretrained language models[J]. Journal of Construction Engineering and Management, 2024, 150(6): 04024041.
[8]	RADFORD A, NARASIMHAN K, SALIMANS T, et al. Improving language understanding by generative pre-training[EB/OL]. [2024-05-16]. https://gwern.net/doc/www/s3-us-west-2.amazonaws.com/d73fdc5ffa8627bce44dcda2fc012da638ffb158.pdf.
[9]	蒋灿, 郑哲, 梁雄, 等. 大语言模型驱动的交互式建筑设计新范式——基于Rhino7的概念验证[J]. 图学学报, 2024, 45(3): 594-600. DOI
	JIANG C, ZHENG Z, LIANG X, et al. A new interaction paradigm for building design driven by large language model: proof of concept with Rhino7[J]. Journal of Graphics, 2024, 45(3): 594-600. (in Chinese) DOI
[10]	CHIU T K F. The impact of Generative AI (GenAI) on practices, policies and research direction in education: a case of ChatGPT and Midjourney[EB/OL]. (2023-09-04) [2024-05-16]. https://doi.org/10.1080/10494820.2023.2253861.
[11]	张华平, 李林翰, 李春锦. ChatGPT中文性能测评与风险应对[J]. 数据分析与知识发现, 2023, 7(3): 16-25. DOI
	ZHANG H P, LI L H, LI C J. ChatGPT performance evaluation on Chinese language and risk measures[J]. Data Analysis and Knowledge Discovery, 2023, 7(3): 16-25. (in Chinese) DOI
[12]	ZHANG L, CHEN Z L. Large language model-based interpretable machine learning control in building energy systems[J]. Energy and Buildings, 2024, 313: 114278.
[13]	裴丹, 张圣林, 孙永谦, 等. 大语言模型时代的智能运维[J]. 中兴通讯技术, 2024, 30(2): 56-62.
	PEI D, ZHANG S L, SUN Y Q, et al. Artificial intelligence for IT operations in era of large language model[J]. ZTE Technology Journal, 2024, 30(2): 56-62. (in Chinese)
[14]	JIANG G, MA Z H, ZHANG L, et al. EPlus-LLM: a large language model-based computing platform for automated building energy modeling[J]. Applied Energy, 2024, 367: 123431.

An intelligent maintenance system for public buildings integrating digital twin and large language model

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 10

References 14

Related Articles 5

Recommended Articles

Metrics

Comments

[1]	WU Jingyi, JING Jun, HE Yifan, ZHANG Shiyu, KANG Yunfeng, TANG Wei, KONG Delan, LIU Xiangdong. Traffic anomaly event analysis method for highway scenes based on multimodal large language models [J]. Journal of Graphics, 2024, 45(6): 1266-1276.
[2]	HUANG Wenkai, LIANG Zhihong, WANG Minghua, ZHANG Wenfeng, WANG Yishou. Application and prospect of digital twin in the design, manufacturing, and operation of aerospace structures [J]. Journal of Graphics, 2024, 45(2): 241-249.
[3]	PANG Bo, YANG Hui, YU Rongrong, ZHANG Haoyue, LUO Qiang. Research on spacecraft mechanisms production line balance based on digital twin technology [J]. Journal of Graphics, 2024, 45(2): 332-338.
[4]	TANG Peng, SA Guo-dong, LIU Zhen-yu, TAN Jian-rong. Design of digital twin system for forging hydraulic press [J]. Journal of Graphics, 2023, 44(3): 609-615.
[5]	TIAN Ling, LIU Guo, LIU Si-chao . Digital twin and production line simulation technology [J]. Journal of Graphics, 2021, 42(3): 349-358.