Welcome to Journal of Graphics share: 

Journal of Graphics ›› 2023, Vol. 44 ›› Issue (6): 1130-1139.DOI: 10.11996/JG.j.2095-302X.2023061130

• Image Processing and Computer Vision • Previous Articles     Next Articles

Detail-enhanced multi-exposure image fusion method

XIA Xiao-hua1,2(), LIU Xi-heng1, YUE Peng-ju1, ZOU Yi-qing3, JIANG Li-jun3   

  1. 1. School of Construction Machinery, Chang'an University, Xi'an Shaanxi 710064, China
    2. State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin Heilongjiang 150001, China
    3. Liuzhou OVM Machinery Co., Ltd. Liuzhou Guangxi 545006, China
  • Received:2023-05-29 Accepted:2023-09-08 Online:2023-12-31 Published:2023-12-17
  • About author:First author contact:

    XIA Xiao-hua (1987-), associate professor, Ph.D. His main research interests cover machine vision and opto-mechatronics.
    E-mail:xhxia@chd.edu.cn

  • Supported by:
    National Natural Science Foundation of China(61901056);China Postdoctoral Science Foundation(2020M683631XB);State Key Laboratory of Robotics and System Open Foundation(SKLRS-2021-KF-10)

Abstract:

A detail-enhanced multi-exposure image fusion method was proposed to address the problem of low weights obtained in the light and dark regions in the sequence image, resulting in the loss of details in the bright and dark regions of the fused image. Wavelet decomposition was conducted on the sequence image and the fused image based on the weight map. This process involved extracting the low-frequency components from the fused image and the high-frequency components from the edge regions, and they were fused with the high-frequency components from the non-edge regions of the sequence image. Finally, the detail-enhanced fused image was obtained through wavelet inverse transform. Experimentally, nine sets of classical multi-exposure image sequences were selected for comparison with nine multi-exposure image fusion algorithms in terms of subjective comparison and objective evaluation, respectively. The results demonstrated that the proposed method, which combined the spatial and frequency domain image fusion methods, could effectively solve the problem of detail loss in the bright and dark areas of fused images, while avoiding the problem of ringing phenomenon often encountered in frequency domain image fusion methods. The fused images were realistic, natural, and exhibited vibrant colors. The mean image information entropy value and the mean image gradient value of the fused images obtained through the proposed method were 7.655 5 and 7.027 3, respectively, ranking first and second among the ten multi-exposure image fusion algorithms. Considering both subjective and objective evaluation results, the proposed method outperformed the nine comparative methods.

Key words: multi-exposure images, image fusion, detail enhancement, wavelet transform, high dynamic range

CLC Number: