Welcome to Journal of Graphics share: 

Journal of Graphics ›› 2022, Vol. 43 ›› Issue (4): 736-743.DOI: 10.11996/JG.j.2095-302X.2022040736

• Industrial Design • Previous Articles     Next Articles

Research on interactive design of children’s sound and painting based on multimodal sensory experience

  

  1. School of Industrial Design, Hubei University of Technology, Wuhan Hubei 430068, China
  • Online:2022-08-31 Published:2022-08-15
  • Contact: LI Xiao-ying (1973), professor, master. Her main research interests cover product design and user experience, etc
  • Supported by:
    Special Program for Postgraduates of Hubei University of Technology (2020048); Industry-University Cooperative Education Fund of
    Ministry of Education (202002255007)

Abstract:

In order to solve the problems of children’s limited thinking and insufficient interaction caused by the one-sided inculcation of children’s picture education and the traditional way of drawing, the audio-visual interactive system for children based on multi-modal sensory experience was constructed. Based on the characteristics of children’s sensory capacity, the system integrated the audio-visual sensory attributes and matched the design requirements of children’s audio-visual interaction according to the relationship between human and objects in interaction design, and constructed children’s audio-visual interactive behaviors. The visualization technology was applied to the establishment of the mapping of sound and picture and the audio-visual interactive platform for children. Through the innovated painting experience, children’s sound and painting creation were made richer and more diversified, and the boundary of their cognitive ability was expanded. The fuzzy Delphi method was utilized to collect and screen the index factors
affecting children’s painting and to determine the index model of vocal painting experience. The fuzzy analytic hierarchy process (AHP) was employed to calculate the weight of each index element. The feasibility of the platform was verified by experiments regarding children users, which were a combination of interviews and fuzzy comprehensive evaluation. Children’s vocalization served as the medium of painting creation, which could change the traditional drawing method using hands, brain, and eyes, thereby optimizing their interactive painting experience and heighten their interest in painting creation.

Key words:

CLC Number: