欢迎访问《图学学报》 分享到:

图学学报 ›› 2022, Vol. 43 ›› Issue (4): 736-743.DOI: 10.11996/JG.j.2095-302X.2022040736

• 工业设计 • 上一篇    下一篇

基于多模态感官体验的儿童音画交互设计研究

  

  1. 湖北工业大学工业设计学院,湖北 武汉 430068
  • 出版日期:2022-08-31 发布日期:2022-08-15
  • 通讯作者: 李晓英(1973),女,教授,硕士。主要研究方向为产品设计、用户体验及交互设计等
  • 基金资助:
    湖北工业大学研究生专项(2020048);教育部产学合作协同育人基金项目(202002255007)

Research on interactive design of children’s sound and painting based on multimodal sensory experience

  1. School of Industrial Design, Hubei University of Technology, Wuhan Hubei 430068, China
  • Online:2022-08-31 Published:2022-08-15
  • Contact: LI Xiao-ying (1973), professor, master. Her main research interests cover product design and user experience, etc
  • Supported by:
    Special Program for Postgraduates of Hubei University of Technology (2020048); Industry-University Cooperative Education Fund of
    Ministry of Education (202002255007)

摘要:

为解决儿童图画教育的单一灌输形式和传统图画绘制方式引起的儿童思维受限、互动不足等问题,构建基于多模态感官体验的儿童音画交互系统。该系统基于儿童感官行为能力特征,融合视听感官属性并根据交互设计中人与物的关系匹配儿童音画交互的设计需求,构建儿童音画交互行为;应用可视化技术方法,建立声音与图画的映射和儿童音画交互平台。通过创新绘画体验,使儿童音画创作方式更加丰富、多元,扩展儿童认知能力边界。运用模糊德尔菲法收集和筛选影响儿童绘画的指标因素并确定发声绘画体验指标模型,模糊层次分析法计算各项指标要素权重,采用访谈形式结合模糊综合评价进行儿童用户相关实验,验证平台的可行性。以儿童发声作为图画创作的介质,改变传统图画手、脑、眼并用的绘制方式,从而优化儿童的绘画互动体验与提高图画创作兴趣。

关键词: 多模态感官体验, 视听交互, 儿童音画交互平台, 声音可视化, 音画映射

Abstract:

In order to solve the problems of children’s limited thinking and insufficient interaction caused by the one-sided inculcation of children’s picture education and the traditional way of drawing, the audio-visual interactive system for children based on multi-modal sensory experience was constructed. Based on the characteristics of children’s sensory capacity, the system integrated the audio-visual sensory attributes and matched the design requirements of children’s audio-visual interaction according to the relationship between human and objects in interaction design, and constructed children’s audio-visual interactive behaviors. The visualization technology was applied to the establishment of the mapping of sound and picture and the audio-visual interactive platform for children. Through the innovated painting experience, children’s sound and painting creation were made richer and more diversified, and the boundary of their cognitive ability was expanded. The fuzzy Delphi method was utilized to collect and screen the index factors
affecting children’s painting and to determine the index model of vocal painting experience. The fuzzy analytic hierarchy process (AHP) was employed to calculate the weight of each index element. The feasibility of the platform was verified by experiments regarding children users, which were a combination of interviews and fuzzy comprehensive evaluation. Children’s vocalization served as the medium of painting creation, which could change the traditional drawing method using hands, brain, and eyes, thereby optimizing their interactive painting experience and heighten their interest in painting creation.

Key words:

中图分类号: