Welcome to Journal of Graphics share: 

Journal of Graphics ›› 2022, Vol. 43 ›› Issue (5): 832-840.DOI: 10.11996/JG.j.2095-302X.2022050832

• Image Processing and Computer Vision • Previous Articles     Next Articles

Monkey action recognition based on global spatiotemporal encode network 

  

  1. 1. CBSR&NLPR, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China;  2. School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China;  3. JOINN Laboratories (Beijing) Co., Ltd., Beijing 100176, China
  • Online:2022-10-31 Published:2022-10-28
  • Supported by:
    The Chinese National Natural Science Foundation Projects (82090051, 81871442); The Youth Innovation Promotion Association CAS (Y201930)

Abstract:

Accurate quantification of caged monkeys’ behaviors is a primary goal for the preclinical drug safety assessment. Skeleton information is important to the analysis on the behaviors of monkeys. However, most of the current skeleton-based action recognition methods usually extract the features of the skeleton sequence in the spatial and temporal dimensions, ignoring the integrity of the skeleton topology. To address this problem, we proposed a skeleton action recognition method based on the global spatiotemporal encode network (GSTEN). Based on the spatial temporal graph convolutional network (ST-GCN), the proposed method inserted global token generator (GTG) and several global spatiotemporal encoders (GSTE) in parallel to extract the global features in the spatiotemporal dimension. To verify the performance of the proposed method, we conducted experiments on a self-built monkey action recognition dataset. The experimental results show that the proposed GSTEN could achieve an accuracy of 76.54% without increasing the number of model parameters, which was 6.79% higher than the baseline model ST-CGN. 

Key words:

CLC Number: