欢迎访问《图学学报》 分享到:

图学学报

• 计算机视觉 • 上一篇    下一篇

基于视觉识别定位的苹果采摘系统研究

  

  1. 山东理工大学机械工程学院,山东 淄博 255049
  • 出版日期:2018-06-30 发布日期:2018-07-10

Research on Apple Picking System Based on Visual Identification and Location

  1. School of Mechanical Engineering, Shandong University of Technology, Zibo Shandong 255049, China
  • Online:2018-06-30 Published:2018-07-10

摘要: 针对果实振荡、重叠影响采摘机器人采摘精度和效率的问题,研制了一种在农田
环境下利用视觉检测技术和机器人定位抓取技术的苹果采摘系统。首先利用图像处理技术对初
始图像进行图像预处理;其次根据图像角点提取算法检测图像曲率,通过计算曲线段上的多个
像素平均角方向之间的差值对曲率进行平滑处理,获取图像曲率集中峰值点;最后对图像曲率
峰值点进行像素坐标标定,并将该点像素坐标转化为物理坐标作为机器人的定位抓取目标点,
机器人根据定位目标点的位置信息调整运动姿态对果实进行实时追踪和识别,实现果实的精确
定位、抓取和采摘。试验证明,该系统下的机器人抓取果实的成功率高达九成以上,基本能够
满足实际生产中的果实采摘需求,可为苹果等球状果实精准识别、定位抓取提供参考。

关键词: 机器人, 角点检测, 曲率, 图像处理, 阈值分割

Abstract: The task of apple picking robot become more complicated for swing and overlapping of
apple. Thus the paper proposes a new apple picking method based on visual identification and
location technology. It can help robot to find out target more efficiently by visual inspection
technology in the Orchard. Firstly, we applied image filtering, histogram equalization and image
segmentation to make the background and fruit’s contour separated. Secondly, the proposed algorithm
applied to calculate the curvature of edge contour to find the peak point of curvature. Finally, this
study converted the pixel coordinate of peak point calibrated, and turning pixel coordinate into world
coordinate system to make it the target point for robot which robot can grab. Robot could adjust
posture to trace fruit and identify it with position information of target point, and then find it, grab it,
and pick it accurately. The experiment showed the robot grab the fruits of success rate as high as
ninety percent above by applying proposed method. The proposed study also provide some valuable
reference for identify and locating of spherical or round shaped fruits.

Key words: robot, corner detection, curvature, image processing, threshold segmentation