| 基于DeepPose和Faster RCNN的多目标人体骨骼节点检测算法 |
| |
| 作者姓名： | 余保玲 虞松坤 孙耀然 杨振 傅旭波 |
| |
| 作者单位： | 1. 浙江大学公共体育与艺术部, 杭州 310058;
2. 浙江大学光电科学与工程学院, 杭州 310058;
3. 中国科学院自动化研究所, 北京 100190 |
| |
| 基金项目： | 国家重点研发计划项目（2018AAA0100405）和胶州人工智能产业技术研究院开放课题资助 |
| |
| 摘 要： | 近年来，随着计算机视觉技术的不断发展，深度学习技术在人体关节节点检测中得到了很好的应用。但是由于人体关节结构复杂，关节之间存在相互依赖的关系和互相遮挡的问题，因此人体骨骼节点检测依然是一个极具挑战的任务。传统的模型难以预测多个目标的骨骼节点，为了解决这个问题，提出一种基于Faster RCNN和DeepPose相结合的方法，首先通过Faster RCNN检测出包含人体的感兴趣区域，并将该区域作为改进的DeepPose算法的输入，使其能够处理多目标关节节点检测的问题。实验表明，该算法在MPII数据集的手腕、膝盖两种关键节点检测上均取得最好结果，比之前的最好结果各提升1.2%和0.3%，在全部的关键节点检测上PCKh为87.6%。
|
| 关 键 词： | Faster RCNN DeepPose 人体关节节点检测 |
| 收稿时间： | 2019-05-07 |
| 修稿时间： | 2019-10-30 |
Human body joint nodes detection based on DeepPose and Faster RCNN |
| |
| Authors: | YU Baoling YU Songkun SUN Yaoran YANG Zhen FU Xubo |
| |
| Institution: | 1. Department of Public Physical and Art Education, Zhejiang University, Hangzhou 310058, China;
2. College of Optical Science and Engineering, Zhejiang University, Hangzhou 310058, China;
3. Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China |
| |
| Abstract: | Human body joint nodes detection is a considerably challenging task which has drawn enormous attention in the field of computer vision recently. The challenges of this task include: coping with the complex structure of human body joints, denoting the interdependence between joint nodes, and dealing with the sheltered and overlapped body joint nodes. Among the common solutions to this task, the models based on deep learning are widely applied and provide useful results. However, the existing models have following drawbacks: 1) comparatively low accuracy in prediction; 2) poor performance in multi-objective tasks. In our work, we proposed a novel method aiming at more satisfactory results. We firstly detect the relevant regions of human body with Faster RCNN, and then input the regions into a modified DeepPose algorithm. We achieve the state-of-the-art results in the detection of the wrist and knee on MPII dataset, improving 1.2% and 0.3% in PCKh, respectively. The total PCKh is 87.6% on MPII dataset. |
| |
| Keywords: | Faster RCNN DeepPose human body joint nodes detection |
|
| 点击此处可从《》浏览原始摘要信息 |
| 点击此处可从《》下载免费的PDF全文 |
