机构:[1]Department of Artificial Intelligence, Nankai University, Tianjin, China,[2]Characteristic Medical Center of the Chinese People’s Armed Police Force, Tianjin, China,[3]Key Laboratory of Exercise and Health Sciences of Ministry of Education, Shanghai University of Sport, Shanghai, China,[4]Department of Neurosurgery, China International Neurological Institute, Xuanwu Hospital, Capital Medical University, Beijing, China,神经科系统科技平台神经外科中国国际神经科学研究所首都医科大学宣武医院[5]Research Center of Spine and Spinal Cord, Beijing Institute for Brain Disorders, Capital Medical University, Beijing, China
Quantifying rat behavior through video surveillance is crucial for medicine, neuroscience, and other fields. In this paper, we focus on the challenging problem of estimating landmark points, such as the rat's eyes and joints, only with image processing and quantify the motion behavior of the rat. Firstly, we placed the rat on a special running machine and used a high frame rate camera to capture its motion. Secondly, we designed the cascade convolution network (CCN) and cascade hourglass network (CHN), which are two structures to extract features of the images. Three coordinate calculation methods-fully connected regression (FCR), heatmap maximum position (HMP), and heatmap integral regression (HIR)-were used to locate the coordinates of the landmark points. Thirdly, through a strict normalized evaluation criterion, we analyzed the accuracy of the different structures and coordinate calculation methods for rat landmark point estimation in various feature map sizes. The results demonstrated that the CCN structure with the HIR method achieved the highest estimation accuracy of 75%, which is sufficient to accurately track and quantify rat joint motion.
基金:
National Key R&D Program of China [2017YFE0129700]; National Natural Science Foundation of China (Key Program)National Natural Science Foundation of China (NSFC) [11932013]; National Natural Science Foundation of ChinaNational Natural Science Foundation of China (NSFC) [61673224]; Tianjin Natural Science Foundation for Distinguished Young Scholars [18JCJQJC46100]; Tianjin Science and Technology Plan Project [18ZXJMTG00260]
第一作者机构:[1]Department of Artificial Intelligence, Nankai University, Tianjin, China,
通讯作者:
推荐引用方式(GB/T 7714):
Jin Tianlei,Duan Feng,Yang Zhenyu,et al.Markerless Rat Behavior Quantification With Cascade Neural Network[J].FRONTIERS IN NEUROROBOTICS.2020,14:doi:10.3389/fnbot.2020.570313.
APA:
Jin, Tianlei,Duan, Feng,Yang, Zhenyu,Yin, Shifan,Chen, Xuyi...&Jian, Fengzeng.(2020).Markerless Rat Behavior Quantification With Cascade Neural Network.FRONTIERS IN NEUROROBOTICS,14,
MLA:
Jin, Tianlei,et al."Markerless Rat Behavior Quantification With Cascade Neural Network".FRONTIERS IN NEUROROBOTICS 14.(2020)