Skip to Content
SensorsSensors
  • Article
  • Open Access

30 December 2020

15 Pages

Online Multiple Athlete Tracking with Pose-Based Long-Term Temporal Dependencies

,
,
,
and
1
School of Computer Science and Engineering, Beihang University, Beijing 100191, China
2
State Key Laboratory of Software Development Environment, Beihang University, Beijing 100191, China
3
Hangzhou Innovation Institute, Beihang University, Hangzhou 310000, China
*
Author to whom correspondence should be addressed.
This article belongs to the Section Sensing and Imaging

Abstract

This paper addresses the Multi-Athlete Tracking (MAT) problem, which plays a crucial role in sports video analysis. There exist specific challenges in MAT, e.g., athletes share a high similarity in appearance and frequently occlude with each other, making existing approaches not applicable for this task. To address this problem, we propose a novel online multiple athlete tracking approach which make use of long-term temporal pose dynamics for better distinguishing different athletes. Firstly, we design a Pose-based Triple Stream Network (PTSN) based on Long Short-Term Memory (LSTM) networks, capable of modeling long-term temporal pose dynamics of athletes, including pose-based appearance, motion and athletes’ interaction clues. Secondly, we propose a multi-state online matching algorithm based on bipartite graph matching and similarity scores produced by PTSN. It is robust to noisy detections and occlusions due to the reliable transitions of multiple detection states. We evaluate our method on the APIDIS, NCAA Basketball and VolleyTrack databases, and the experiment results demonstrate its effectiveness.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.