A team led by Steffi Colyer, a senior lecturer in biomechanics at the University of Bath, has developed open access software that analyses motion capture data, without using markers.
The system is now available to physiotherapists, sports coaches and other clinicians seeking an unobtrusive way of analysing body movements from video footage that is comparable to using markers.
Motion analysis traditionally relies on attaching light-reflective markers on to specific points on the body. The movement of these markers in 3D space is then calculated using data from an array of cameras that film the person’s movements from different angles.
Placing markers accurately on the body can be time consuming to set up and can sometimes interfere with the person’s natural movements.
To overcome this, Dr Colyer and her colleagues developed a non-invasive markerless system, using computer vision and deep learning methods to measure motion by identifying body landmarks from regular 2D image data.
Article published article in Scientific Data
Using the same images to evaluate the performance of their fully automated system, they found the results were comparable to that of a traditional marker-based motion capture system.
Based on using technology that is similar to that used by commercial systems, the system is available as an open-source workflow that can be adapted to meet the user’s needs.
The team has released a unique dataset to allow other researchers to evaluate new markerless algorithms and further progress the fields of computer vision and biomechanics.
Members of the team used an open source computer vision system, OpenPose, to estimate the position of the joints on a 2D video image of a person running, jumping and walking. They then fuse the data in 3D and input those data into open-source modelling software called OpenSim, which fits a skeleton to the joints and allows the whole body motion to be obtained.
The fully synchronised video and marker-based data used in this study, along with the code underpinning the markerless pipeline are now available and are outlined in a paper published in Scientific Data. The article – titled Synchronised Video, Motion Capture and Force Plate Dataset for Validating Markerless Human Movement Analysis – can be accessed here
This could be useful for physiotherapists, clinicians and sports trainers in a wide range of applications including sports performance and injury prevention or rehabilitation [Steffi Colyer]
Opens opportunities outside lab settings
Dr Colyer said: ‘The trouble with using markers is that they can be tricky to place on a participant accurately and reliably and this process can take a long time, which isn’t very practical for many participants and applications (for example elite athletes or clinical populations).
‘Our markerless system estimates the joint positions from video alone without the need for any equipment to be placed on the participant or any preparation time. This opens the door for us to capture motion data more readily in settings outside of the laboratory and the outcomes for the movements we analysed are comparable to traditionally-used techniques with markers.
‘Our pipeline is open source, which means that anyone with some expertise in the area can use it for free to get movement data from normal video footage.
Dr Colyer added: ‘This could be useful for physiotherapists, clinicians and sports trainers in a wide range of applications including sports performance and injury prevention or rehabilitation. Additionally, the accompanying data set provides the first high-quality benchmark to evaluate emerging algorithms in this rapidly evolving field.
‘We have used the system to measure the biomechanics of skeleton athletes during their push-starts and we have recently taken it out on to the tennis and badminton courts to unobtrusively monitor how much work the players are performing during training and match play.’
The research team is based at CAMERA, the University of Bath’s Centre for Analysis of Motion, Entertainment and Research Applications.
