Markerless Optical Motion Capture System for Asymmetrical Swimming Stroke


  • F. Ferryanto Mechanical Design Research Group, Faculty of Mechanical and Aerospace Engineering, Institut Teknologi Bandung
  • Andi Isra Mahyuddin Mechanical Design Research Group, Faculty of Mechanical and Aerospace Engineering, Institut Teknologi Bandung, Bandung, Indonesia
  • Motomu Nakashima Department of Systems and Control Engineering, Tokyo Institute of Technology, Tokyo, Japan



asymmetrical swimming stroke, front crawl, image matching, image processing, markerless optical motion capture


This work presents the development of a markerless optical motion capture system of the front-crawl swimming stroke. The system only uses one underwater camera to record swimming motion in the sagittal plane. The participant in this experiment was a swimmer who is active in the university?s swimming club. The recorded images were then segmented to obtain silhouettes of the participant by a Gaussian Mixture Model. One of the swimming images was employed to generate a human body model that consists of 15 segments. The silhouette and model of the participant were subjected to an image matching process. The shape of the body segment was used as the feature in the image matching. The model was transformed to estimate the pose of the participant. The intraclass correlation coefficient between the results of the developed system and references were evaluated. In general, all body segments, except head and trunk, had a correlation coefficient higher than 0.95. Then, dynamics analysis by SWUM was conducted based on the joint angle acquired by the present work. The simulation implied that the developed system was suitable for daily training of athletes and coaches due to its simplicity and accuracy.


Download data is not yet available.


Windolf, M., Gzen, N. & Morlock, M., Systematic Accuracy and Precision Analysis of Video Motion Capturing Systems - Exemplified on the Vicon-460 System, Journal of Biomechanics, 41(12), pp. 2776-2780, 2008.

Maletsky, L.P., Sun, J. & Morton, N.A., Accuracy of an Optical Active-Marker System to Track the Relative Motion of Rigid Bodies, Journal of Biomechanics, 40(3), pp. 682-685, 2007.

Mihradi, S., Ferryanto, F., Dirgantara, T. & Mahyuddin, A.I., Development of an Optical Motion-Capture System for 3D Gait Analysis, 2nd International Conference on Instrumentation, Communications, Information Technology, and Biomedical Engineering (ICICI-BME), Bandung, 2011.

Whittle, M.W., Gait Analysis: An Introduction, Butterworth-Heinemann, 2014.

Monnet, T., Samson, M., Bernard, A., David, L. & Lacouture, P., Measurement of Three-Dimensional Hand Kinematics During Swimming with a Motion Capture System: A Feasibility Study, Sports Engineering, 17, pp. 171-181, 2014.

Corazza, S., Muendermann, L., Chaudhari, A.M., Demattio, T., Cobelli, C. & Andriacchi, T.P., A Markerless Motion Capture System to Study Musculoskeletal Biomechanics: Visual Hull and Simulated Annealing Approach, Annals of Biomedical Engineering, 34, p. 1019-1029, 2006.

Hernandez, Y., Kim, K.H., Benson, E., Jarvis, S., Meginnis, I. & Rajulu, S., Underwater Space Suit Performance Assessments Part 1: Motion Capture System Development and Validation, International Journal of Industrial Ergonomics, 72, pp. 119-127, 2019.

Goffredo, M., Carter, J.N. & Nixon, M.S., 2D Markerless Gait Analysis, 4th European Conference of the International Federation for Medical and Biological Engineering, Berlin, Heidelberg, 2009.

Andr J., Lopes, J., Palermo, M., Gonlves, D., Matias, A., Pereira, F., Afonso, J., Seabra, E., Cerqueira, J. & Santos, C., Markerless Gait Analysis Vision System for Real-time Gait Monitoring, 2020 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), 2020, Ponta Delgada, Portugal, 2020.

Cao, Z., Simon, T., Wei, S.E. & Sheikh, Y., OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields, IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(1), pp. 172-186, 2019.

Ceseracciu, E., Sawacha, Z., Fantozzi, S., Cortesi, M., Gatta, G., Corazza, S. & Cobelli, C., Markerless Analysis of Front Crawl Swimming, Journal of Biomechanics, 44(12), p. 2236-2242, 2011.

Ferryanto, F., & Nakashima, M., Development of A Markerless Optical Motion Capture System for Daily Use of Training in Swimming, Sports Engineering, 20, p. 63-72, 2017.

Rosenhahn, B., Kersting, U.G., Smith, A.W., Gurney, J. K., Brox, T. & Klette, R., A System for Marker-Less Human Motion Estimation, Lecture Notes in Computer Science, Berlin, Heidelberg, Springer, 2005, pp. 230-237.

Bouchrika, I. & Nixon, M.S., Model-Based Feature Extraction for Gait Analysis and Recognition, in Lecture Notes in Computer Science, Berlin, Heidelberg, Springer, pp. 150-160, 2007.

Mdermann, L., Corazza, S. & Andriacchi, T.P., The Evolution of Methods for the Capture of Human Movement Leading to Markerless Motion Capture for Biomechanical Applications, Journal of NeuroEngineering and Rehabilitation, 3(6), 2006. DOI: 10.1186/1743-0003-3-6.

Zivkovic, Z., Improved Adaptive Gaussian Mixture Model for Background Subtraction, 17th International Conference on Pattern Recognition, 2004, Cambridge, UK, 2004.

Goshtasby, A.A., Image Registration: Principles, Tools and Methods, Springer Science & Business Media, 2012.

Zitova, B. & Flusser, J., Image Registration Methods: A Survey, Image and Vision Computing, 21(11), pp. 977-1000, 2003.

Schmidt, M, Argmax and Max Calculus, The University of British Columbia, Argmax.pdf, (6 January 2016).

Wang, D., Tan, D. & Liu, L., Particle Swarm Optimization Algorithm: An Overview, Soft Computing, 22, p. 387-408, 2018.

Golberg, D. E., Genetic Algorithms in Search, Optimization, and Machine Learning, Addion Wesley, 1989.

Nakashima, M., Satou, K., & Miura, Y., Development of Swimming Human Simulation Model Considering Rigid Body Dynamics and Unsteady Fluid Force for Whole Body, Journal of Fluid Science and Technology, 2(1), pp. 56-67, 2007.

Craven, P. & Wahba, G., Smoothing Noisy Data with Spline Functions, Numerische Mathematik, 24, pp. 383-393, 1975.

Bartko, J.J., The Intraclass Correlation Coefficient as a Measure of Reliability, Psychological Reports, 19(1), pp. 3-11, 1966.

Qingchao, W., GuoQing, Z., Qing, Z. & Qinghang, Z., On DLT Method for CCD Camera Calibration, Third International Conference on Signal Processing (ICSP?96), Beijing, China, 1996.