Personal Coach App with AI

280х280
Celadon
  • Score Awaiting client review
    n/a
  • Date Published
  • Reading Time 2-Minute Read
Shark-2-1

The mobile app provides exercise analytics with video recommendations based on computer vision models.

Timeline

7 months

Tech Stack

C++, Python, TensorFlow, TensorflowLite, React.js, React Native

Summary

The idea was an AI-powered virtual assistant – mobile app. With the help of artificial intelligence, the app would closely monitor the user via the camera and would compare the movements of the user to the ones we would upload as references – the movements of professional athletes and gym coaches.

In addition, the app would also be able to monitor user’s progress and tailor an individual workout program just for the user and for all those who wish to work out in a fun and efficient way.

Challenge

  • To create a custom dataset so that the app is able to monitor and record certain movements and compare them to the ones that are indicated as references
  • To develop an optimized architecture
  • To translate a 2D body point into a 3D one by a separate model
  • To compare the instructor’s video and the received data from the user’s device

Solution

By using a set of tools listed above, we built a platform that processes the video data of the exercises that are performed by an instructor and also translates the 2D body point functions into 3D.

Our app features a catalogue of exercise templates for the user and can capture the video of the user performing the movements.

The movements’ analysis and comparison happen in the server and the processes video is then returned to the user with personalized recommendations.