Personal Coach App with AI Share: Celadon Score Awaiting client review n/a Date Published 13 September 2019 Reading Time 2-Minute Read The mobile app provides exercise analytics with video recommendations based on computer vision models. Timeline 7 months Tech Stack C++, Python, TensorFlow, TensorflowLite, React.js, React Native Summary The idea was an AI-powered virtual assistant – mobile app. With the help of artificial intelligence, the app would closely monitor the user via the camera and would compare the movements of the user to the ones we would upload as references – the movements of professional athletes and gym coaches. In addition, the app would also be able to monitor user’s progress and tailor an individual workout program just for the user and for all those who wish to work out in a fun and efficient way. Challenge To create a custom dataset so that the app is able to monitor and record certain movements and compare them to the ones that are indicated as references To develop an optimized architecture To translate a 2D body point into a 3D one by a separate model To compare the instructor’s video and the received data from the user’s device Solution By using a set of tools listed above, we built a platform that processes the video data of the exercises that are performed by an instructor and also translates the 2D body point functions into 3D. Our app features a catalogue of exercise templates for the user and can capture the video of the user performing the movements. The movements’ analysis and comparison happen in the server and the processes video is then returned to the user with personalized recommendations.