UnmuteMe

Web platform that allows you to upload a video (with or without audio), generates audio according to the content of the frames and synchronizes them.

This project proposes the use of Artificial Intelligence models and techniques for the generation of audio from an input video. The aim of this project is to develop a web application that allows users to add a new audio track to a video.  The user will upload a video to the platform, the original audio will be removed from the video and using artificial intelligence, a new audio track will be generated synchronised with the content of the video frames.

To achieve this, it is proposed to implement a video to text conversion process and, subsequently, from text to audio, in order to generate the synchronised audio track. The implementation must consider the possible overlapping between the different sounds present in the scene, the temporal resolution necessary to achieve a good synchronisation between image and audio and whether only ambient noise is generated or the recreation of human voices.


TOP