TAB Foundation / Facebook Thailand: Visible Track

BBDO Bangkok, in partnership with Kunana, Facebook Thailand and TAB Foundation have launched Visible-Track.com, the first online service that enables blind individuals to enjoy millions of music videos that are available online. Just because the blind cannot see, doesn’t mean they cannot enjoy various forms of videos such as movies and videos on YouTube through music, dialogue and sound effects, which helps paint the picture in their minds. But there’s one thing that those who are blind have never experienced before, music videos, and since most music videos are mainly music and visuals that tell a story, for those who cannot see, watching a music vide ogives them no further enjoyment other than listening to the music track. Until now. By simply entering the website with accessibility features, then copy and pasting any music video link from YouTube or Facebook Watch, the website uses AI to intelligently add sound effects to each scene automatically to help one paint the ‘scene’ in their mind. To do this, the service utilises as many as 6 Ais, e.g. scene splitting, scene classification, action classification and object classification that work together on different tasks to help music videos become visible and universally accessible to everyone. Additionally, the service also uses image-captioning AI and text-to-speech AI to generate audio descriptions to describe what’s going on in the scene. Alternatively, blind individuals can also use the Visible Track service via a messenger bot on the TAB Foundation Facebook page (@TNIBinfo).