What we’re doing today is very much around creating digital humans.
I view this as a foundational technology. “The range of applications is really wide. The next step, Riparbelli says, is to incorporate interactivity, where a viewer or user can engage in real time with the video, even ask it questions, and get back appropriate answers that appear to be delivered as spontaneous conversation. We have an engine for that,” Riparbelli adds. But programmatically creating videos, where you address someone with information specific to them, we can do at scale today. In the case of an email, it’s a bit of text inserted programmatically. “We could take a video and switch out the name, switch out the city, switch out the product, and it would be just like when you get an email personalised for you. The video can be further customised, depending on who the audience is, presenting different types of content depending on the circumstances. I think in two to four years, we’ll all have our own avatars for various purposes We create a digital version of the real actor, and then we can make it look like the presenter is really speaking that different language.” Company co-founder and CEO, Victor Riparbelli, explains: “Instead of dubbing or subtitling it, which generally is a pretty bad experience, we have a voice actor perform that same video in a different language. Synthesia has already developed a body of experience with the technology, using it in elearning, ‘rewriting’ a video of a speaker delivering a talk into a different language. Video Gaga: In the future video may be created in radically different ways, and that will change the ways it is used and consumed Synthesia AI: Avatars for avatars Synthesia’s ENACT technology enabled the footballer to deliver lines in English, and then create his lip-sync from scratch based on the other foreign language voiceovers – and with greater speed and for lower cost than a traditional visual effects house would have done it. Beckham is one of the founding members of the Malaria No More UK Leadership Council, but it’s still a non-starter if he has to spend hours learning lines in multiple languages and then try to deliver them in a single take. Every effort has been made to keep the shoot short and sweet. It’s essentially one shot with Beckham reading off a teleprompter. The production is simple: David Beckham sits down at a table with a cup of tea and speaks into camera. This effect could probably be approximated with simple dubbing, but Synthesia’s ENACT product creates essentially perfect lip-sync for each of the languages spoken, making it look, at the very least, like Beckham has been up all night making sure his non-English lines are perfect. The voices are native speakers who have been affected by the disease, but Beckham’s mouth movement matches their lines. Synthesia’s calling card has been a public service announcement for UK charity Malaria Must Die, in which football superstar David Beckham appears to deliver a message about the ravages of the deadly disease in nine languages, including Hindi, Spanish, Arabic and Mandarin. The company, funded by venture capitalists from the US and UK, hopes that their tools will give creators ‘superpowers’ when it comes to manipulating video. The company, formed three years ago by a group of high-level researchers and entrepreneurs from UCL, Stanford, Technical University of Munich, and Cambridge, has developed AI-powered video augmentation technology. If Synthesia has its way, no one will know that Taylor Swift doesn’t speak perfect Mandarin. Synthesia AI: A new start-up, Synthesia, aims to put AI-driven video production into the hands of creators
0 kommentar(er)
