Technologies for a dark future: CD Projekt RED talks about the facial animation system in Cyberpunk 2077

Polish company CD Projekt RED noted attending a conference dedicated to computer graphics SIGGRAPH 2023, where, as part of a separate presentation, technical specialists spoke about the features of the facial animation system in the upcoming role-playing game Cyberpunk 2077

After release The Witcher 3 Polish developers have seriously thought about how to improve the animation of characters’ faces in their future developments. Then they began to work on Cyberpunk 2077, which is a story-driven adventure with a huge number of characters who will eventually have to speak as many as ten languages ​​of all kinds of localizations.

Taking into account all of the above, experts CDPR came to the obvious conclusion – it is simply impossible to rely on the classic technology of capturing facial animation, which means you need a solution that allows you to automate all processes as efficiently as possible. So the authors “Witcher“went to the creators JALI – a program based on machine learning algorithms designed to effectively synchronize speech with animation of faces, while “catching“a variety of sound levels – from a barely audible whisper to a loud scream

The artificial intelligence behind JALI, carefully analyze the sound, determining not only the tone of the voice, but also accents, pauses, emotions of the speaker, and then, based on the data obtained, sets the model the necessary parameters for playing the animation.

The full version of the presentation can be found below:

Release Cyberpunk 2077 will take place very soon, November 19… The project will work on almost all current platforms, including next generation consoles Xbox series x and Playstation 5Not so long ago, a long-term construction successfully went to print

Read also: Disco is back in fashion: Disco Elysium celebrates its first birthday and prepares to receive a translation into Russian

Add to our Telegram channel by the link or search for it manually in the search by name gmradost… There we publish, including what is not included in the news feed Also subscribe to us in Yandex.Dzene, Twitter and VK. And don’t forget that we now have a dark theme and ribbon instead of tiles.