NVIDIA will use its new NVIDIA ACE technology for the first time in the game “MECHA BREAK”

NVIDIA has announced that its NVIDIA ACE technology will be used for the first time in the game MECHA BREAK from the studio Amazing Seasun Games. This technology is intended to deliver a completely new gaming experience that will immerse players even more in the virtual world.

But what exactly is NVIDIA ACE? This technology makes it possible to use generative AI to create digital characters so lifelike that they can act and interact like real people. NVIDIA ACE covers all aspects of a digital human – from speech and translation, visual perception and intelligence to realistic animations, behavior and a lifelike appearance.

At Gamescom 2024, NVIDIA debuted its On-Device Small Language Model technology, which is specifically designed to enhance the conversational abilities of game characters. These ACE and Digital Human technologies will be used for the first time in Amazing Seasun Games’ MECHA BREAK game to bring characters to life and deliver a more dynamic, immersive gaming experience on GeForce RTX AI PCs.

Specifically, the Nemotron-4 4B Instruct model has been integrated. This is NVIDIA’s first on-device digital human voice model designed specifically for role-playing games. It has features such as retrieval augmented generation and function calling that enable game characters to respond more intuitively to player instructions and perform more accurate and relevant actions.

Nemotron-4 4B Instruct is available as an NVIDIA NIM for cloud and on-device deployment by game developers. According to NVIDIA, these NIMs are optimized to keep memory requirements low while ensuring fast response times. Developers can leverage the power of over 100 million GeForce RTX-powered PCs and laptops.

It’s also worth taking a look at the game itself: MECHA BREAK is a multiplayer game in which players can select and customize different mechas, for example by changing their design. According to NVIDIA, the ACE showcase demo will allow players to interact with NPCs in natural language, particularly the game’s mechanic. Players can ask him for advice on objectives, the best mech for a particular task and more, or customize their mech’s paint job for added polish on the battlefield.

The game will be released in 2025. An exact date is not yet known. You can watch a first showcase here:

Source: NVIDIA