Uncategorized

NVIDIA Demos AI Tools for Game Developers, Creators, and Academicians

Earlier this month, NVIDIA held its GeForce RTX AI PC Tour in Bangalore (India), highlighting AI developments that can drastically change crucial aspects of game development, while empowering modders, creators, and independent developers. The technologies present at the event included NVIDIA ACE, Omniverse, ComfyUI, ChatRTX, NVIDIA Canvas, and more. The demonstrations were led by John Gillooly, Technical Product Marketing Manager, Asia Pacific South at NVIDIA.

NVIDIA ACE (Avatar Cloud Engine)

NVIDIA ACE (Avatar Cloud Engine) was first shown off at CES earlier this year. Based on NeMotron-4, a small language model, it has the potential to revolutionize NPCs in modern gaming. It has already been integrated into Mecha Break and Legends, where it’s used to enhance the conversational abilities of characters. This

You can ask an NPC simple (or complex) questions using a microphone that they remember in future conversations. Shackled with a form of the “guard-rail” system, NPCs can stay on topic, providing the most relevant details about your present quest.

Omniverse Audio2Face

Omniverse Audio2Face is another open-source tool that can be used to animate pre-existing character models with near-perfect lip sync. The only inputs required from the user are the face model and the voice recording; the tool does the rest, imparting life-like expressions without needing any additional expertise.

ComfyUI

And there’s ComfyUI. Not the most useful, but perhaps among the more interesting applications of Stable Diffusion. It lets you render superhero versions of any person using TensorRT. It doesn’t require an active internet connection and produces the image almost instantly.

Using a webcam, the hero’s face can be replaced by simply capturing a selfie via a webcam, and feeding it the result.

NVIDIA Canvas

NVIDIA Broadcast (previously RTX Voice) has been around for several years now. It leverages AI to implement noise cancellation that separates human voice from background noise, button clicking/pressing sounds, and any third-party audio. It also lets you use custom backgrounds for video calls, removing any unnecessary objects from the scene.

NVIDIA Canvas is relatively less known. It turns elementary patterns from brushstrokes to sketch representations into realistic images. It’s essentially a layman’s canvas that lets you create lifelike “paintings” without giving the process much thought.

Areej Syed

Processors, PC gaming, and the past. I have been writing about computer hardware for over seven years with more than 5000 published articles. Started off during engineering college and haven't stopped since. Find me at HardwareTimes and PC Opset.
Back to top button