GameNGen, the first game engine powered entirely by a neural model that enables real-time interaction with a complex environment over long trajectorie

bnew

Veteran
Joined
Nov 1, 2015
Messages
55,910
Reputation
8,234
Daps
157,510

Explaining GameNGen in Layman's Terms​

What is GameNGen?
GameNGen is a new kind of game engine that uses artificial intelligence (AI) to simulate and generate game environments. Unlike traditional game engines that rely on pre-programmed rules and graphics, GameNGen uses neural models—essentially sophisticated AI algorithms—to create the game world. Key Points:
  1. Real-Time Interaction: GameNGen allows players to interact with complex game environments in real-time. This means you can play the game as if it were running on a normal computer, but it's actually being generated by an AI.
  2. High Quality: The simulation quality is very high, comparable to what you'd see in a regular game. For example, it can run the classic game DOOM at over 20 frames per second (which is smooth enough for most players) using just one Tensor Processing Unit (TPU), which is a specialized computer chip designed for AI tasks.
  3. Next Frame Prediction: The AI predicts what the next frame of the game should look like based on what happened in previous frames and any actions taken by the player. This prediction is so good that it's hard for humans to tell whether they're watching real gameplay or simulated gameplay.
  4. Training Process:To achieve this, GameNGen goes through two training phases:
    • Phase 1: An AI agent learns how to play the game by playing it many times and recording these sessions.
    • Phase 2: Another AI model called a diffusion model is trained using these recorded sessions to predict what the next frame should look like based on past frames and actions.

Simplified Example​

Imagine you're watching a video of someone playing DOOM. Now imagine an AI system that can predict what happens next in that video just by looking at previous frames and knowing what actions were taken (like moving left or shooting). This prediction happens so quickly and accurately that it looks almost indistinguishable from real gameplay.

Technical Terms Explained​

  • Neural Model: A type of AI algorithm inspired by how human brains work.
  • RL-Agent (Reinforcement Learning Agent): An AI that learns by trial and error through rewards or penalties.
  • Diffusion Model: An advanced type of neural network used here for generating images based on past data.
  • PSNR (Peak Signal-to-Noise Ratio): A measure of image quality; higher values mean better quality. In this case, GameNGen achieves a PSNR of 29.4, which is comparable to lossy JPEG compression—a common method used for compressing images without losing too much detail.
  • TPU (Tensor Processing Unit): A specialized computer chip designed specifically for running neural networks efficiently.

Summary​

GameNGen represents a significant advancement in using AI for generating interactive game environments in real-time with high quality. It uses sophisticated neural models to predict future frames based on past actions, allowing for seamless gameplay experiences that are hard to distinguish from actual human-played games.
 

Gizmo_Duck

blathering blatherskite!
Joined
Aug 15, 2018
Messages
74,125
Reputation
5,467
Daps
157,475
Reppin
Duckburg, NY
Google DeepMind] We present GameNGen, the first game engine powered entirely by a neural model that enables real-time interaction with a complex environment over long trajectories at high quality. GameNGen can interactively simulate the classic game DOOM

Juelz Talking GIF - Juelz Talking - Discover & Share GIFs
 

daze23

Siempre Fresco
Joined
Jun 25, 2012
Messages
31,967
Reputation
2,692
Daps
44,049
this is crazy :mindblown:

AI is basically drawing the game, frame by frame, in real time. that may seem the same as how a computer normally renders a game, but really it's very different

-they have an AI that runs through DOOM, probably millions of times, doing basically everything possible.

-another AI watches the recordings of the first AI playing the game, and learns to predict what the next frame would look like, based on previous actions

-now this AI basically draws the game frame by frame, from what it learned watching the game a lot. the player inputs a control, and the AI predicts what the next frame should look like

:wow:

I, for one, welcome our new neural model enabled overlords :bow:
 

The axe murderer

For I am death and I ride on a pale horse
Joined
Aug 27, 2015
Messages
40,311
Reputation
6,138
Daps
137,952
this is crazy :mindblown:

AI is basically drawing the game, frame by frame, in real time. that may seem the same as how a computer normally renders a game, but really it's very different

-they have an AI that runs through DOOM, probably millions of times, doing basically everything possible.

-another AI watches the recordings of the first AI playing the game, and learns to predict what the next frame would look like, based on previous actions

-now this AI basically draws the game frame by frame, from what it learned watching the game a lot. the player inputs a control, and the AI predicts what the next frame should look like

:wow:

I, for one, welcome our new neural model enabled overlords :bow:
Yeah I'm skeptical of all the promises that tech bro grifters make with tech AI and all. But this here is legit impressive anyway you look at it
 

Diunx

Probably drunk
Joined
Nov 18, 2013
Messages
12,023
Reputation
1,345
Daps
36,263
Reppin
nightset
So what exactly can be done with this? Gameplay videos? Or is the plant to feed it so much game data that when you ask it to shyt out an RPG it will do so?
 

ORDER_66

Demon Time coming 2024
Bushed
Joined
Feb 2, 2014
Messages
146,916
Reputation
15,774
Daps
585,878
Reppin
Queens,NY
I knew this day was coming where NPC's themselves become self aware and the games are gonna start getting harder...:wow:

GTA 7 gonna be fukking lit...:wow:
 

JNew

Superstar
Joined
Aug 23, 2019
Messages
4,306
Reputation
636
Daps
18,107
At some point the games will become broken if the difficulty becomes infinite.

First thing that comes to mind is spawning enemies out of nowhere or do things game developers never intended.
 

TDT

All Star
Joined
Dec 31, 2014
Messages
3,569
Reputation
477
Daps
6,244

Explaining GameNGen in Layman's Terms​

What is GameNGen?
GameNGen is a new kind of game engine that uses artificial intelligence (AI) to simulate and generate game environments. Unlike traditional game engines that rely on pre-programmed rules and graphics, GameNGen uses neural models—essentially sophisticated AI algorithms—to create the game world. Key Points:
  1. Real-Time Interaction: GameNGen allows players to interact with complex game environments in real-time. This means you can play the game as if it were running on a normal computer, but it's actually being generated by an AI.
  2. High Quality: The simulation quality is very high, comparable to what you'd see in a regular game. For example, it can run the classic game DOOM at over 20 frames per second (which is smooth enough for most players) using just one Tensor Processing Unit (TPU), which is a specialized computer chip designed for AI tasks.
  3. Next Frame Prediction: The AI predicts what the next frame of the game should look like based on what happened in previous frames and any actions taken by the player. This prediction is so good that it's hard for humans to tell whether they're watching real gameplay or simulated gameplay.
  4. Training Process:To achieve this, GameNGen goes through two training phases:
    • Phase 1: An AI agent learns how to play the game by playing it many times and recording these sessions.
    • Phase 2: Another AI model called a diffusion model is trained using these recorded sessions to predict what the next frame should look like based on past frames and actions.

Simplified Example​

Imagine you're watching a video of someone playing DOOM. Now imagine an AI system that can predict what happens next in that video just by looking at previous frames and knowing what actions were taken (like moving left or shooting). This prediction happens so quickly and accurately that it looks almost indistinguishable from real gameplay.

Technical Terms Explained​

  • Neural Model: A type of AI algorithm inspired by how human brains work.
  • RL-Agent (Reinforcement Learning Agent): An AI that learns by trial and error through rewards or penalties.
  • Diffusion Model: An advanced type of neural network used here for generating images based on past data.
  • PSNR (Peak Signal-to-Noise Ratio): A measure of image quality; higher values mean better quality. In this case, GameNGen achieves a PSNR of 29.4, which is comparable to lossy JPEG compression—a common method used for compressing images without losing too much detail.
  • TPU (Tensor Processing Unit): A specialized computer chip designed specifically for running neural networks efficiently.

Summary​

GameNGen represents a significant advancement in using AI for generating interactive game environments in real-time with high quality. It uses sophisticated neural models to predict future frames based on past actions, allowing for seamless gameplay experiences that are hard to distinguish from actual human-played games.

Wonder if it cam simulate the latest DOOM game..
 

bnew

Veteran
Joined
Nov 1, 2015
Messages
55,910
Reputation
8,234
Daps
157,510
this is crazy :mindblown:

AI is basically drawing the game, frame by frame, in real time. that may seem the same as how a computer normally renders a game, but really it's very different

-they have an AI that runs through DOOM, probably millions of times, doing basically everything possible.

-another AI watches the recordings of the first AI playing the game, and learns to predict what the next frame would look like, based on previous actions

-now this AI basically draws the game frame by frame, from what it learned watching the game a lot. the player inputs a control, and the AI predicts what the next frame should look like

:wow:

I, for one, welcome our new neural model enabled overlords :bow:

this is how you get games truly rated E for everyone when you can prompt it at the beginning to exclude certain images like blood, foul language or anything that can be triggering or not approved by a parent.
 

Mowgli

Veteran
Joined
May 1, 2012
Messages
103,086
Reputation
13,358
Daps
243,181
Need a neural final fantasy engine so I can play infinite epic final fantasies with 400 special attacks. 800 epic bosses, 200 summons and 300 magic spells each game
 
Top