Playing Doom without a game engine using Diffusion AI.

[bejiitas_wrath]

Diffusion Models Are Real-Time Game Engines

 

This is a new method of gameplay using Diffusion AI to generate a playable Doom game without an underlying game engine, using the AI to predict what will come up next and generating the level on the fly.

 

Quote

We present GameNGen, the first game engine powered entirely by a neural model that enables real-time interaction with a complex environment over long trajectories at high quality. GameNGen can interactively simulate the classic game DOOM at over 20 frames per second on a single TPU. Next frame prediction achieves a PSNR of 29.4, comparable to lossy JPEG compression. Human raters are only slightly better than random chance at distinguishing short clips of the game from clips of the simulation. GameNGen is trained in two phases: (1) an RL-agent learns to play the game and the training sessions are recorded, and (2) a diffusion model is trained to produce the next frame, conditioned on the sequence of past frames and actions. Conditioning augmentations enable stable auto-regressive generation over long trajectories.

 

 

Paper and more information. Useful charts and graphs.

 

https://gamengen.github.io/

 

Link to the actual paper: https://arxiv.org/pdf/2408.14837

 

[mmiov]

This is some pretty impressive stuff but, it makes me worried about the future of games as a whole. Will companies get lazy and unnecessarily resort to AI generating their games? (Probably yes.)

[JustHeziel]

"in the future, entertainment will be randomly AI generated"

[RataUnderground]

There is another older thread for this garbage.

 

 

[Johnny B. Getgoode]

3 hours ago, mmiov said:

This is some pretty impressive stuff but, it makes me worried about the future of games as a whole. Will companies get lazy and unnecessarily resort to AI generating their games? (Probably yes.)

 

While this is indeed a problem, we already have shit like asset flips and bare-minimum remasters of old classics. The majority of the game industry houses are already finding ways to cut corners and maximize profit and minimize expenses, up to and including laying off the talent that made them money in the first place. You are justified in your worry of AI being a golden ticket to avoid having to design actual games, but let's face, companies aren't getting lazy; they already are.

Personally, I'm fine with AI being used as part of the creative process...when its trained on the USER'S OWN DATA. Poaching copyrighted work or other people's effort to power commercial AI is just douche-y. 

[VGA]

I want an AI-powered Oblige :D

[SupremeBioVizier]

Super interesting, like some coding wizard allowed a player to creep into a rem sleep dream, given we are all products of our environment but with a healthy brain humans can break away and achieve more than it's conditioning, looking forward to an AI not giving the illusion of consciousness but actually dealing with the side effect of consciousness like we all are have a nervous system and shyit. 🤪😆 The future is wetware living airplanes and automobiles "no dave, youve already spent 30 dollars at Starbucks this week, I'm not unlocking the car door"