Sony patents artificial intelligence system for video games

Key things

Sony is patenting artificial intelligence for creating game assets to improve customization for content creators or developers.
The technology allows people to edit scenes using voice commands, though it's unclear if this will be accessible to players
Sony leads the way in patenting AI systems for integration into games, but competitors are expected to follow.

A new patent has appeared Sony's plan to allow content creators to use artificial intelligence to create video game assets. The development is notable as major video game companies race to integrate AI into their products, with Sony leading the way by regularly patenting new AI technologies.

As of 2023, the company has patented several notable AI-based technologies. Recently, for example, a Sony patent allowed AI to interact with the game and stream the game. In another patent, the console giant proposed creating artificial intelligence companions based on player behavior that would potentially offer more immersive and personalized gaming experiences. Now, Sony seems to be taking artificial intelligence further by exploring how to turn gamers into game asset creators.

Sony is working on a new device that will help developers make better use of the PS5's haptic feedback

A recent patent publication details a new device in development by Sony that could help game developers implement haptic feedback.

A newly discovered Sony patent details technology that converts voice inputs into 3D models that can later be edited and inserted into a game. The patent's focus on creating “subparts” suggests the system will likely be used to customize background objects. One example from the patent describes how a user creates and modifies a chair using AI and then implements it into a scene.

Sony's new artificial intelligence allows players to customize objects in games

This new asset generation patent could potentially revolutionize how players interact with video game worlds. The technology appears to allow content creators and developers to edit scenes using voice commands, create personalized game environments and cosmetics. This could mean changing the entire scene design or generating customized accessories for the characters in the game. Of course, the patent does not clearly indicate whether this system will be available to players. However, with Sony patenting an AI-based avatar generation system earlier this year, it's likely that the company is aiming to expand the player's customization options.

How Sony's AI-powered asset generation works

User provides voice input.
AI processes the input, converts it to text and creates a corresponding 2D model.
The 2D model is then converted to a 3D model using a conversion algorithm.
The user can edit the generated asset using example images or voice commands.
The final asset can be incorporated into the game.

The use of artificial intelligence in video games is predicted to grow by 27% from 2020 to 2027, forcing other industry giants to compete for the most lucrative features. Currently, Sony is at the forefront with a number of pioneering AI technologies that have already been patented. But rivals like Microsoft are expected to enter the race soon. In 2022, during the height of interest in AI, Microsoft patented an AI-generated audio score system for personalized in-game soundtracks, indicating that it won't let Sony dominate the space.