New Sony Patent Could Use AI and a Camera Pointed at Your Fingers to Work Out What Button You’ll Press Next

Sony's latest patent filing, WO2025010132, titled "TIMED INPUT/ACTION RELEASE," aims to revolutionize the gaming experience by significantly reducing latency in future hardware. This innovative approach, first highlighted by Tech4gamers, focuses on streamlining the "timed release of user commands" through predictive technology.

The PlayStation 5 Pro introduced PlayStation Spectral Super Resolution (PSSR), which upscales smaller resolutions to 4K. However, newer graphics technologies like frame generation can introduce additional latency, making games feel less responsive. This issue is not unique to Sony; GPU manufacturers AMD and Nvidia have introduced Radeon Anti-Lag and Nvidia Reflex, respectively, to address similar concerns. Sony's new patent suggests a unique solution to this problem.

Sony's patent outlines a system that uses a machine-learning AI model to predict the next user input, combined with external sensors such as a camera focused on the controller. This setup aims to anticipate and process commands more efficiently, reducing the delay between a player's action and the game's response. The patent specifically mentions, "In one particular example, the method may include providing camera input as an input to a machine learning (ML) model. The camera input may indicate the first user command."

Additionally, Sony explores the potential of using controller buttons as sensors, leveraging their past experience with analog buttons in next-generation controllers. This approach could further enhance the precision and responsiveness of gameplay.

While the exact implementation of this technology in future consoles like the PlayStation 6 remains uncertain, the patent clearly indicates Sony's commitment to reducing latency. This is particularly important in genres like twitch shooters, where high framerates and low latency are crucial for competitive play. As rendering technologies like FSR 3 and DLSS 3 continue to evolve, Sony's efforts to minimize latency without sacrificing responsiveness could set a new standard in gaming performance.