Sony's New AI Patent Predicts Button Presses Using Finger-Camera Tech

Sony's latest patent filing suggests a groundbreaking approach to reducing latency in future gaming hardware, leveraging an AI model supported by additional sensors. This move comes in the wake of Sony's introduction of PlayStation Spectral Super Resolution (PSSR) with the PlayStation 5 Pro, which, while capable of upscaling to 4K, can introduce latency issues due to frame generation technologies.

This new Sony patent could be a game-changer for PlayStation. Image credit: Sony Interactive Entertainment.

As reported by Tech4gamers, the patent, numbered WO2025010132 and titled “TIMED INPUT/ACTION RELEASE,” aims to streamline the "timed release of user commands" by predicting the next button press. Sony's filing explains that latency between a user's input and the system's execution can lead to delayed and unintended consequences in gameplay. To address this, the patent proposes a system that includes a machine-learning AI model to anticipate the next input, paired with an external sensor such as a camera focused on the controller to detect impending button presses. The patent specifically notes, “In one particular example, the method may include providing camera input as an input to a machine learning (ML) model. The camera input may indicate the first user command.”

Moreover, the patent hints at the potential use of controller buttons as sensors, especially given Sony's history with analog buttons. This could lead to innovative controller designs in future PlayStation generations.

While it's uncertain whether this exact technology will feature in the PlayStation 6, Sony's exploration into latency reduction is clear. This initiative is particularly relevant given the popularity of rendering technologies like FSR 3 and DLSS 3, which can increase frame latency. Such advancements are crucial for genres like twitch shooters, where both high framerates and low latency are essential for competitive play. Whether this patent translates into tangible hardware improvements remains to be seen, but it underscores Sony's commitment to enhancing the gaming experience.