Sony patent could let viewers step in when streamers get stuck in games

Sony has patented a system that could let viewers guide streamers with on-screen pointers, send reactions they can physically feel, and even change parts of the game world.

Backseat gaming could become a lot more hands-on. Instead of typing instructions into chat and hoping a Twitch, Kick, or YouTube streamer notices, viewers could point directly at something on their screen.

The patent, titled “Adaptive screen share pointer and reactions during gameplay,” describes receiving cursor commands from someone watching a livestream without controlling a game character. The pointer’s appearance could change depending on what is happening in the game.

It offers another approach to helping players get unstuck, following Sony’s separate patent for an AI “ghost” player that could complete difficult sections for them.

As spotted by Insider Gaming, possible uses include pointing out a boss’s weak spot, indicating where an enemy could appear, or showing a player where to aim a ball.

The concept also extends beyond giving directions. Examples include viewers creating temporary bridges or manipulating objects, potentially helping the streamer uncover hidden items and passages in PlayStation games.

Sony

The published application also describes viewer reactions triggering haptic feedback, with different reactions producing different sensations. Groups of viewers could influence gameplay when enough reactions of a particular type are received.

However, viewers would not necessarily have unrestricted access. The system could stop processing cursor commands during cutscenes or rotate control between viewers based on their previous contributions.

Microsoft has explored a related idea through its patent for cloud-based gameplay helpers, which describes assistance that could take over difficult sections. Sony’s viewer system instead gives people watching a way to contribute while the streamer remains the player.

It also adds to Sony’s other creator-focused patent ideas, including AI that automatically turns gameplay into social media clips.