The camera will take an image of the subject in the user’s hands and track its movement based on pixels, outlines and / or colors. In doing so, the game can be trained to recognize objects as controllers or tell players in advance what can be used.
The patent proposes using a banana to control the in-game camera or as a joystick replacement for flying, as well as two oranges to replace the steering wheel. In addition, the game can pause itself if the camera loses the tracked object from the field of view.
Finally, the patent mentions the use of a banana as a controller with virtual buttons. Most likely, this will also require a camera that will track clicks.
Instead of the glowing ball of the PlayStation Move controller, the new controller received a small LED panel (marked with the number 235). However, the main feature was the adaptive triggers and vibration on the DualSense controller, which Sony hinted at in its announcement.
The new controller also features finger tracking sensors similar to those on the Valve Index controller. This supposedly allows players to get a feel for the size and texture of virtual objects. So far, this feedback is implemented only on the button for the index finger, but the technology can be used on several buttons.
Finally, the controller received a flexible loop with which it can be attached to the user’s hand. In this case, the controller can be used in either hand.
More on review
