-
Sony is working on finger-tracking for a new VR motion controller, possibly the PlayStation Move 2, to be paired with an unannounced PSVR 2 headset.
-
The video accompanies a new research paper titled Evaluation of Machine Learning Techniques for Hand Pose Estimation on Handheld Device with Proximity Sensor.
-
This technique doesn’t use any external vision to track the position of fingers as seen in the controller-free solution on Oculus Quest.
Past patents have suggested that Sony is working on finger-tracking for a new VR motion controller, possibly the PlayStation Move 2, to be paired with an unannounced PSVR 2 headset. Now a new video from Sony researchers gives us a much more solid look at that work..The video accompanies a new research paper titled ‘Evaluation of Machine Learning Techniques for Hand Pose Estimation on Handheld Device with Proximity Sensor’. Crucially, the work is authored by Kazuyuki Arimatsu and Hideki Mori from Sony Interactive Entertainment. That’s the division of Sony specifically responsible for the PlayStation brand, and not the wider corp. Watch the video below – this could well be the basis for Sony next-gen PlayStation Move 2 VR controllers.
What we can see is a prototype for a controller similar to Valve’s Index Controllers in terms of functionality. Sensors in the controller are able to tell when a user is gripping the device with all their fingers and when they lift individual fingers away. The movement is imitated in a virtual representation of the hand, allowing for deeper hand presence in VR. As the video states, this technique doesn’t use any external vision to track the position of fingers as seen in the controller-free solution on Oculus Quest.
Learn more: NEW DETAILS OF SONY PLAYSTATION VR PATENT RELEASED
.
“Sony itself has warned that it’s not likely to release PSVR 2 alongside PS5. Hopefully we won’t have to wait too much longer, though. “
Later on in the video we also see the controller put to the test with a simulated sweaty hand and with hands fitted with rings and watches. The results are impressive. While nothing’s confirmed yet, it’s looking more and more possible that finger tracking becomes a major feature of Sony’s next-generation motion controllers for a possible PSVR 2. We do know that Sony is prototyping new headsets and we also know that its next-generation console, the PS5, will support the original PSVR headset. A true successor seems likely, and a new pair of controllers to accompany it is also likely to happen.
“ A year ago, the company also licensed advanced haptics for VR controllers. Not only that, but advanced haptics and trigger resistance already feature on the new DualSense controller for PS5.”
If these really are Sony’s next-gen VR controllers, expect to see a strap somewhere on the final device to help you hold them, much like the original patent showed. A year ago, the company also licensed advanced haptics for VR controllers. Not only that, but advanced haptics and trigger resistance already feature on the new DualSense controller for PS5. Lots of threads to follow here.
That said, don’t expect to see any of this work as a commercial product this year. Sony itself has warned that it’s not likely to release PSVR 2 alongside PS5. Hopefully we won’t have to wait too much longer, though. For now, check out everything we know about PSVR 2.
The patent for a ‘Controller Device‘ outlines an input mechanism for a “home-use game machine” that “detects movement of a user’s hand”. Not only that, but the kit features “a plurality of sensor units that detect the fingers of the user”. These can detect “the proximity or contact of a finger and outputs a finger detection signal indicating the state of proximity or contact of the finger.” When the fingers are wrapped around the sensor, the controllers can relay that information to a given VR game and reflect the user’s in-game hands as making a fist or grabbing object.
Learn more:
ENTERTAINMENT INDUSTRY UNION LEADERS TO DISCUSS THEIR EFFORTS AT COMBATING PANDEMIC
.