When you buy through link on our site , we may earn an affiliate commission . Here ’s how it work .
scientist have developed an app for the Apple Vision Pro mixed reality headset that lets exploiter control a robot using forefront and deal gestures alone . It could be used to control machine remotely in different scenarios — from play pranks to navigate a disaster geographical zone .
The app , called " Tracking Streamer , " tracks human apparent movement — in particular how the foreland , wrist and fingers move — and stream this data over a Wi - Fi connection to a robot on the same net . The connected robot then translate the datum into corresponding movements .
An app, called “Tracking Streamer,” tracks human movements — in particular how the head, wrist and fingers move — and streams this data over a Wi-Fi connection to a robot on the same network.
The research worker published their work in a short paper bring out March 9 onGithub — an open - source computer code deposit . Their system tracks 26 gunpoint in the hands and wrist joint , as well as disjoined level in the foreland . It also records spatial data — such as how mellow up from the background you are .
interrelate : Please do n’t fag the Apple Vision Pro while drive , study urge , but bribe coffee with VR is an ' exciting gewgaw '
Developer of the appYounghyo Park , a doctorial student at MIT published a TV to the website X , formerly known as Twitter , evidence the system in action .
In a inadequate video clip , subject co - authorGabe Margolis , a grad student at MIT , operate a four - legged golem using his hands and eubstance movements .
Margolis perform gestures to command a robot to approach a shut door , turn the hold with its gripper and enter . In another sequence , he gestures for the robot to pick up a fictile scum can lid and throw it into the garbage . At one tip , he also bends down — which touch off the automaton to mimic him .
— Ultrasonic headband rush lucid dreams using AI , its creators lay claim — but an expert remains disbelieving
— I tried a social basketball secret plan in virtual realness and it ’s a game record changer for VR fitness
— see a ' robot heel ' scramble through a basic parkour course with the aid of AI
Apple launched its Vision Pro practical realism ( VR ) headset in Feb. 2024 , with footage since emerging of people wearing the machine in their Clarence Day - to - daylight lives . soon before its launching , scientists published research that investigated how well VR headsets performed if you were to employ them in daily life history .
They found the twist had a lag sentence , cut off peripheral vision and cause sport - house - mirror - similar distortions . They discourage against wearing VR headsetswhile driving or take the air downstairs .
Park and Margolis hypothecate in their paper that some exploiter may bear the Apple Vision Pro all the time , like glasses , and that continue use will supply more data that can be feed into teach robots how masses move .
