In case you missed it yesterday , Apple just gave us our first prescribed look atiOS 16.Of form , it did n’t really call it that — as it did last year , the company highlighted severalupcoming handiness improvementsto its operating system , say only that they are coming “ later this year with software updates across Apple political platform . ” That ’s essentially inscribe for iOS 16 , iPadOS 16 , watchOS 9 , and macOS 13 .
While the features Apple announced are fantastic improvement for those with various vision , talking to , or motor impairments , they also address to some overall improvements — specially in AI and machine acquisition — that we will likely see throughout the next generations of Apple ’s operating system . If we read into the announcements , here are a few of the major advancements we can expect to see in iOS 16 :
Live captions = Better speech recognition
Android has had a springy captions feature of speech since version 10 , and now Apple will get it three yr later . With this setting enabled , your iPhone or Mac ( if it has Apple silicon ) will automatically produce caption in real prison term for literally any audio content , including videos , FaceTime calls , phone call option , and more . It ’s a innate extension of the on - twist speech processing that was inclose last yr in iOS 15 , but it speaks to a large improvement in the edification of that lineament .
We hope this means an betterment in Siri ’s understanding of your commands and dictation , but one could easy see these feature show up in other places . Take for exercise , the Notes app , where one can imagine a “ transcribe ” feature to create text edition out of any audio transcription or video . If Apple ’s charge it as an accessibility characteristic , Live Caption ’s transcription will need to be rock - solid , and it opens up a humans of possibleness for the rest of iOS 16 .
Apple Watch mirroring = AirPlay improvements
Another handiness feature of speech coming later this year will get you mirror your Apple Watch on your iPhone and use your iPhone ’s display to control your lookout man It ’s designed to make elements easier to manipulate for those with motor function problems and grant handicapped user to enjoy all of the iPhone ’s extra accessibility features .
Apple will allow Apple Watch mirroring later this year — thanks to new AirPlay advancement .
Malus pumila
However , Apple Watch mirroring also has intriguing implications . Apple says the lineament “ uses hardware and software integration , admit advances built on AirPlay . ” That doesn’tnecessarilymean that we ’ll see something like AirPlay 3 , but it fathom like there are some improvements arrive to AirPlay , probably in the direction of fresh theoretical account for developer .
Notably , this seems like it allows equipment to convey control intent in a path that AirPlay does n’t justly now . AirPlay push audio and video out to devices , and permit for simple controls ( play / pause , volume , and so on ) , but permit AirPlay - compatible devices to signal advanced touch dominance seems fresh and could lead to some unbelievable raw features .
Here ’s a orca scenario : If Apple can mirror your Apple Watch to your iPhone and allow you to amply interact with it , it could probably mirror your iPhone to your Mac or iPad and do the same ! That alone would be a game - changing feature .
Door Detection = Real-world AR object recognition
Apple ’s been quiet ameliorate its objective recognition for some sentence now . For case , you’re able to search for all sorts of things in the Photos app and get prototype hold in them , and Io 15 added a neatvisual search featurethat uses the camera to identify plants and animals , famed landmark , nontextual matter , and other things .
Now Apple has announced it will be append the power to discover doors in veridical time using the Magnifier app , include judging their aloofness and scan text on them . It ’s only for machine with LiDAR ( which how it ’s measure out range ) , but it speaks to a broader improvement in physical object acknowledgment .
The iPhone ’s tv camera will presently be able to notice if doors are open .
The most obvious use - showcase is augmented world glasses or goggles , which are not expected to be release until next class at the earliest . But Apple already has a robust ARKit model for developers , which is used for AR apps , and it includes the ability to greet and pass over certain unremarkable items . And it would n’t be out of character for Apple to preview raw technology that ’s not plunge for a while .
It seems reasonable to presume that the Door Detection feature film is a rude prolongation of work Apple ’s already doing in augment reality scene and target spying . So do n’t be surprised if you see a demo at WWDC of young ARKit framework features for developer . It might bulge in iOS 16 with new AR apps , but it ’s also bound to show up in much bigger projects as Apple continue to exhibit its AR software puppet toward eventual consolidation in AR glass .
