Apple’s ‘foundational’ Vision Pro tool was secretly built 6 years ago
Apple’s ARKit developer framework was made ‘in conjunction’ with its Vision Pro headset, suggesting the tech had a secret purpose when it launched in 2017.
ValVades
Digital Trends may earn a commission when you buy through links on our site. Why trust us?
By
Alex Blake
September 5, 2023 7:37AM 
Long before Apple’s Vision Pro headset made its debut, there was rampant speculation that the company’s wider augmented reality (AR) efforts were part of a larger project toward building the then-mysterious device. Now, it seems that at least one of those technologies was built with Vision Pro in mind.
I recently interviewed Susan Prescott, Apple’s vice president of Worldwide Developer Relations, and Steve Sinclair, senior director of product marketing for Apple Vision Pro, to find out how the company courted developers while prepping the headset. In the course of that interview, Sinclair shed some light on how Vision Pro intertwined with the company’s ARKit developer framework.
AppleThroughout my talk with Prescott and Sinclair, both made repeated references to ARKit, Apple’s framework for building AR experiences. Prescott said it was “foundational” for allowing people to build content for Vision Pro. When discussing how Apple adapted existing tools for its headset, Sinclair stated that “ARKit on iPhone and on iPadOS allowed us the opportunity to learn from developers and from ourselves on how best to implement these things on a platform like Vision Pro.”
Was ARKit specifically built with Vision Pro in mind, I asked, or did its development come about separately and subsequently?
“We’ll just say in conjunction” was Sinclair’s response.
Sinclair’s answer seems to imply that, at a minimum, Vision Pro was a consideration in the development of ARKit, if not the main driving force behind its creation.
ARKit’s secret purpose
AppleWhen Apple revealed ARKit as part of iOS 11 in 2017, it explained that the tool would allow developers to “build detailed and compelling virtual content on top of real-world scenes for interactive gaming, immersive shopping experiences, industrial design and more.” Looking back, that seems like a description ripe for Vision Pro as much as it does the iPhone or iPad.
We already know that Vision Pro has been in development since at least 2007, the date Apple provisionally applied for a very early headset patent. In the intervening 16 years, there have been many other technologies that Apple ostensibly made for different devices that could also have been created with Vision Pro in mind.
LiDAR, for instance, has been heavily promoted as a way to enjoy AR experiences using an iPhone or an iPad Pro, but it also features prominently in Vision Pro. Numerous patents registered over the years, from extending a Mac’s display into virtual space to in-air MacBook keyboards, could all have been disguised Vision Pro technologies.
That’s unsurprising given Apple’s famous tight-lipped reticence, and it’s interesting to see the suggestion that ARKit has always had a secret secondary purpose. What other seemingly innocuous techs could find their way into future Apple devices? Only time will tell.
Editors' Recommendations
Exclusive: How Apple inspired creators to take a risk on its $3,500 Vision Pro Apple’s Vision Pro headset may try to alter your emotions during movies Apple’s Vision Pro may help your eyesight in this genius way Apple has been secretly working on a ChatGPT rival for years The next Vision Pro could let you see invisible energy
In ancient times, people like Alex would have been shunned for their nerdy ways and strange opinions on cheese. Today, he…
Apple’s Vision Pro could get this incredible gaming upgrade
Apple has touted its Vision Pro headset as a premier gaming device that works with many different controllers. But with extensive gesture control seemingly used everywhere on the product except for gaming, it feels like a missed opportunity.
Well, that could change in the future, as a newly published Apple patent (number 11709554) shows how future editions of the Vision Pro could transform your hands into gaming controllers, complete with fingertip controls and haptic feedback.
Apple’s next Vision Pro may send you on a mood-altering trip
It sounds like something out of a sci-fi novel, but Apple could be working on a way to let you alter your mood just by telling its Vision Pro headset how you want to feel. That’s according to a recently granted patent (number 11703944) that outlines the whole futuristic idea.
It’s a strange concept and one that sounds woven right out of a Philip K. Dick story. In fact, in the author’s Do Androids Dream of Electric Sheep? there is a machine that puts users into whatever mood they desire. It sounds as though Apple’s inventors have been reading a little sci-fi in their spare time.
Apple’s secret AR glasses may have this genius feature for glasses users
Apple’s Vision Pro headset has got the entire tech world talking, but it’s still unclear exactly how it will work with the prescription lenses used by glasses wearers around the world. Get it right and it could be a beautifully seamless experience -- get it wrong and Apple risks alienating potentially millions of users. It’s a crucial obstacle to overcome.
Apple has said it will let you add special prescription lenses to the Vision Pro, but pricing is uncertain, and they could cost as much as $600 a pop according to journalist Mark Gurman. Now, though, a fresh patent for Apple’s upcoming augmented reality (AR) glasses shows that there could be a much better -- and cheaper -- way to do it.
