New leak reveals exactly how Apple’s VR headset will work

Apple’s Reality Pro headset will launch in a few weeks, but most of its software capabilities have been kept secret -- until now, as a new report reveals all.

New leak reveals exactly how Apple’s VR headset will work

Digital Trends may earn a commission when you buy through links on our site. Why trust us?

Alex Blake

By April 19, 2023 4:23AM

Apple’s forthcoming Reality Pro headset hasn’t even launched, yet it’s already been plagued by negative stories and general skepticism about its prospects. Yet a new report claims Apple is going to come out swinging with a full gamut of blockbuster apps and games for its high-end device, all in an attempt to win over wary customers.

First reported by Bloomberg journalist Mark Gurman, Apple is apparently building a host of apps and experiences that will entice people to shell out around $3,000 for the mixed-reality headset. These will include games, workouts, collaboration tools, and much more, with a mixture of virtual reality (VR) and augmented reality (AR) options.

A man using a virtual reality headset with controllers.

All this is necessary for a few reasons. Firstly, mixed-reality headsets are still a new, niche market, and many of Apple’s potential customers will have never tried one. Apple will need to convince these newcomers that its headset is fun and easy to use, not a confusing and intimidating device.

The second issue is the Reality Pro’s high price. Expected to cost $3,000, it will be more expensive than most rivals devices. As such, customers are likely to be much more cautious about buying one. If Apple can create an enticing software ecosystem for its headset, it might be able to ease people’s concerns about the financial outlay.

Immersive experiences

A rendering of an Apple mixed-reality headset (Reality Pro) in a gray color seen from the front.Ahmed Chenni, Freelancer.com

Gurman states that a big part of Apple’s strategy involves tweaking existing iPad apps to its VR and AR world. The company has apparently adapted many of its existing iPad apps and optimized them for the headset experience, including Safari, Calendars, Maps, FaceTime and more.

Some of these modified apps will feature immersive experiences that make use of the Reality Pro’s capabilities. Apple Fitness+ will incorporate VR instructors for its workouts, while the Freeform collaboration app could let you work together with other Apple headset users on virtual whiteboards. Another key experience is TV viewing, with the Apple TV app rumored to let you watch sports or movies in immersive environments like a desert or the sky, according to Gurman.

FaceTime could also create 3D renderings of call participants within a VR meeting room, something Meta has attempted to do with its Quest Pro headset. Meta’s efforts have not met with a particularly positive reception, however, so it remains to be seen whether Apple can succeed where its rival has stumbled.

Pitching to developers

Apple VR Headset Concept by Antonio De RosaAntonio De Rosa

Being able to achieve that will depend in large part on whether Apple can get developers on board to build the kinds of killer apps that will help the headset break out into the mainstream.

It is apparently no accident that Apple is expected to unveil the Reality Pro at its Worldwide Developers Conference (WWDC) in June, an event that will be packed to the gills with developers and will feature a week of hands-on sessions to give attendees time to learn about the headset and the xrOS operating system that will power it.

Yet Apple doesn’t just want to attract developers focusing on content consumption apps — it also wants the Reality Pro device to become a key tool in content creation. It will allegedly support apps like Pages, Keynote, GarageBand and iMovie, all for creating documents, music and movies. Gaming will also be an important focus, and Apple is rumored to be working with games developers on bringing their products to the headset.

How xrOS will work

A rendering of an Apple mixed-reality headset (Reality Pro) in a gold color seen from the front.Apple headset render Ahmed Chenni, Freelancer.com

We’ve heard before that Apple is building a dedicated operating system for the Reality Pro headset, dubbed xrOS. In his latest report, Gurman revealed a few new details about this system.

For one thing, xrOS “will be able to run multiple apps at the same time, floating within the mixed-reality interface.” This includes the ability to remember where you were when using a certain app. For instance, if you were using Safari in your kitchen, moved to another room, then back to the kitchen, your web browser would reappear where you left off each time.

The operating system is based on iOS, Gurman says, which will help make the process of bridging existing apps to the new device much easier. In fact, the reporter states that headset users will be able to use “millions of existing apps from third-party developers.” The iOS parallels will be seen in the form of a familiar-looking home screen with floating app icons, as well as the addition of Apple’s Control Center for controlling volume, Bluetooth and Wi-Fi.

You’ll be able to use all these apps with a combination of hand-tracking and eye-tracking, swiping through virtual menus with your fingers and typing on virtual keyboards in midair (although the headset will also connect to physical keyboards too). Apple has also created a form of biometric security that scans a user’s eyes to unlock the device.

With all these software features apparently in the works, Apple is clearly making a strong push to appeal to customers and convince them the Reality Pro is worth its $3,000 price tag. Whether those efforts can actually win over the market remains to be seen, but we’ll all have a better idea at WWDC in June. As Gurman himself has previously argued, it could be one of the most critical events in Apple’s history.

Editors' Recommendations

Here’s why WWDC could be a ‘critical event’ for Apple Leak reveals how Apple VR headset’s hand tracking may work Apple boss says AR ‘may be even better than just the real world’ Apple just patented a new VR headset controller — but there’s a catch Apple’s Reality Pro headset just got demoed in a secret ceremony

Alex Blake

In ancient times, people like Alex would have been shunned for their nerdy ways and strange opinions on cheese. Today, he fits right in at Digital Trends, where he writes about all things Apple, from the latest devices to ongoing developments and everything in between. He’s loved tech ever since he realized video games were about as fun as real people, but easier to manage and much cheaper.

He was first drawn to Apple thanks to its combination of beautiful design and aspirational price tags that helped remind him of his place somewhere between grunt and serf. He’s written for brands like TechRadar, GamesRadar and MacFormat, and runs a popular blog dedicated to EA’s FIFA series. They say that if the wind’s just right and you really listen hard enough, you can hear him ranting about FIFA’s career mode from anywhere in the world.

Some Apple staff concerned about its high-tech headset, report claims

A rendering of an Apple mixed-reality headset (Reality Pro) in a gray color seen from the front.

Apple is expected to launch its first mixed-reality headset in the next few months, but a report by the New York Times on Sunday suggests that some at the company have doubts about its potential for success.

Citing eight current and former Apple employees, the Times said that for some at the company, “enthusiasm has given way to skepticism” regarding the AR/VR headset, which is likely to be unveiled at Apple’s annual Worldwide Developers Conference (WWDC) in June.

Read more

Apple’s VR headset may have leaked — but there’s a catch

A rendering of an Apple mixed-reality headset (Reality Pro) in a gold color seen from the front.

The first images of components for Apple’s mixed-reality headset have supposedly just leaked online, possibly providing a tantalizing glimpse of what is to come. But there are questions surrounding the images, and they might not be what they claim to be.

The images were posted by MrWhite128 on Twitter, a protected account known for having provided accurate Apple leaks and information in the past. The four pictures seem to show various cable arrangements, including a handful apparently shaped to fit around a user’s eyes.

Read more

Apple’s VR headset could launch early, and that’s risky

A rendering of an Apple mixed-reality headset (Reality Pro) in a gray color seen from the front.

Tim Cook has pushed for Apple to launch its Reality Pro mixed-reality headset as soon as possible, despite objections from the company’s powerful design team. The move raises questions over whether the device will be ready for prime time when it launches this summer.

The news comes from the Financial Times (FT), which cites a former Apple engineer as a source. This engineer reportedly worked on the headset project and noted that there is “huge pressure” on Apple to launch the Reality Pro after years of postponements.

Read more