After years of speculation, Apple announced the Apple Vision Pro, the tech giant’s first spatial computer, at WWDC23 in June 2023. At the presentation, Apple’s CEO Tim Cook spoke of “a new era for computing,” while Mike Rockwell, Apple’s Vce President of the Technology Development Group, described the Apple Vision Pro as “the most advanced personal electronics device ever” (source: Apple).
Promising words, but what can the Apple Vision Pro really do? The Apple Vision Pro has been available in the USA since February 2024 and in Germany from July 2024. This makes it all the more important to take a closer look at the latest innovation from Apple and decide whether it’s worth buying.
Overview and hardware
Personal computing, mobile computing, spatial computing — the Apple Vision Pro is the third major innovation from the Californian technology company after the Mac and iPhone. Visually implemented as a wearable mixed reality headset, the Apple Vision Pro represents a standalone spatial computer that connects digital content to the physical world without isolating the user from their environment (the Apple Vision Pro is not intended to be classified as a VR or AR device).
What does that mean exactly? Apple Vision Pro creates an infinite canvas for apps that integrates seamlessly into the room without being limited by a display. The three-dimensional user interface is controlled by eye movements, hand gestures and voice commands.
Apple Vision Pro: hardware (source: Apple)
Let’s take a look at the hardware. The Apple Vision Pro basically consists of four components:
The lens
The central element of the Apple Vision Pro is a continuous piece of three-dimensionally formed, laminated glass that flows into a slightly curved aluminum alloy frame. This glass acts as a lens and contains all the internal hardware of the Apple Vision Pro, including all sensors, cameras and chips.
On the left side of the frame is a shutter button for taking photos and videos in 3D, and on the right side is the Digital Crown. Clicking on it opens the home screen; by turning it, the user can adjust the degree of immersion, and thus decide for themselves how much they want to immerse themselves in the virtual world.
The light seal
Lens and frame are connected with a light seal made of a soft textile that keeps unwanted light away from the eyes. It can be bent to adjust the fit and is available in a range of shapes and sizes.
The headband
The headband is made of three-dimensionally knitted fabric and has a light gray color with orange highlights. It provides cushioning, is breathable, stretchy and also available in multiple sizes.
The battery
To reduce the weight of the Apple Vision Pro, the battery is not integrated into the headset, but can be connected to it via a woven cable, similar to a powerbank. It fits easily into the pocket of a jacket or pants.
Overall, the Apple Vision Pro has a modular design so that the ideal-fitting model can be put together for every head and face shape.
Apple Vision Pro trailer: design
Display: Micro OLED technology and EyeSight
The Apple Vision Pro uses two ultra-high-resolution, micro-OLED displays in the size of a postage stamp, each with 23 million pixels per display. That’s a higher number of pixels than a 4K TV has — per eye. In addition, there are special catadioptric lenses that are supposed to ensure outstanding image sharpness. With these technical features, the Apple Vision Pro literally transforms any place into a home theater with a screen that feels 30 meters wide.
Glasses cannot be worn under the Apple Vision Pro, but users with vision correction needs can use ZEISS optical inserts that are magnetically attached to the inside of the display. The lenses have to be purchased separately.
EyeSight was developed so that users can better interact with other people while using the Apple Vision Pro: This innovative feature makes the device appear transparent as soon as someone approaches. Users can see the person, while at the same time the eyes of the user are visible. However, these are not the actual eyes, but rather a realistic projection in the lens.
Apple Vision Pro: EyeSight (source: Apple)
Cameras und eye tracking
Two main cameras, four downward-facing cameras, two infrared cameras, two side cameras, two TrueDepth cameras and five sensors — they are all integrated into the glass lens and continuously capture the user’s surroundings as well as their hand or eye movements, even in low light.
The two main cameras are Apple’s first 3D cameras. They are located on the bottom front and allow taking photos as well as videos with a larger depth of field. LiDAR scanner and true-depth cameras create 3D maps in real time, among other things.
In addition, there is the high-performance eye tracking system: It uses high-speed IR cameras and a ring of LEDs that project invisible light patterns onto the user’s eyes. This enables responsive, intuitive input, making additional hardware to control the Apple Vision Pro obsolete.
Control
Speaking of control: No controllers or the like are needed for the Apple Vision Pro. The three-dimensional user interface is controlled intuitively by the user’s eyes, hands and voice. For example, the hand does not have to be raised to select certain things with the fingers — it can simply remain in the lap or at the sides of the user’s body.
Spatial audio und audio ray tracing
The Apple Vision Pro has an extremely advanced spatial audio system that provides a more intense sound experience. For this purpose, the user’s ears are scanned in advance (HRTF = Head-Related Transfer Function) to customize the spatial audio to the individual head and ear shape (this option has already been available since iOS 16). Two individually amplified drivers inside each audio pod, which are located in the immediate vicinity of the user’s ears, generate this personalized 3D audio and transfer it directly.
Furthermore, the Apple Vision Pro has audio ray tracing: This function uses sensors that detect materials and objects in the room to then give the impression that the sound comes directly from the surrounding environment.
Apple Vision Pro trailer: audio
Operating system: visionOS
The first spatial computer consequently also uses the first spatial operating system: visionOS features a three-dimensional user interface that appears as if it were physically present in the room. Visually, it resembles a mixture of iPhone, iPad and Mac screen, but at the same time it is something completely new.
Apple Vision Pro: visionOS (source: Apple)
The boundaries of a display are removed so that apps of any size can be displayed side by side in the space around the user — multitasking is redefined here. A connection with Magic Keyboard, Magic Trackpad or a Mac itself is also possible. In this case, the Apple Vision Pro becomes a very large, private and portable 4K display.
Apple Vision Pro: operating system (source: Apple)
The visionOS user interface responds dynamically to natural light and casts shadows to help the user understand scale and distance. Interaction itself happens via eyes, hands and voice, as mentioned earlier: Users can browse through apps by simply looking at them, select apps by tapping their fingers together, scroll by flicking their wrist, and dictate with their voice.
Processor, RAM and storage
For a smooth user experience, the Apple Vision Pro features a dual-chip design: the M2 chip provides standalone power to allow the device to operate independently, while the R1 chip provides a lag-free content experience. Heat generated by the processors is dissipated as the Apple Vision Pro draws air up the bottom of the headset and vents it out at the top.
The newly introduced R1 chip processes input from twelve cameras, five sensors, and six microphones, ensuring that content feels as if it is appearing in real time. New images are streamed to the displays within twelve milliseconds, eight times faster than the blink of an eye.
In terms of memory capacity, the M2 chip has 16 GB of RAM and the R1 chip has a memory bandwidth of 256 GB/s.
Apple Vision Pro trailer: processor
Battery life
If the Apple Vision Pro is connected to the mains (via USB‑C adapter), it can be used all day. Apple also offers an external battery that is connected to the headset via cable, similar to a power bank. The runtime is approximately up to two hours.
Weight and dimensions
The Apple Vision Pro measures approx. 16 x 9 x 25 cm (width x height x depth including headband). The housing alone is about 4 cm deep, including the light blocker it is 9 cm.
With a weight of 600–650 g (depending on the light seal and headband), the Apple Vision Pro is not exactly a lightweight. The separate battery weighs 353 g.
Privacy and security
Eye tracking, spatial audio — with so much sensitive data, the question arises how the Apple Vision Pro is set in terms of privacy and security. As it turns out, very well: The data collected during eye tracking, for example, is stored locally and not shared with Apple, third-party apps or websites.
The data recorded by the microphones, cameras and sensors is processed at system level, so individual apps do not have to check the user’s environment themselves. EyeSight, on the other hand, has a visual indicator that shows when users take a photo or video.
With Optic ID, a new authentication method is introduced that analyzes the iris of the user with various invisible LED light images, compares it with the Optic ID data protected by the Secure Enclave, and then unlocks the Apple Vision Pro. Optic ID user data is fully encrypted and remains internal to the device, so it is not stored on Apple servers. The data is not accessible to apps.
Price and release date
The price of the Apple Vision Pro starts at 3,499 US dollars. With the release date in Germany, the price in euros was also announced: The base model with 256 GB starts at EUR 3,999.
An impressive price that will prove difficult to make the Apple Vision Pro accessible to a wide range of people. Apple is therefore reportedly already working on a cheaper model that could be called Apple Vision (without Pro).
As the cameras and sensors, the dual-chip design and the two OLED displays are the most expensive components of the headset, cutbacks could be made on these elements, in order to reduce the price. According to industry observers, the cheaper model could be launched on the market in 2025 at the earliest, but probably not until 2026.
Apple only sells the Apple Vision Pro directly: in the Apple Online Store, the Apple Store App and in Apple Stores.
Apple Vision Pro — specs at a glance
General |
Singular piece of 3D formed glass that acts as a lens, aluminum alloy frame, light seal, 3D knitted headband Shutter button for photo/video recording Digital Crown for immersion control |
Display |
2x micro-OLED display with 23 million pixels each, pixel width 7.5 microns EyeSight technology Insertable ZEISS lenses for wearers of glasses |
Camera |
12 cameras, 5 sensors Eye tracking |
Audio |
Spatial audio (HRTF) Audio ray tracing 6 microphones |
Control | Eyes, hands, voice |
Operating system | visionOS |
Processor |
Dual-chip design: M2 chip for standalone performance R1 chip for a lag-free, real-time experience of content |
Battery | 2 hours with external battery, otherwise mains operation |
Release date | February 02, 2024 in the USA, July 12, 2024 in Germany |
Price | 3,499 US dollars, 3,999 euros |
Apple Vision Pro Test — what are the first reactions?
Some testers had the opportunity to try out the Apple Vision Pro shortly after it was launched. Overall, all participants of the Apple Vision Pro demo are enthusiastic. “I think this is the first device where the word “magical” actually fits the most,” sums up web video producer Alexander Böhm on his YouTube channel AlexiBexi. One of the reasons why is that users don’t even realize that they are interacting with a technical device.
Nilay Patel from The Verge is also mostly positive about the Apple Vision Pro, but notes that wearing the headset makes you feel oddly lonely. He wonders how you can, for example, watch a movie together or collaborate with people who are in the room and connected via FaceTime at the same time.
t3n was particularly impressed by the intuitive control of the Apple Vision Pro, the adjustable immersion and the high resolution, but criticized the high weight and the annoying connection to the external battery.
We also have a model of the Apple Vision Pro in the Bitnamic office. Apple’s first spatial computer is certainly promising — especially with regard to the possibilities for remote maintenance and use in industry.
Apple Vision Pro in industry
Compared to other smart glasses for industry, the Apple Vision Pro is similar in appearance and price to the Microsoft HoloLens 2. Like the latter, the Apple Vision Pro is also very suitable for industrial fields of application: Especially in production and manufacturing, logistics, construction, but also in the pharmaceutical and healthcare sectors, processes can be simplified or accelerated.
The high resolution and delay-free image transmission of the Apple Vision Pro are particularly useful for precise work in maintenance and service or quality control. Of course, there is also the possibility of working with both hands free, as there is no need to hold an additional device such as a smartphone or tablet.
Most of the benefits are likely to be achieved in combination with augmented reality: AR elements support remote maintenance and step-by-step instructions, while checklists are displayed to help with quality control or product acceptance. Various situations could be simulated for training courses to test trainees’ skills.
We at Bitnamic will be running a few more tests, but we can already say for sure: The Apple Vision Pro has enormous potential — and this needs to be unlocked.