Meta Platforms is set to introduce artificial intelligence (AI) capabilities to its Meta Quest headsets, positioning itself ahead of Apple in the rapidly evolving virtual reality (VR) space. This announcement comes as Apple prepares to launch its Vision Pro, with its AI integration scheduled for later this year.
AI Integration in Meta Quest
The new feature, dubbed Meta AI with Vision, will be available on the Quest 3 and Quest Pro headsets starting next month. This development extends the capabilities of Meta’s existing AI, which is already integrated into the company’s Ray-Ban smart glasses. The AI assistant leverages the full-colour passthrough cameras on these devices to provide users with real-time information based on their visual environment.
Meta has provided examples of the AI’s utility, such as helping users complete an outfit by analysing what they are wearing or identifying a dog as it runs in and out of frame. Beyond visual queries, the AI can answer general questions, offer local restaurant recommendations, and retrieve famous quotes from literature, including works like Shakespeare’s Hamlet.
Technology and Limitations
The Meta AI with Vision relies on multimodal technology, allowing it to process inputs from multiple sources and translate content between them. However, the AI’s launch will be geographically limited, available initially only in Canada and the United States, and it will support English exclusively. This restriction is partly due to Meta’s decision not to release its latest multimodal model in the European Union.
Additionally, while the AI is optimised for the advanced sensors in the Quest 3 and Quest Pro, there is potential for future compatibility with the more basic sensors of the Quest 2.
Enhanced User Experience
Meta AI will replace the current Voice Commands on Quest headsets, promising a more intuitive and versatile user experience. Users can enable the AI in an experimental mode via the settings menu on their headset, offering early access to the latest advancements.
The AI’s integration marks a significant step in Meta’s strategy to enhance user interaction with their VR devices. By incorporating real-time visual analysis and internet search capabilities through Bing, the AI is not confined to pre-existing training data, thus offering a more dynamic and responsive user experience.
Implications for the VR Market
Meta’s move to integrate AI into its VR headsets ahead of Apple’s Vision Pro signifies a competitive stride in the burgeoning VR market. The inclusion of AI not only enhances the functionality of Meta’s devices but also sets a precedent for future innovations in VR technology.
The initial rollout’s limitations, particularly its restricted geographical availability and language support, may impact user adoption. However, the promise of expanded capabilities and broader accessibility in the future could mitigate these concerns.
Future Developments
As the VR market continues to expand, the integration of AI into VR devices is expected to become a standard feature. Meta’s early adoption and continuous development of AI functionalities highlight its commitment to maintaining a competitive edge in the industry.
The company’s future plans may include expanding the AI’s compatibility with other Quest models and potentially introducing support for additional languages and regions. These advancements will be crucial in broadening the appeal and usability of Meta’s VR headsets on a global scale.
Meta’s introduction of AI in its Quest headsets marks a pivotal moment in the VR industry. By leveraging advanced technology to enhance user interaction and functionality, Meta is setting a high bar for competitors. While the initial rollout is limited, the potential for future developments could significantly shape the landscape of VR technology.
As the competition between Meta and Apple intensifies, consumers can expect rapid advancements and innovations in VR, driven by the integration of sophisticated AI capabilities. The next few months will be critical in determining how these developments will influence user experiences and the broader VR market.
