Quest headset will be powered by Meta AI
Meta AI, an assistant built on the Llama 3.1 model, can be experienced through mobile applications and web platforms. Meta has also integrated it into their Ray-Ban Meta smart glasses. Recently, Meta announced on their official blog that the Quest headset will also benefit from Meta AI’s capabilities.
Specifically, Meta AI with Vision will utilize the Quest headset’s cameras to capture external information. Users can summon Meta AI in passthrough mode via voice commands, such as asking about outfit coordination while holding up a pair of shorts or requesting a description of the surrounding scenery. Naturally, Meta AI can also perform typical tasks of mobile assistants, like locating nearby restaurants or basketball courts and providing weather forecasts for the coming days.
Meta AI will be launched as an experimental feature on Quest in the United States and Canada in August, with plans for ongoing improvements. Due to the requirement for a color passthrough mode, Quest 2, which is equipped with infrared cameras, will not support Meta AI with Vision. Additionally, Meta AI will replace the existing voice command system in the Quest.
Furthermore, beyond adding more functionality to the Meta Horizon OS headset system, Meta has recently updated the accompanying mobile application. The Meta Quest mobile app has been rebranded as the Meta Horizon mobile app. The update also enhances social features, allowing users to complete Meta Horizon Worlds tasks directly on their phones. The app interface now includes a new bright mode as well.