September 17, 2024
September 17, 2024

Lens Studio Powers Social and Spatial Experiences for the New Spectacles

Creating AR for wearables has never been this easy. The newest version of Lens Studio includes critical features and capabilities specific to development for the new Spectacles. Now, you can create AR for on-the-go, real world experiences. Snap AR offers a one stop shop, where ideation, creation, and distribution happens all in one place. Open or Download Lens Studio to join the Spectacles Developer Program.

Group of people wearing the new Spectacles using the Make Believe Lens showing a fantasy world with a dragon in augmented reality.

AR Experiences: Together & On-The-Go

Create experiences that bring people closer together through seamless, end-to-end AR development in Lens Studio. Build shared experiences for Spectacles with Lens Studio’s  multiplayer simulation, designed to accelerate your development & testing. Design experiences for single or multiplayer games, outdoor fitness, daily productivity, and interactive education. Spectacles are standalone and have a see-through display — so you can see and feel every inch of the real world — for a true AR experience rooted in reality. 

Indoors & Outdoors: With Spectacles, you aren’t tied down by battery packs, wires, or controllers. There’s no need to define a boundary, because you have free range of motion and automatic dimming, from indoors to outdoors.

Everyday Interaction: The natural hand input of SnapOS, MyAI integration, and see-through display makes Spectacles a seamless integration into daily life, so you can focus on interacting with the real world.

Shared Experiences: Lens Studio powers experiences grounded in the real world and designed for friends. Advanced world understanding, sync framework, and Connected Lenses keep you engaged with each other.

Woman building for the new Spectacles in Lens Studio while viewing the Lens she built and interacting with the Lens features with her hand.

Advanced Requirements

We’ve added many new features to Lens Studio necessary for Spectacles development. Here are just a few. We built a set of custom Plugins to help profile power and thermal performance with Perfetto traces for Lenses on Spectacles with the Spectacles Monitor. You can retrieve the camera frame – what the user is currently seeing – to better understand and build experiences around the user’s real-world environment with the Camera Module. With the Perform Http Request, you can access external APIs, download media, and more. ​​When developing Lenses for Spectacles, you may need to place an object on a surface instantaneously. We've made this traditionally computationally heavy operation more lightweight, yet maintaining accuracy, with the World Query Module. You can also build mobile controllers to communicate to Spectacles with the Motion Controller Module.

Three people wearing the new Spectacles working on a laptop and playing augmented reality Chess with the new Spectacles.

Faster Development

For larger and more complex projects, it can be harder to keep track of all that’s going on in a Lens. Switch to Real Time Inspection mode for better scene composition, quicker prototyping, and efficient debugging. In this mode, the Scene Panel, Inspector Panel, and Objects Panel are synchronized with the Preview Panel. To streamline and speed up the creation of spatial and hand-interactive experiences, we are introducing the Spectacles Interaction Kit (SIK) – a Lens Studio SDK that provides a set of defined interaction mechanics, suite of UI controls, and behaviors. Using SIK, you can quickly and easily compose interactive experiences that are easy to use and consistent with the overall Spectacles experience.

Easy Collaboration

Collaboration with other developers and artists is vital for big projects. Take advantage of version control tools, like Git, for project management and mitigating merge conflicts. Crafting richer AR experiences often requires creating modular building blocks that can be easily re-used and shared among teams and products. To help with that, we introduced native TypeScript support in Lens Studio, so you and your team can easily structure your projects in more modular ways, catch type errors and focus on building richer AR experiences for Spectacles. You can now also utilize a Package Manager, which comes in handy when managing dependencies and updates to assets, modules, scripts, and frameworks.

The possibilities of what you can create on top of your world are boundless. Be one of the first developers to build Lenses for Spectacles: apply here.