• OpenAI, Gemini, and Snap-Hosted Open-Source Integrations - Get access credentials to OpenAI, Gemini, and Snap-hosted open-source LLMs from Lens Studio. Lenses that use these dedicated integrations can use camera access and are eligible to be published without needing extended permissions and experimental API access.

• Depth Caching - This API allows the mapping of 2D coordinates from spatial LLM responses back to 3D annotations in a user's past environment, even if the user has shifted their view.

• SnapML Real-Time Object Tracking Examples - New SnapML tutorials and sample projects to learn how to build real-time custom object trackers using camera access for chess pieces, billiard balls, and screens.

• Snap3D In Lens 3D Object Generation - A generative AI API to create high quality 3D objects on the fly in a Lens.

• New LLM-Based Automated Speech Recognition API  - Our new robust LLM-based speech-to-text API with high accuracy, low latency, and support for 40+ languages and a variety of accents.

• BLE API (Experimental) - An experimental BLE API that allows you to connect to BLE devices,  along with sample projects.

• Navigation Kit - A package to streamline the creation of guided navigation experiences using custom locations and GPS locations. 

• Learn more about other Spectacles improvements and version requirements in the Spectacles release notes!

• Make new types of games with all-new capabilities, and improved tooling.

  • Turn Based Custom Component allows you to develop turn based Lenses utilizing the Turn Based Dynamic Response API. It provides built-in functionality for session management, game variable serialization, and Lens Studio debugging.

  • Character Controller Custom Component provides a dynamic player movement system designed to support Bitmoji 3D in various gameplay formats. It includes a non-physics-based movement model with physics interactions, animation state management, and joystick input control.

• Bitmoji Suite: Access the Bitmoji Workspace to change Bitmoji outfits in Lenses, animate from the library, and generate furniture and other stylized objects for Bitmoji scenes.

• Face Swap Custom Component enables creators to perform a static face swap between camera input and custom textures using an on-device ML model. The component transfers a source face onto a target face, preserving the source’s appearance while adopting the target’s position and expressions. Supports flexible input/output options and trigger methods.

• [Beta] You now have the option to run Script Components in the Scene panel by toggling `Run Scripts` at the top of the Scene panel–allowing scripts which create visuals at run time to be shown in the Scene panel. At the moment, only the OnAwake and OnStart script events are triggered. We are working on enabling full-fledged Run Scripts support.

  • For example: you can now see a Bitmoji in the Scene panel when adding the Bitmoji3D component to your scene.

• New Home Page now organizes templates, samples, and guides based on Snapchat, Camera Kit, or Spectacles Lens development. 

• Combine PersonTrackingScope and TextureTrackingScope to support body tracking on any texture on entities (e.g. Body Tracking 3D, Person Normals and Depth, Body Instance Segmentation and Body Mesh). 

  • For example, You can now do body tracking on sources like dual camera or camera roll (media picker).  

• New in Easy Lens:

  • Immersive ML - A large collection of ML Effects that add a unique visual style to the entire scene

  • Body Morph - A vast collection of 3D animated humanoid characters, including mythical creatures, animals, and sci-fi figures, with the user’s face projected onto them.

  • Bi-Directional Communication - A stable back & forth EL lens editing. You can now ask questions about the project including questions about EL’s generated code.

• Custom Type Inputs can now be accessed via Editor Scripting.

• Plugin API changes

  • IInstallableContentActions class has been renamed to IPackageActions.

  • IInstallableContentRegistry has been renamed to IPackageRegistry. 

• API Deprecation Policy describes some changes to how we’re handling deprecation of APIs and features along with alternatives for common deprecated APIs you may be using.

• Q&A Chat now shows links to sources, and a summary of what the AI is searching for, before it comes up with the full answer.

• Helper Script improvements to make it easier to update in your project in the future. This update also removes usage of deprecated APIs.

  • Behavior is now available as a Custom Component.

  • TweenManager is now available as a Package.

• Leaderboard Custom Component UI has been updated. Changes include standardized start screen elements added through Score Preview Widget, and Side Switcher Notifications.  

• Material/VFX Editor: Improved depth processing

  • You can now specify the transform space for depth calculation when sampling depth maps from Texture 2D Parameter and Texture 2D Sample nodes, as well as in Depth nodes.

  • The Position From Depth subgraph has been updated to a built-in node, now taking screen space depth to output either view space or world space position.

• GPU Particles: New Features and UI Improvements

  • Custom Force: enables you to write your own custom force for GPU Particles. The default is an Attract/Repel force.

  • Spawn Control: Constant Spawn and Pre-Warm

  • Size and Alignment parameters have been re-organized. Now, only relevant settings should be visible.

• Fixed issue with Spatial Audio on Windows OS.

• Fixed application crash during drag&drop operations with assets.

• Fixed incorrect lens size shown in Project Settings (MiB to MB).

• RetouchVisual set to ML Retouch won’t work correctly with TrackingScope.

• Script generation and troubleshooting are currently disabled in the Lens Studio AI chat assistant. We are working on delivering an upgraded, improved solution in upcoming releases!

Windows 10 (64 bit); MacOS 10.15+

Minimum of Intel Core i3 2.5Ghz or AMD FX 4300 2.6Ghz or Apple M1 with 4 GB RAM; Intel HD Graphics 5000 / Nvidia GeForce 760 / AMD Radeon HD 5570 or better; screen resolution of 1280x768 or higher

Please make sure that you have the latest driver for your specific graphics card installed

Compatibility Matrix

If you are a Camera Kit developer please review the Lens Studio compatibility table to ensure your Lens will work in your application.