• Lens Cloud is a collection of backend services, built on the same infrastructure that powers Snapchat. Lens Cloud vastly expands what developers can build in augmented reality by providing Multi-User Services,  Location Services, Storage Services and Scanning Services.

  • With the release of Lens Cloud, a City Scale Template has been provided to learn how to get started building city wide content for London, UK.

• A dedicated Visual Studio Code Extension has been released to give developers  the functionality to use VSCode as an IDE for their Lens Studio projects. With the extension installed, VSCode enables; Code editing and smart code completion, JavaScript debugging for Lenses and JavaScript code snippets for Lens development.

• Body Depth & Normal Texture Guide and Template provides developers a detailed estimate of the depth and normal direction for every pixel of a person including their body, head, hair, and clothes. This lets the user easily create sophisticated lighting effects and calculate realistic occlusion and collisions with AR objects.

• Depth Render Target gives developers the ability to capture a Camera's depth stencil texture, enabling ways to create custom effects such as screen space normals, custom occlusions, fog, and depth-based particle collisions.

• SnapML has also received some updated features to enhance a user’s experience and understand the user’s environment.

  • Light Estimation allows developers to do more realistic rendering by matching the real world lighting on objects rendered by the Lens.

• Noise/Blur Estimation gives developers the ability to match the noise and blur levels from the device’s camera with the AR content.

• SnapML now supports quantized models, an ML model format. Some of the benefits include;  model size reduction by 50%, fast inference speed, and more power efficiency.

  • To help showcase quantized models, a new Multi Class Classification Template has been added to showcase these new features.

• Lower Garment Segmentation has been added to the Segmentation System allowing developers to get segmentation masks based on data for upper-garment and lower-garment systems simultaneously with low overhead. A Segmentation Trails Template has been added to showcase this functionality.

• True Size Object Template is a new template that utilizes the best tracking solution available for your device to provide users an accurate scale when placing objects in their physical space. This allows users to test how well physical objects can fit into their environment.

• Voice ML has received two new templates for developers to learn how to add an extra layer of personalization to their content.

  • 2D Animated Text-to-Speech uses a user’s voice to animate 2D lips to be synced with voice.

  • Sentiment Analyzer is a new ML model that returns one of 28 optional emotion classes, such as hope, happiness and anticipation.

• The API Library has expanded allowing you to now build Lenses with third party APIs that give play by play data from five different sport leagues, daily zodiac astrological predictions, and location specific air quality data.

  • Additionally, we made it easier to build Lenses with third party APIs by automatically generating a block of code used to connect to an API upon importing the API asset into your project.

• Fixed issue when duplicate custom components cannot be created from script

• Fixed issue when base color textures are tinted blue on import of certain glTF files

• Fixed crash of Lens Studio with different glTF models

• Fixed crash of Lens Studio when specific script has errors

• Fixed issue when 'Device Camera Texture' moved from folder into root of Resources Panel

Windows 10 (64 bit); MacOS 12.0+

Minimum of Intel Core i3 2.5Ghz or AMD FX 4300 2.6Ghz or Apple M1 with 8 GB RAM; Intel HD Graphics 5000 / Nvidia GeForce 760 / AMD Radeon HD 5570 or better; screen resolution of 1280x768 or higher

Please make sure that you have the latest driver for your specific graphics card installed