We’re excited to unveil four new features for the Lens Studio 4.28 release — Spatial Persistence, Question Answering Service, Two Hands Tracking, and Face Occlusion — as well as improvements to existing tools. Learn more about our latest release below and be sure to check back for more Lens Studio features and updates.
NEW LENS STUDIO UPDATE
NEW LENS STUDIO UPDATE
Introducing Spatial Persistence, Question Answering Service, Two Hands Tracking, and More
Spatial Persistence
Now Lens Creators can produce content tied to a physical location, enabling powerful AR experiences that can exist anywhere in the world. Snapchatters can see and pin location-specific AR content, read or write AR content at that location, and retrieve that same Lens experience data when they return to that location at a different time or restart the Lens. Spatial Persistence builds on our existing cloud persistent storage solution.
Question Answering Service
With this new VoiceML feature, creators can build highly interactive question/answer Lenses for Snapchatters that enable them to learn fun facts and information about a wide range of topics by asking questions and receiving real-time answers based on pre-loaded text. Creators can set the topic, questions, and answers, and Snapchatters will be able to ask up to 15 questions in one session.
Two Hands Tracking
As Spectacles continue gaining popularity, we’re continuously developing new assets to create Spectacles experiences that feel naturally overlaid on the world, including hand interactions and gestures. This update expands current 3D Hand Tracking to efficiently track two hands at once, and is most useful when used with Spectacles. Try out this new tracking mode with the 3D Hand Tracking Template — simply select the “Two Hands” checkbox and you’ll be ready to build!
Face Occlusion
Now creators can apply visual effects more precisely to faces when building face Lenses. If a Snapchatter places an object in front of their face — like their hand or hair — this occlusion model will hide that part of their face, creating a more realistic experience. The Face Occlusion Custom Component is now available in the Asset Library and as a Face Occlusion Template showcasing scene setup for developing improved face Lenses.
Support for French in ASR Template
An improvement for VoiceML functions, French has been added to the list of Automatic Speech Recognition (ASR) Languages offered in the Speech Recognition Template. Now Lens Creators can support and select French for any Lens using Transcription or keyword detection.
Hands in 3D Body Tracking
This update improves Bitmoji Custom Component capabilities — enabling Snapchatters to attach their Bitmoji avatar to bodies in Lenses and track hand joints for added personalization. Simply select the “Track Hand” checkbox within the Bitmoji Custom Component in the Asset Library.