In partnership with ULSee, we planned, designed, and built a real-time and dynamic virtual try-on platform based on facial tracking that allows users to envision their next look, anytime, anywhere.

The Ask

Digital has changed the way consumers interact with brands and traditional marketing efforts to draw in customers are not necessarily resulting in increased sales. We sought to create a virtual reality experience that went beyond gimmick and trend, to be a truly scalable business solution that addressed the increasing pain-points modern retailers face: ratio of in-store inventory vs. cost, utilizing existing assets, appealing to a digitally-savvy demographic, and the paramount need to increase online and in-store sales.

Pupillary Distance (PD) measurement, facial tracking software, virtual try-on capabilities, and 2D to 3D imagery conversion creates a near perfect, life-like experience.

The Actualization

We began with conducting people-centric research to form customer archetypes, and from there we went through the experience mapping and story mapping process, which informed the design of a functional prototype for test markets. We met with international eyewear corporations to understand their unique business needs and objectives in order to get the right product to market in the most efficient way.
Sixty six feature points within the facial tracking software allowed for head and facial movement recognition that creates a life-like view for how the product will look, in near-perfect scale, on the consumer. This resulted in the creation of a smart mirror platform, featuring Pupillary Distance (PD) measurement, virtual try-on, and 2D to 3D conversion of inventory imagery. This give the ability to fit approximately 10,000 virtual frames on a single application, with additional inventory accessed server-side. This all results in increased consumer-facing retail access points and a hyper-specific shopping experience that caters to the retail, spending, and social habits of the consumer.

“Taking standard 2D images, we were able to create 3D effects that match the roll, yaw, and pitch angle of head poses as customers evaluate their glasses from a multitude of angles.” Paul Liu, ULSee

The Accolades
  • 2015 W3 Awards GOLD winner, Best Use of Mobile Camera
  • 2015 Davey Awards SILVER winner, Best Use of Mobile Camera
  • Core technology platform can be applied virtually to any facial “try-on” need, i.e. eyewear, makeup, etc.
  • Scalable business solution that limits need for costly on-site inventory
  • Creates strong brand loyalty by giving consumers the ultimate in options, regardless of location
  • Use of existing 2D marketing imagery converted to 3D


  • UX Design
  • Strategy
  • Motivational UX™
  • Application Development
  • Visual/UI Design

Ready to envision what’s next?

Business Design Strategy
Consumer Products
Learn to Quit
Designing the Future of Complex Training and Simulation
Philips Sonicare For Kids
Man working at a whiteboardWoman testing on a tablet

Hi! Let's stay in touch.
Sign-up for our newsletter!