Mobile XR R&D

A run of augmented, mixed and extended reality experiments on everyday phones.

Role
Concept and development
Areas
XR, Apps, Research
A game-style 3D avatar of a bearded man in a navy captain's hat, standing in a real room.

We spent a long stretch of R&D finding out how much augmented, mixed and extended reality ordinary devices could deliver. Most of this work runs on commodity Android and iOS phones and tablets with no special sensors. Some of it uses the Google Project Tango developer kit, and some of the Tango projects run on ordinary phones too.

The compilation video collects twelve minutes of clips from across these projects.

Projects

  • The Augmented Tarot: our first released app, which brings Rider-Waite tarot cards to life.
  • MagicWatch: context cues drive live database queries, presented as graphics and streaming media around you.
  • Virtual Eddie: a game-style avatar tracked at large scale from recognition targets, as a stand-in for a virtual assistant or guide.
  • The Town: spatial tabletop gameplay that started on Google Tango.
  • Tango Car Show: full-size cars placed in natural environments with realistic lighting and reflections.
  • AR Scuba: an underwater 360 video performed as a hologram.
  • AR Portals: doorways from the real world into virtual ones.
  • Augmented Clothing: clothing as an AR platform, starting with hats.
  • Mobile VR Shooter: a printed paddle becomes a tracked controller for phone VR.
  • ARHero: AR tabletop gaming on everyday Android phones.