Big Blue Ceiling

Handheld AR Controller

A 3D-printed grip that carries a tracking image and a Bluetooth gamepad.

Eddie OffermannDesigner and builder

Role
Designer and builder
Areas
XR, Hardware, Computer Vision
A white 3D-printed grip standing on a plywood bench, holding a square black-and-white leaf print upright, with a small black Bluetooth gamepad clipped to the front of the handle.

A small prototype from our AR headset work. Instead of relying on hand gestures, we tried a physical controller that a camera-equipped headset could track without special electronics.

The grip is 3D printed and holds a square, high-contrast printed image above the hand, the kind of feature-rich picture that image-target tracking locks onto well. The headset follows the image to know where the controller is and how it's turned. For buttons, a small off-the-shelf Bluetooth gamepad clips onto the front of the handle.

The approach fits the conclusion from HoloFlect: for a lot of interaction, handheld controllers worked better than gesture.

  • The white grip with a black Bluetooth gamepad clipped to the handle and the square leaf print held upright above it.
    With a small Bluetooth gamepad clipped on for buttons and a thumbstick.
  • A hand holding the white grip, with the square leaf print raised above the fist like a paddle.
    In the hand: the target sits above the fist, where a head-mounted camera can see it.
  • The white grip standing on a wooden desk with the square leaf print mounted on top.
    The grip and its printed tracking image.

  • Enhanced Presence

    A run of prototypes chasing the feeling of being in the room with someone far away.

    • Telepresence
    • XR
    • Hardware
    • Computer Vision
    • Research

  • HoloFlect

    A modular, upgradeable AR headset platform built for enterprise.

    • XR
    • Hardware
    • Computer Vision
    • AI
    • Optics
    • Research

  • MRiot Vision Pro Module

    Friendly hardware and software that give entertainment an understanding of people.

    • Computer Vision
    • Hardware
    • XR
    • Tools
    • AI

  • Phone-Based AR Headset

    The first HoloFlect prototype, built from a phone and a hand tracker.

    • XR
    • Hardware
    • Computer Vision