Human-Computer Interaction



A prototype tangible six degrees of freedom (6 DoF) input device that is inexpensive and intuitive to use: a cube with colored corners of specific shapes, tracked by a single camera, with pose estimated in real time.

News: Our work featured on the Science360, NSF‘s official news site! [link]

This work has been published on Graphics Interface 2017.

Chen, Zeyuan, Christopher G. Healey, and Robert St Amant. “Performance Characteristics of a Camera-Based Tangible Input Device for Manipulation of 3D Information.” Proceedings of the 43rd Graphics Interface Conference. Canadian Human-Computer Communications Society, 2017. [paper][Bibtex]


The average refresh rate is 63 fps with a single model(updated 10/17/2016).

Applications: facilitating AR game development or serving as a joystick-like controller.


Basic Performances. Our device works well with noisy surroundings and is invariant to changes of lighting environment.


Virtual Object Viewer: the 3D objects are projected inside the cube so that the users manipulate the virtual objects

in the same way as they interact with a physical object. A Fish Tank VR version is under development!