wIzQubesTM-a novel tangible interface for interactive storytelling in mixed reality

Abstract

In this paper, we present a novel tangible interface, wIzQubesTM, for interactive storytelling in Mixed Reality. A pair of cubes tracked by computer vision is used to control the storytelling process. The first cube is used to navigate through different scenes of the story, with the numbers printed on fiducial markers pasted on the six sides. The second cube is used to choose different items needed in the story, with the cartoon symbols on the six sides. Bringing two cubes close to each other with right items selected advances the story. wIzQubesTM embeds the concept of both Mixed Reality and Tangible Interaction. Multiple modalities including speech, 3D audio, 3D graphics and touch are used to provide the kids with multi-sensory experiences in interactive storytelling. Keywords: —Cubes, Mixed reality, Storytelling, Tangible user interface.