Abstract :-

To illuminate the alignment between mixed reality juggling toys and ambidextrous vactors twirling a projection of those toys, roomware lighting control is deployed to show the modeled position of a virtual camera spinning around each player, even while the affordances are whirled. “Tworlds” is a mixed reality multimodal toy using twirled juggling-style affordances built using mobile devices— smartphones, phablets, & tablets— to modulate various displays, including 3D models and, now, environmental lighting. A unique feature of the projection is the preservation of logical alignment even when the virtual camera moves continuously around an avatar between frontal and dorsal views in an “inspection gesture,” phase-locked rotation and revolution (like the face of the moon pointing at the Earth). For example, a right-handed user would prefer to see their self-identified puppet holding an affordance in the right hand for dorsal (tethered) views, but would rather see the puppet switch hands for a frontal (mirrored) perspective. Because the projected phase of the toy must be modulated in order to preserve such visual correspondence, even while the prop is being whirled, and to elucidate the inspection gesture, we use networked lighting (Philips Hue Wi-Fi networked bulbs) to indicate the position of the virtual camera. Even though a toy might be twirled too fast for such lights to track in the real world, so that only computer graphic “eye candy” effects are practical, the speed of the orbiting of the virtual camera can be adjusted to accommodate even sluggish lighting switching.