In his groundbreaking doctoral thesis, André Zenner, a computer scientist based in Saarbrücken, Germany, has taken a significant step towards answering the question of how virtual reality can be experienced haptically, or through the sense of touch. Zenner's research, which was conducted at the Saarbrücken Graduate School of Computer Science at Saarland University, focuses on the use of physical props, or "proxies," to make objects in virtual environments tangible.
Zenner's work acknowledges that having a proxy for every virtual object is not scalable, so he set out to develop devices that could simulate the physical properties of multiple virtual objects effectively. This led to the creation of two special VR controller prototypes: "Shifty" and "Drag:on."
"Shifty" is a tubular controller that features a movable weight installed inside. The weight can be moved along the lengthwise axis by a motor, altering the center of gravity and inertia of the rod. When combined with corresponding visualizations in VR, "Shifty" can create the illusion that a virtual object is getting longer or heavier. Zenner's experiments demonstrated that objects are perceived as lighter or smaller when the weight is close to the user's hand, and when coupled with the appropriate visual input, they are perceived as longer and heavier as the weight moves further away from the user.
Zenner explains that these perceptual changes are primarily due to variations in the controller's inertia, rather than changes in overall weight. The research and development department at gaming giant Sony has already begun experimenting with this concept, citing Zenner's work in the development of new VR controllers.
The second controller, "Drag:on," consists of two flamenco fans that can be unfolded using servomotors, increasing the air resistance of the controller. As the fans unfold, the user must exert more force to move the controller through the air. When paired with the appropriate visual stimuli, "Drag:on" can create the impression that the user is holding various objects, such as a small shovel, a large paddle, or even pushing a heavy trolley or twisting a difficult-to-turn knob.
Both "Shifty" and "Drag:on" are the result of basic research and are considered "proof of concepts." While specific products using this technology are not yet available on the market, Zenner's prototypes have demonstrated through user experiments that different controller states can enhance the perception of various VR objects.
Zenner's award-winning work, which he completed at the Saarbrücken Graduate School of Computer Science at Saarland University, has garnered significant attention in the VR research community. He now conducts research at Saarland University and the German Research Center for Artificial Intelligence, continuing to push the boundaries of haptic experiences in virtual reality.
