As the entertainment industry buzzes with the launch of next-gen immersive technologies such as the Apple Vision Pro and the recently announced Meta Quest Pro 2, attention is now turning towards how extended reality can be enhanced through haptic technologies. These technologies allow users to experience physical stimuli alongside virtual experiences, opening up new possibilities for realism in immersive environments.
Philippe Guillotel, senior director of metavideo group at InterDigital, explains that haptic technologies can amplify connected experiences beyond the current limitations of screens and devices. Whether it's through in-built haptic feedback within VR headsets and controllers or accompanying devices that allow for new tactile sensations, greater connectivity and emerging immersive technologies can support and enhance these experiences.
Currently, haptic technology's use within XR is primarily centered around vibrotactile feedback, predominantly through controllers that vibrate as the user interacts with the virtual environment. Gaming is perhaps the most well-known application of haptics, from the rumbling vibrations of a controller as a character runs to cutting-edge bodywear that reacts to virtual stimulation in first-person shooters.
Beyond gaming, experiments are underway to determine how haptics can enhance immersion in both live and virtual environments, such as sporting and esports events. With the upcoming 2024 Olympics and UEFA 2024 Euro Championships coinciding with a boom in popularity of live sports and esports among streaming audiences worldwide, the prospect of haptic-enhanced video adds a new depth of sensation that will help audiences feel more connected than ever before.
Major breakthroughs are being made by organizations like the Japan Broadcasting Corporation NHK, which is creating specialist equipment to enhance the viewing of live sports. These innovations range from handheld devices that react to an athlete's motions to chairs that respond to actions such as throws, tackles, and physical contact, like the Razer Esther gaming seat cushion and Razer HyperSense headphone.
To ensure that XR experiences are properly enhanced with the addition of new haptic technologies, it is essential to recognize the importance of the Quality of Personal Experience. QoPE should not be determined by the haptic devices themselves but should be enhanced by their addition and adapted to each user. A robust wireless network performance that supports XR experiences is key, as mobile VR environments require high-speed, low-latency communications. If the internet is to transmit tactile sensations in real-time through streamed media, latency cannot exceed one millisecond to avoid dissociation between sensations and visual stimuli by the human neurological system.
The visual constraints of the current generation of haptic hardware also need to be considered. Many devices are currently heavy, bulky, or restrict user movement, detracting from the experience haptic tech is trying to achieve by making it less natural and lifelike. These limitations hinder interoperability between different devices and reduce immersion.
For haptic technology advancements to truly take root within the VR space, adherence to standards and protocols will be integral. Innovations in immersive video codecs and advancements in haptics research are empowering a new dimension of interactive and sensory-enhanced communications, services, and experiences. The MPEG immersive video (MIV) standard allows for the compression of immersive video, enabling enhanced interoperability and quality of experience across various devices and different immersive experiences while achieving sustainable data rates for seamless streaming.
Haptic technologies have the potential to revolutionize how we experience virtual worlds, entertain ourselves, and even work. While it may take some time before affordable and deployable suites of haptic tech are available for users to enjoy at home or in business environments, strides are being made constantly, and recent announcements show that it is on the horizon. With 5G and 6G as key enablers of XR experiences through immersive media codecs, the next generation of immersion is within reach, thanks to the crucial technologies and standards being developed today.
