PUBLICATION
Hasti: Haptic and Audio Synthesis for Texture Interactions
The IEEE World Haptics Conference (IEEE WHC)
July 6, 2021
By: Sonny Chan, Chase Tymms, Nicholas Colonnese
Abstract
Multi-sensory stimuli can greatly enhance immersion in interactive virtual environments. Advances in graphics algorithms and technologies like VR displays have pushed the appearance of interactive virtual worlds to unprecedented fidelity, but rendering sound and, especially, touch feedback of comparable quality remains a challenge. We describe a method for real-time synthesis of vibrotactile haptic and audio stimuli for interactions with textured surfaces in 3-D virtual environments. Standard descriptions of object geometry and material properties, including displacement and roughness texture maps typically used for physically-based visual rendering, are employed to generate realistic sound and touch feedback consistent with appearance. Our method reconstructs meso-and microscopic surface features on the fly along a contact trajectory, and runs a micro-contact dynamics simulation whose outputs drive vibrotactile haptic actuators and modal sound synthesis. An exploratory, absolute identification user study was conducted as an initial evaluation of our synthesis methods.
Download Paper
Areas
AR/VR
Share
Related Publications
SIGGRAPH - August 2, 2021
Fast Diffraction Pathfinding for Dynamic Sound Propagation
Carl Schissler, Gregor Mückl, Paul Calamia
ISMAR - July 29, 2021
Instant Visual Odometry Initialization for Mobile AR
Alejo Concha, Michael Burri, Jesus Briales, Christian Forster, Luc Oth
ICSA - November 6, 2019
Auralization systems for simulation of augmented reality experiences in virtual environments
Peter Dodds, Sebastià V. Amengual Garí, W. Owen Brimijoin, Philip W. Robinson
Journal of the Audio Engineering Society - July 20, 2021
Six-Degrees-of-Freedom Parametric Spatial Audio Based on One Monaural Room Impulse Response
Johannes M. Arend, Sebastià V. Amengual Garí, Carl Schissler, Florian Klein, Philip W. Robinson
All Publications
Additional Resources
Videos
Downloads & Projects
Visiting Researchers & Postdocs
Visit Our Other Blogs
Engineering
Facebook AI
Oculus
Tech@
RSS Feed
About
Careers
Privacy
Cookies
Terms
Help
Facebook © 2021
To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy