Touching Virtual Shapes: Combining Kinesthetic and Tactile Feedback in a Single Haptic Device

Abstract

Virtual training environments are powerful tools for various applications. To increase the immersion and realism of these environments, several devices have been developed capable of rendering a wide range of haptic sensations. As humans mainly interact with objects using their hands, the main focus of research has been on developing devices capable of providing feedback to the hand and fingers. Currently, most of these devices only provide one form of feedback, either kinesthetic feedback to finger posture or tactile sensations in the form of pressing or skin stretching. These devices seldom provide more than one kind of feedback while remaining compact enough to be wearable with a natural range of motion of the hand. In this work, we present a device that combines an existing kinesthetic feedback glove with a novel tactile fingertip display. The haptic display consists of a cable-driven platform, powered by a stand-alone actuation module. It has been designed to be compact enough for a near-natural range of motion, with the possibility of multi-finger applications in mind. To validate the design, we conducted an experiment with 16 healthy young par- ticipants who were asked to reproduce virtual shapes with their index fingers after exploring those shapes under two different conditions: 1) with purely kinesthetic feedback, and 2) with kinesthetic feedback and tactile feedback. The outcome metrics were the exploration time, reproduction time, and reproduction error. For each testing condition, the workload and motivation of the participants were also evaluated. We found that participants had a lower reproduction error and used more time to reproduce the shapes with the novel haptic display enabled compared to purely kinesthetic feedback. We did not find significant differences in exploration time, workload, or motivation between testing conditions. Thus, the combined feedback provided by our novel device leads to better performance in shape reproduction compared to only kinesthetic feedback. Further, our device is lightweight and compact, potentially enabling multi-finger use which may lead to even greater performance and immersion in virtual object manipulation tasks.