Serious Gaming in Augmented Reality using HMDs for Assessment of Upper Extremity Motor Dysfunctions

Abstract

For a better understanding of how different disorders affect motor function, a uniform, standardized and objective evaluation is a desirable goal for the clinical community. We explore the potential of Augmented Reality (AR) combined with serious gaming and free hand tracking to facilitate objective, cost-effective and patient-friendly methods for evaluation of upper extremity motor dysfunction in different patient groups. In this paper, we describe the design process of the game and the system architecture of the AR framework to meet these requirements. Furthermore, we report our findings from two pilot studies we conducted with healthy people aged over 50. First, we present a usability study (n = 5) on three different modalities of visual feedback for natural hand interaction with AR objects (i. e., no augmented hand, partial augmented hand and a full augmented hand model). The results show that a virtual representation of the fingertips or hand improves the usability of natural hand interaction. Secondly, a study about game engagement is presented. The results of this experiment (n = 8) show that there might be potential for engagement, but usability needs to be improved before it can emerge.