Design protocol analysis is a technique to understand designers’ cognitive processes by analyzing sequences of observations on their behavior. These observations typically use audio, video, and transcript data in order to gain insights into the designer's behavior and the design process. The recent availability of sophisticated sensing technology has made such data highly multimodal, requiring more flexible protocol analysis tools. To address this need, we present VizScribe, a visual analytics framework that employs multiple coordinated multiple views that enable the viewing of such data from different perspectives. VizScribe allows designers to create, customize, and extend interactive visualizations for design protocol data such as video, transcripts, sketches, sensor data, and user logs. User studies where design researchers used VizScribe for protocol analysis indicated that the linked views and interactive navigation offered by VizScribe afforded the researchers multiple, useful ways to approach and interpret such multimodal data.@en

Despite its grounding in creativity techniques, merging multiple source sketches to create new ideas has received scant attention in design literature. In this paper, we identify the physical operations that in merging sketch components. We also introduce cognitive operations of reuse, repurpose, refactor, and reinterpret, and explore their relevance to creative design. To examine the relationship of cognitive operations, physical techniques, and creative sketch outcomes, we conducted a qualitative user study where student designers merged existing sketches to generate either an alternative design, or an unrelated new design. We compared two digital selection techniques: freeform selection, and a stroke-cluster-based "object select" technique. The resulting merge sketches were subjected to crowdsourced evaluation of these sketches, and manual coding for the use of cognitive operations. Our findings establish a firm connection between the proposed cognitive operations and the context and outcome of creative tasks. Key findings indicate that reinterpret cognitive operations correlate strongly with creativity in merged sketches, while reuse operations correlate negatively with creativity. Furthermore, freeform selection techniques are preferred significantly by designers. We discuss the empirical contributions of understanding the use of cognitive operations during design exploration, and the practical implications for designing interfaces in digital tools that facilitate creativity in merging sketches.@en

In this study, sixteen Engineering students were assigned to small groups (n=4) to work collaboratively on engineering design tasks. Using wearable sociometric devices, we collected real-time non-linguistic speech data on team interaction including turn-taking, successful interrupts and overlaps. Results from 2-stage regression models indicate that speech and conversational dynamics such as turn-taking and successful interrupts are significant in predicting the perceived collaboration quality and creative fluency of design teams.@en

We use sociometric trace data to create an index of dynamic group flow in collaborative design teams. Sixteen students in four teams worked on a collaborative engineering design task, while wearing sociometric devices to collect real-time data on team interaction. Results indicate that group flow as measured by dynamic trace data is partially correlated with self-reported flow. This finding implies the potential to use trace data to provide reliable and dynamic measures of task engagement during collaborative learning.@en