From industrial exoskeletons to implantable medical devices, robots that interact closely with people are poised to improve every aspect of our lives. Yet designing these systems is very challenging; humans are incredibly complex and, in many cases, we respond to robotic devices in ways that cannot be modelled or predicted with sufficient accuracy. A new approach, human-in-the-loop optimization, can overcome these challenges by systematically and empirically identifying the device characteristics that result in the best objective performance for a specific user and application. This approach has enabled substantial improvements in human-robot performance in research settings and has the potential to speed development and enhance products. In this Perspective, we describe methods for applying human-in-the-loop optimization to new human-robot interaction problems, addressing each key decision in a variety of contexts. We also identify opportunities to develop new optimization techniques and answer underlying scientific questions. We anticipate that our readers will advance human-in-the-loop optimization and use it to design robotic devices that truly enhance the human experience.

@en

Exoskeletons that assist in ankle plantarflexion can improve energy economy in locomotion. Characterizing the joint-level mechanisms behind these reductions in energy cost can lead to a better understanding of how people interact with these devices, as well as to improved device design and training protocols. We examined the biomechanical responses to exoskeleton assistance in exoskeleton users trained with a lengthened protocol. Kinematics at unassisted joints were generally unchanged by assistance, which has been observed in other ankle exoskeleton studies. Peak plantarflexion angle increased with plantarflexion assistance, which led to increased total and biological mechanical power despite decreases in biological joint torque and whole-body net metabolic energy cost. Ankle plantarflexor activity also decreased with assistance. Muscles that act about unassisted joints also increased activity for large levels of assistance, and this response should be investigated over long-term use to prevent overuse injuries.

@en

Human prion diseases are rare, transmissible and often rapidly progressive dementias. The most common type, sporadic Creutzfeldt-Jakob disease (sCJD), is highly variable in clinical duration and age at onset. Genetic determinants of late onset or slower progression might suggest new targets for research and therapeutics. We assembled and array genotyped sCJD cases diagnosed in life or at autopsy. Clinical duration (median:4, interquartile range (IQR):2.5–9 (months)) was available in 3,773 and age at onset (median:67, IQR:61–73 (years)) in 3,767 cases. Phenotypes were successfully transformed to approximate normal distributions allowing genome-wide analysis without statistical inflation. 53 SNPs achieved genome-wide significance for the clinical duration phenotype; all of which were located at chromosome 20 (top SNP rs1799990, pvalue = 3.45x10-36, beta = 0.34 for an additive model; rs1799990, pvalue = 9.92x10-67, beta = 0.84 for a heterozygous model). Fine mapping, conditional and expression analysis suggests that the well-known non-synonymous variant at codon 129 is the obvious outstanding genome-wide determinant of clinical duration. Pathway analysis and suggestive loci are described. No genome-wide significant SNP determinants of age at onset were found, but the HS6ST3 gene was significant (pvalue = 1.93 x 10−6) in a gene-based test. We found no evidence of genome-wide genetic correlation between case-control (disease risk factors) and case-only (determinants of phenotypes) studies. Relative to other common genetic variants, PRNP codon 129 is by far the outstanding modifier of CJD survival suggesting only modest or rare variant effects at other genetic loci.@en

Our nervous systems can learn optimal control policies in response to changes to our bodies, tasks, and movement contexts. For example, humans can learn to adapt their control policy in walking contexts where the energy-optimal policy is shifted along variables such as step frequency or step width. However, it is unclear how the nervous system determines which ways to adapt its control policy. Here, we asked how human participants explore through variations in their control policy to identify more optimal policies in new contexts. We created new contexts using exoskeletons that apply assistive torques to each ankle at each walking step. We analyzed four variables that spanned the levels of the whole movement, the joint, and the muscle: step frequency, ankle angle range, total soleus activity, and total medial gastrocnemius activity. We found that, across all of these analyzed variables, variability increased upon initial exposure to new contexts and then decreased with experience. This led to adaptive changes in the magnitude of specific variables, and these changes were correlated with reduced energetic cost. The timescales by which adaptive changes progressed and variability decreased were faster for some variables than others, suggesting a reduced search space within which the nervous system continues to optimize its policy. These collective findings support the principle that exploration through general variability leads to specific adaptation toward optimal movement policies.@en

Exoskeletons can enhance human mobility, but we still know little about why they are effective. For example, we do not know the relative importance of training, how much is required, or what type is most effective; how people adapt with the device; or the relative benefits of customizing assistance. We conducted experiments in which naïve users learned to walk with ankle exoskeletons under one of three training regimens characterized by different levels of variation in device behavior. Assistance was also customized for one group. After moderate-variation training, the benefits of customized assistance were large; metabolic rate was reduced by 39% compared with walking with the exoskeleton turned off. Training contributed about half of this benefit and customization about one-quarter; a generic controller reduced energy cost by 10% before training and 31% afterward. Training required much more exposure than typical of exoskeleton studies, about 109 minutes of assisted walking. Type of training also had a strong effect; the low-variation group required twice as long as the moderate-variation group to become expert, and the high-variation group never acquired this level of expertise. Curiously, all users adapted in a way that resulted in less mechanical power from the exoskeleton as they gained expertise. Customizing assistance required less time than training for all parameters except peak torque magnitude, which grew slowly over the study, suggesting a longer time scale adaptation in the person. These results underscore the importance of training to the benefits of exoskeleton assistance and suggest the topic deserves more attention.

@en

Lower-limb exoskeletons could improve the mobility of people with disabilities, older adults, workers, first responders, and military personnel. Despite recent advances, few products are commercially available and exoskeleton research is still often limited by hardware constraints. Many promising multi-joint assistance strategies, especially those with high-torque and high-power components, have yet to be tested because they are beyond the capabilities of current devices. To study these untested assistance strategies, we present a hip–knee–ankle exoskeleton emulator that can apply high torques and powers that match or exceed those observed in uphill running. The system has powerful off-board motors that actuate a 13.5 kg exoskeleton end effector worn by the user. It can apply up to 200 Nm of torque in hip flexion, hip extension, and ankle plantarflexion, 250 Nm of torque in knee extension, and 140 Nm of torque in knee flexion, with over 4.5 kW of power at each joint and a closed-loop torque bandwidth of at least 18 Hz in each direction of actuation. The exoskeleton is compliant in unactuated directions, adjustable for a wide range of users and comfortable during walking and running. When paired with human-in-the-loop optimization, we expect that this system will identify new assistance strategies to improve human mobility. A complete computer-aided design (CAD) model of the exoskeleton and a bill of materials are included and available for download.

@en