While consciousness has been historically a heavily debated topic, awareness had less success in raising the interest of scholars. However, more and more researchers are getting interested in answering questions concerning what awareness is and how it can be artificially generated. The landscape is rapidly evolving, with multiple voices and interpretations of the concept being conceived and techniques being developed. The goal of this paper is to summarize and discuss the ones among these voices connected with projects funded by the EIC Pathfinder Challenge “Awareness Inside” callwithin Horizon Europe, designed specifically for fostering research on natural and synthetic awareness. In this perspective, we dedicate special attention to challenges and promises of applying synthetic awareness in robotics, as the development of mature techniques in this new field is expected to have a special impact on generating more capable and trustworthy embodied systems.

@en

Stepping strategy, including step time and step location modulation, and hip strategy, i.e., upper-body movement, play crucial roles in achieving robust humanoid locomotion. However, exploiting these balance strategies in a unified and flexible manner has not been well addressed. In this article, we propose a sequential convex optimization approach. Based on the linear inverted pendulum model, we modulate step parameters, including step location and step time, using quadratically constrained quadratic programming in real time. Then, based on the nonlinear inverted pendulum plus flywheel model, we regulate angular momentum using the linear model predictive control. To accommodate for scenarios with height variation, we consider nonlinear 3-D locomotion dynamics explicitly. The proposed approach is validated via comparison studies and extensive experiments on the humanoid with planar and linear feet. The results demonstrate enhanced robustness against dynamic disturbances and adaptability to real-world scenarios. On average, the enhanced stepping strategy rejects 135% larger external forces than our previous article. Also, robust locomotion across height-varying stepping stones is realized, which is rarely reported for a humanoid robot with planar feet.

@en

Soft continuum manipulators are celebrated for their versatility and physical robustness to external forces and perturbations. However, this feature comes at a cost. The many degrees of freedom and compliance pose challenges for accurate pose reconstruction, both in terms of distributed sensing and pose reconstruction algorithms. Moreover, soft arms are inherently susceptible to deformation from external forces or loads, meaning that closed-loop control is essential for robust task performance. In this article, we propose the integration of multiple Inertial Measurement Units (IMUs) of a soft robot arm, Helix, for reconstruction of pose under internal and external forces. Furthermore, we integrate this dynamic pose reconstruction for kinematic-based closed-loop control strategies. By serially integrating sensing in the body of the Helix soft manipulator, we provide the system with high-frequency pose reconstruction and demonstrate improvements in end effector position with comparison to open-loop performance.

@en

While much work has been done recently in the realm of model-based control of soft robots and soft-rigid hybrids, most works examine robots that have an inherently serial structure. While these systems have been prevalent in the literature, there is an increasing trend toward designing soft-rigid hybrids with intrinsically coupled elasticity between various degrees of freedom. In this work, we seek to address the issues of modeling and controlling such structures, particularly when underactuated. We introduce several simple models for elastic coupling, typical of those seen in these systems. We then propose a controller that compensates for the elasticity, and we prove its stability with Lyapunov methods without relying on the elastic dominance assumption. This controller is applicable to the general class of underactuated soft robots. After evaluating the controller in simulated cases, we then develop a simple hardware platform to evaluate both the models and the controller. Finally, using the hardware, we demonstrate a novel use case for underactuated, elastically coupled systems in "sensorless"force control.

@en

Imitation learning (IL) facilitates intuitive robotic programming. However, ensuring the reliability of learned behaviors remains a challenge. In the context of reaching motions, a robot should consistently reach its goal, regardless of its initial conditions. To meet this requirement, IL methods often employ specialized function approximators that guarantee this property by construction. Although effective, these approaches come with some limitations: 1) they are typically restricted in the range of motions they can model, resulting in suboptimal IL capabilities, and 2) they require explicit extensions to account for the geometry of motions that consider orientations. To address these challenges, we introduce a novel stability loss function that does not constrain the function approximator's architecture and enables learning policies that yield accurate results. Furthermore, it is not restricted to a specific state space geometry; therefore, it can easily incorporate the geometry of the robot's state space. Proof of the stability properties induced by this loss is provided and the method is empirically validated in various settings. These settings include Euclidean and non-Euclidean state spaces, as well as first-order and second-order motions, both in simulation and with real robots. More details about the experimental results can be found at https://youtu.be/ZWKLGntCI6w.

@en

Adopting compliant structures holds the potential to enhance the robustness and interaction capabilities of the next generation of bionic limbs. Although researchers have proficiently explored this approach in the design of artificial hands, they devoted little attention to the development of more proximal joints. This work presents a compliant prosthetic elbow prototype called BICEP. The design incorporates compliant cross-axis flexural pivots that connect the upper and lower arm without direct contact between the two links. The actuation architecture, inspired by biological mechanisms, employs one actuator and two tendons to create an agonist-antagonist mechanism. This joint enables rotation along its flexion-extension axis while maintaining flexibility in out-of-plane directions, in a system with an overall weight of 351 g. A preliminary evaluation showcases lifting capacities supporting up to 2500 g, and a maximum speed of 157^∘ per second across a 135^∘ range of motion. The soft cross-axis flexural pivots exhibit compliant behavior in both the sagittal and transversal planes, enabling a pleasant interaction with the environment and ensuring safe absorption of unintentional impacts.

@en

Parallel robots based on Handed Shearing Auxetics (HSAs) can implement complex motions using standard electric motors while maintaining the complete softness of the structure, thanks to specifically designed architected metamaterials. However, their control is especially challenging due to varying and coupled stiffness, shearing, non-affine terms in the actuation model, and underactuation. In this paper, we present a model-based control strategy for planar HSA robots enabling regulation in task space. We formulate equations of motion, show that they admit a collocated form, and design a P-satI-D feedback controller with compensation for elastic and gravitational forces. We experimentally identify and verify the proposed control strategy in closed loop.@en

Soft robots enable safe and robust operations in unstructured environments. However, the nonlinearities of their continuum structure complicate the accomplishment of classic robotic tasks, such as pick and place. In this work, we propose the R-Soft Inverted Pendulum, a Soft Inverted Pendulum (SIP) actuated only by a revolute joint at the base. The objective is to exploit the snap effect to execute pick and place task. We model the proposed system with two approaches: Curvature Parametrization and Strain Parametrization. The former is particularly simple and easy to implement in the classic dynamics of a rigid manipulator, although it suffers from numerical issues. The latter is more complex but guarantees numerical robustness. Additionally, we analyze the equilibria of the system and its structural properties. Furthermore, we propose a control law based on feedback linearization. Finally, we validate the proposed system through simulations.

@en

A central challenge in Learning from Demonstration is to generate representations that are adaptable and can generalize to unseen situations. This work proposes to learn such a representation without using task-specific heuristics within the context of multi-reference frame skill learning by superimposing local skills in the global frame. Local policies are first learned by fitting the relative skills with respect to each frame using Gaussian Processes (GPs). Then, another GP, which determines the relevance of each frame for every time step, is trained in a self-supervised manner from a different batch of demonstrations. The uncertainty quantification capability of GPs is exploited to stabilize the local policies and to train the frame relevance in a fully Bayesian way. We validate the method through a dataset of multi-frame tasks generated in simulation and on real-world experiments with a robotic manipulation pick-and-place re-shelving task.We evaluate the performance of our method with two metrics: how close the generated trajectories get to each of the task goals and the deviation between these trajectories and test expert trajectories. According to both of these metrics, the proposed method consistently outperforms the state-of-the-art baseline, Task-Parameterised Gaussian Mixture Model (TPGMM).

@en

Introducing parallel elasticity in the hardware design endows quadrupedal robots with the ability to perform explosive and efficient motions. However, for this kind of articulated soft quadruped, realizing dynamic jumping with robustness against system uncertainties remains a challenging problem. To achieve this, we propose an impact-aware jumping planning and control approach. Specifically, an offline kino-dynamic-type trajectory optimizer is first formulated to achieve compliant 3D jumping motions, using a novel actuated spring-loaded inverted pendulum (SLIP) model. Then, an optimization-based online landing strategy, including pre-impact leg motion modulation and post-impact landing recovery, is designed. The actuated SLIP model, with the capability of explicitly characterizing parallel elasticity, captures the jumping and landing dynamics, making the problem of motion generation/regulation more tractable. Finally, a hybrid torque control consisting of a feedback tracking loop and a feedforward compensation loop is employed for motion control. Experiments demonstrate the ability to accomplish robust 3D jumping motions with stable landing and recovery. Besides, our approach can be applied to quadrupedal robots with or without additional parallel compliance.

@en

This work concerns the application of physics-informed neural networks to the modeling and control of complex robotic systems. Achieving this goal requires extending physics-informed neural networks to handle nonconservative effects. These learned models are proposed to combine with model-based controllers originally developed with first-principle models in mind. By combining standard and new techniques, precise control performance can be achieved while proving theoretical stability bounds. These validations include real-world experiments of motion prediction with a soft robot and trajectory tracking with a Franka Emika Panda manipulator.

@en

This letter concerns control-oriented and structure-preserving learning of low-dimensional approximations of high-dimensional physical systems, with a focus on mechanical systems. We investigate the integration of neural autoencoders in model order reduction, while at the same time preserving Hamiltonian or Lagrangian structures. We focus on extensively evaluating the considered methodology by performing simulation and control experiments on large mass-spring-damper networks, with hundreds of states. The empirical findings reveal that compressed latent dynamics with less than 5 degrees of freedom can accurately reconstruct the original systems' transient and steady-state behavior with a relative total error of around 4%, while simultaneously accurately reconstructing the total energy. Leveraging this system compression technique, we introduce a model-based controller that exploits the mathematical structure of the compressed model to regulate the configuration of heavily underactuated mechanical systems.

@en

Continuum soft robots are nonlinear mechanical systems with theoretically infinite degrees of freedom (DoFs) that exhibit complex behaviors. Achieving motor intelligence under dynamic conditions necessitates the development of control-oriented reduced-order models (ROMs), which employ as few DoFs as possible while still accurately capturing the core characteristics of the theoretically infinite-dimensional dynamics. However, there is no quantitative way to measure if the ROM of a soft robot has succeeded in this task. In other fields, like structural dynamics or flexible link robotics, linear normal modes are routinely used to this end. Yet, this theory is not applicable to soft robots due to their nonlinearities. In this work, we propose to use the recent nonlinear extension in modal theory -called eigenmanifolds- as a means to evaluate control-oriented models for soft robots and compare them. To achieve this, we propose three similarity metrics relying on the projection of the nonlinear modes of the system into a task space of interest. We use this approach to compare quantitatively, for the first time, ROMs of increasing order generated under the piecewise constant curvature (PCC) hypothesis with a high-dimensional finite element (FE)-like model of a soft arm. Results show that by increasing the order of the discretization, the eigenmanifolds of the PCC model converge to those of the FE model.

@en

Model-based strategies are a promising solution to the grand challenge of equipping continuum soft robots with motor intelligence. However, finite-dimensional models of these systems are inherently inaccurate, thus posing pressing robustness concerns. Moreover, the actuation space of soft robots is usually limited. This article aims at solving both these challenges by proposing a robust model-based strategy for the shape control of soft robots with system uncertainty and input saturation. The proposed architecture is composed of two key components. First, we propose an observer that estimates deviations between the theoretical model and the soft robot, ensuring that the estimation error converges to zero within finite time. Second, we introduce a sliding mode controller to regulate the soft robot shape while fulfilling saturation constraints. This controller uses the observer's output to compensate for the deviations between the real system and the established model. We prove the convergence of the closed-loop with theoretical analysis and the method's effectiveness with simulations and experiments.@en

Suitable representations of dynamical systems can simplify their analysis and control. On this line of thought, this article aims to answer the following question: Can a transformation of the generalized coordinates under which the actuators directly perform work on a subset of the configuration variables be found? We not only show that the answer to this question is yes but also provide necessary and sufficient conditions. More specifically, we look for a representation of the configuration space such that the right-hand side of the dynamics in Euler-Lagrange form becomes [\boldsymbol{I}\; \boldsymbol{O}]{T}\boldsymbol{u}, being \boldsymbol{u} the system input. We identify a class of systems, called collocated, for which this problem is solvable. Under mild conditions on the input matrix, a simple test is presented to verify whether a system is collocated or not. By exploiting power invariance, we provide necessary and sufficient conditions that a change of coordinates decouples the input channels if and only if the dynamics is collocated. In addition, we use the collocated form to derive novel controllers for damped underactuated mechanical systems. To demonstrate the theoretical findings, we consider several Lagrangian systems with a focus on continuum soft robots.

@en

Controlled execution of dynamic motions in quadrupedal robots, especially those with articulated soft bodies, presents a unique set of challenges that traditional methods struggle to address efficiently. In this study, we tackle these issues by relying on a simple yet effective two-stage learning framework to generate dynamic motions for quadrupedal robots. First, a gradient-free evolution strategy is employed to discover simply represented control policies, eliminating the need for a predefined reference motion. Then, we refine these policies using deep reinforcement learning. Our approach enables the acquisition of complex motions like pronking and back-flipping, effectively from scratch. Additionally, our method simplifies the traditionally labour-intensive task of reward shaping, boosting the efficiency of the learning process. Importantly, our framework proves particularly effective for articulated soft quadrupeds, whose inherent compliance and adaptability make them ideal for dynamic tasks but also introduce unique control challenges.

@en

The compliant nature of soft robots is appealing to a wide range of applications. However, this compliant property also poses several control challenges, e.g., how to deal with infinite degrees of freedom and highly nonlinear behaviors. This paper proposes a hybrid controller for a pneumatic-actuated soft robot. To this end, a model-based feedforward controller is designed and combined with a correction torque calculated via Gaussian process regression. Then, the proposed model-based and hybrid controllers are experimentally validated, and a detailed comparison between controllers is presented. Notably, the experimental results highlight the potential benefits of adding a learning approach to a model-based controller to enhance the closed-loop performance while reducing the computational load exhibited by purely learning strategies.

@en

Creating artificial general intelligence is the solution most often in the spotlight. It is also linked with the possibility—or fear—of machines gaining consciousness. Alternatively, developing domain-specific artificial intelligence is more reliable, energy-efficient, and ethically tractable, and raises mostly a problem of effective coordination between different systems and humans. Herein, it is argued that it will not require machines to be conscious and that simpler ways of sharing awareness are sufficient.

@en

Formulating the dynamics of continuously deformable objects and other mechanical systems analytically from first principles is an exceedingly challenging task, often impractical in real-world scenarios. What makes this challenge even harder to solve is that, usually, the object has not been observed previously, and the only information that we can get from it is a stream of RGB camera data. In this study, we explore the use of deep learning techniques to solve this nonlinear identification problem. We specifically focus on extracting dynamic models of simple deformable objects from the high-dimensional sensor input coming from an RGB camera. We investigate a two-stage approach to achieve this goal. First, we train a variational autoencoder to extract an extremely low-dimensional representation of the object configuration. Then, we learn a dynamic model that predicts the evolution of these latent space variables. The proposed architecture can accurately predict the object's state up to one second into the future.

@en

Integrating Brain-Machine Interfaces into non-clinical applications like robot motion control remains difficult - despite remarkable advancements in clinical settings. Specifically, EEG-based motor imagery systems are still error-prone, posing safety risks when rigid robots operate near humans. This work presents an alternative pathway towards safe and effective operation by combining wearable EEG with physically embodied safety in soft robots. We introduce and test a pipeline that allows a user to move a soft robot's end effector in real time via brain waves that are measured by as few as three EEG channels. A robust motor imagery algorithm interprets the user's intentions to move the position of a virtual attractor to which the end effector is attracted, thanks to a new Cartesian impedance controller. We specifically focus here on planar soft robot-based architected metamaterials, which require the development of a novel control architecture to deal with the peculiar nonlinearities - e.g., non-affinity in control. We preliminarily but quantitatively evaluate the approach on the task of setpoint regulation. We observe that the user reaches the proximity of the setpoint in 66% of steps and that for successful steps, the average response time is 21.5s. We also demonstrate the execution of simple real-world tasks involving interaction with the environment, which would be extremely hard to perform if it were not for the robot's softness.@en