Continual learning (CL) enables intelligent systems to continually acquire, adapt, and apply knowledge, representing a dynamic paradigm in AI. For embodied agents—interacting with their environment physically and cognitively—CL enhances adaptability and reduces training costs significantly. In this literature review, we contribute by focusing on the application of CL in such agents, showcasing the approaches, means of evaluation and practical uses of this cognitive framework in real-world scenarios. We conclude that while CL holds promise for embodied agents, there exists a notable gap between the theoretical evaluation of CL and the complex real-world scenarios these agents operate in.

In the future, autonomous social robots are expected to seamlessly integrate into our society. To be perceived as interactive partners rather than mere tools, these robots must be embodied and capable of navigating complex, dynamic environments. This study explores the critical role of embodiment and examines the application of human-inspired socio-cognitive mechanisms in embodied agents. We conducted a systematic scoping review of 36 publications sourced from Scopus, IEEE Xplore, Web of Science, and PubMed. Our findings reveal a diverse array of human-inspired implementations in embodied agents, including curiosity-driven learning, categorical thinking, and predictive learning. Notably, human-like eye-gaze plays a crucial role in enhancing the anthropomorphism of these agents. By drawing inspiration from human interactions, we can transition from pre-programmed robots to fully autonomous agents that exhibit emergent behaviours and adapt to ever-changing conditions. Embodiment allows agents to communicate their intentions and desires through various modes, facilitating richer interactions. Additionally, multiple studies underscore the importance of using embodied agents to study human behaviours. Furthermore, the choice of embodiment type must depend on the task at hand; for some tasks, virtual embodiment is more effective, while for others, physical embodiment is preferable. This review provides a comprehensive starting point for future researchers interested in developing human-inspired embodied agents.

Virtual agents have demonstrated remarkable progress in both competitive and cooperative en- vironments. Embodied agents, which enhance AI interactions with the physical world, show great promise for a variety of use cases in both virtual and non-virtual settings. This literature review ex- amines the intersection of embodied virtual agents with cognitive and social frameworks derived from human behavior, focusing on open-ended learning and intrinsic motivation. These paradigms, inspired by human learning and adaptability, offer a path to- wards addressing the limitations of current artificial systems. The literature survey provides a thorough analysis of the research landscape, discussing the definitions, applications, and benefits of embodied agents in virtual settings. Furthermore, it evaluates the methods and benchmarks used to assess the ca- pabilities of these agents, while offering possible solutions for developing the next generation of embodied agents.