This paper proposes a new active learning method named as optimum-pursuing method (OPM) from the viewpoint of optimization theory, which aims to provide an effective tool for solving constrained optimization and reliability-based design optimization (RBDO) problems with low computation cost. It uses the cheap Kriging metamodel to replace the expensive physical response. The novelty of the proposed OPM primarily lies in two aspects. First, the OPM utilizes the advantage of the optimization theory rather than sampling technology. By using the augmented Lagrangian approach, it comprehensively considers the objective, constraints, and their relations, thereby automatic identification of important region in the vicinity of the optimum. Second, the accordingly optimum-pursuing function consists of three parts: Kriging mean, Kriging standard deviation, and merit function. Also, the target reliability surface is further considered to enhance the local accuracy of the reliability analysis. The performance of OPM is tested for both deterministic optimization and problems, in which two mathematical and three real-world engineering examples are selected to showcase the feasibility and validity. The results demonstrate that OPM is promising for solving both deterministic optimization and RBDO problems by comparing with the well-known active learning methods.

Multi-objective Stochastic Linear bandit (MOSLB) plays a critical role in the sequential decision-making paradigm, however, most existing methods focus on the Pareto dominance among different objectives without considering any priority. In this paper, we study bandit algorithms under mixed Pareto-lexicographic orders, which can reflect decision makers’ preferences. We adopt the Grossone approach to deal with these orders and develop the notion of Pareto-lexicographic optimality to evaluate the learners’ performance. Our work represents a first attempt to address these important and realistic orders in bandit algorithms. To design algorithms under these orders, the upper confidence bound (UCB) policy and the prior free lexicographical filter are adapted to approximate the optimal arms at each round. Moreover, the framework of the algorithms involves two stages in pursuit of the balance between exploration and exploitation. Theoretical analysis as well as numerical experiments demonstrate the effectiveness of our algorithms.

Data-driven modeling in mechanics is evolving rapidly based on recent machine learning advances, especially on artificial neural networks. As the field matures, new data and models created by different groups become available, opening possibilities for cooperative modeling. However, artificial neural networks suffer from catastrophic forgetting, i.e. they forget how to perform an old task when trained on a new one. This hinders cooperation because adapting an existing model for a new task affects the performance on a previous task trained by someone else. The authors developed a continual learning method that addresses this issue, applying it here for the first time to solid mechanics. In particular, the method is applied to recurrent neural networks to predict history-dependent plasticity behavior, although it can be used on any other architecture (feedforward, convolutional, etc.) and to predict other phenomena. This work intends to spawn future developments on continual learning that will foster cooperative strategies among the mechanics community to solve increasingly challenging problems. We show that the chosen continual learning strategy can sequentially learn several constitutive laws without forgetting them, using less data to achieve the same error as standard (non-cooperative) training of one law per model.

In this paper, a variable-fidelity constrained lower confidence bound (VF-CLCB) criterion is presented for computationally expensive constrained optimization problems (COPs) with two levels of fidelity. In VF-CLCB, the hierarchical Kriging model is adopted to model the objective and inequality constraints. Two infill sampling functions are developed based on the objective and the constraints, respectively, and an adaptive selection strategy is set to select the elite sample points. Moreover, based on the VF-CLCB criterion, a parallel optimization method noted as PVF-CLCB is subsequently developed to accelerate the optimization process. In PVF-CLCB, a VF influence function is defined to approximately evaluate the estimation error of the hierarchical Kriging models, based on which multiple promising points can be determined at each iteration. In addition, an allocation strategy is proposed to distribute the computation resources between the objective- and constraint-oriented functions properly. Lastly, the proposed VF-CLCB and PVF-CLCB approaches are compared with the alternative methods on 12 benchmark numerical cases, and their significant superiority in solving computationally expensive COPs is verified. Furthermore, the proposed methods are employed to optimize the global stability of the stiffened cylindrical shell, and the optimum structure is yielded.