Hyperparameter Tuning for Artificial Neural Network Pre­ dicting Concrete Compressive Strength

More Info
expand_more

Abstract

Concrete compressive strength is the most frequently used and most important mechanical propertyof concrete. National and international building codes (such as the Eurocode) frequently use the com­pressive strength for design with concrete.

In some cases, instead of testing the concrete specimens under compressive loading in laboratories, predicting the compressive strength using machine learning predictions could be a good alternative. The ingredients making up the concrete mix and the curing age can be used as predictors for the com­pressive strenght.

Artificial Neural Networks (ANNs) are machine learning algorithms that have been used since the nine­teen sixties and were inspired by the way neurons work in the brain. Previous researches suggest that ANNs have great potential to predict concrete compressive strength.

In this research, an Artificial Neural Network was set up using the Keras framework and was trained with concrete composition data consisting of examples of concrete recipes and their respective con­crete compressive strenghts. Then, three hyperparameter optimization methods (for loop, grid search and Bayesian optimization) were implemented in several runs. The resulting hyperparameters were used to create ANNs. Afterwards, the three methods were compared with respect to several met­ rics (R­squared score, root mean square error and running time) to see which one is the relatively best method to provide hyperparameters for the predefined ANN that learns from concrete composition data.

The best runs of the three hyperparameter optimization methods show similar goodness­of­fit (with negligible difference). Among these best runs, grid search has the shortest running time. Bayesian optimization provides the highest R­squared score, and has root mean square error of 4.45 [MPa] and a reasonable running time of 73 minutes. Therefore, Bayesian optimization is considered the preferable hyperparameter optimization algorithm for the concrete compressive data used as goodness­of­fit is in most cases to be considered the decisive metric for this application. Further research trying runs with larger parameter grids and spaces, or using other tuning methods could result in even better goodness­ of­fit results.

Files

BEP_Seuntjens_20210624.pdf
(pdf | 1.04 Mb)
Unknown license