For decades, grain boundary engineering has proven to be one of the most effective approaches for tailoring the mechanical properties of metallic materials, although there are limits to the fineness and types of microstructures achievable, due to the rapid increase in grain size once being exposed to thermal loads (low thermal stability of crystallographic boundaries). Here, we deploy a unique chemical boundary engineering (CBE) approach, augmenting the variety in available alloy design strategies, which enables us to create a material with an ultrafine hierarchically heterogeneous microstructure even after heating to high temperatures. When applied to plain steels with carbon content of only up to 0.2 weight %, this approach yields ultimate strength levels beyond 2.0 GPa in combination with good ductility (>20%). Although demonstrated here for plain carbon steels, the CBE design approach is, in principle, applicable also to other alloys.