This study presents a robust contact constitutive model in the distinct element method (DEM) framework for simulating the mechanical behavior of masonry structures. The model is developed within the block-based modeling strategy, where the masonry unit is modeled as deformable blocks with potential crack surfaces in the middle of the bricks, while the mortar joints are defined as zero-thickness interfaces. The modeling strategy implements multi-surface plasticity with damage mechanics, including a tension cut-off, Coulomb failure criterion, and an elliptical compressive cap for the damage in tension, shear, and compression, respectively. Two new features are introduced in this contact model: a piecewise linear softening function for strength degradation in tension and shear and a hardening/softening function to phenomenologically define the compressive damage of masonry composite into the unit-mortar interface. The constitutive model is implemented in commercial DEM software using the small displacement configuration and validated against material and experimental tests on masonry walls subjected to constant pre-compression and monotonically increasing in-plane load. The experimental and numerical results regarding the force-displacement relationship and damage pattern produced by the proposed constitutive model are compared and critically discussed, demonstrating the capability of DEM coupled with the suitable constitutive law in simulating the behavior of masonry structures.