Microwave cavities are commonly used in many experiments, including optomechanics, magnetic field sensing, magnomechanics, and circuit quantum electrodynamics. Noise, such as variations in the magnetic field or mechanical vibrations, can cause fluctuations of the natural frequency of the cavity, creating challenges in operating them in experiments. To overcome these challenges, we demonstrate a dynamic feedback system implemented by the locking of a microwave drive to the noisy cavity. A homodyne-interferometer scheme monitors the cavity resonance fluctuations due to low-frequency noise, which is mitigated by frequency modulating the microwave generator. The feedback has a bandwidth of 400 Hz, with a reduction of cavity fluctuations by 85% integrating up to a bandwidth of 2 kHz. Moreover, the cavity resonance frequency fluctuations are reduced by 73%. This scheme can be scaled to enable multitone experiments locked to the same feedback signal. As a demonstration, we apply the feedback to an optomechanical experiment and implement a cavity-locked multitone mechanical measurement. As low-frequency cavity frequency noise can be a limiting factor in many experiments, the multitone microwave locking technique presented here is expected to be relevant for a wide range of microwave-cavity experiments.