We present a hybrid semiconductor-based superconducting qubit device that remains coherent at magnetic fields up to 1 T. The qubit transition frequency exhibits periodic oscillations with the magnetic field, consistent with interference effects due to the magnetic flux threading the cross section of the proximitized semiconductor nanowire junction. As the induced superconductivity revives, additional coherent modes emerge at high magnetic fields, which we attribute to the interaction of the qubit and low-energy Andreev states.