Localization based on visible light is gaining significant attention. But most existing studies rely on a key requirement: the object of interest needs to carry an optical receiver (camera or photodiode). We remove this requirement and investigate the possibility of achieving accurate localization in a passive manner, that is, without requiring objects to carry any optical receiver. To achieve this goal, we exploit the reflective surfaces of objects and the unique propagation properties of LED luminaires. We present geometric models, a testbed implementation, and empirical evaluations to showcase the opportunities and challenges posed by this new type of localization. Overall, we show that our method can track with high accuracy (few centimeters) a subset of an object’s trajectory and it can also identify passively the object’s ID.