Possibilities count
There is a quantity that we’ll call the “amplitude” for each possible path that a photon can take.
The amplitudes can interfere constructively and destructively, even though each photon takes only one path.
The amplitudes at detector A interfere destructively; those at detector B interfere constructively.