Someone correct me if I'm wrong, but I think because generally vocals are centered so it's easier to single them out by inverting the phase of one channel?
It won't work if the vocals are double tracked and panned hard left/right, and you'll still hear any stereo effects like reverb or chorus.