That's actually a really good idea that works extremely well. As long as the room accoustics are exceptional, and the performance is good and loud. As any weaknesses in your accoustic environment will be magnified times a thousand . . . not to mention the unusually high level of hiss or any self noise you'll likely encounter if the pefromance is in the least bit quiet.
But yea, if you can pull it off, the stereo image is exceptional -- particularly on headphones.