Try adjusting the mic position first. If you have it at an angle, it may be picking up reflections as well as the direct sound. If you or anything in the room is moving around, or if you have standing waves happening, that could affect what the mic is 'hearing'.