Something going on with the mic or cable, if the mic needs phantom it won't work with it off, if the mic does not need phamtom it won't make any difference if it's on or off.
As asked above, what is the mic, is the cable a proper mic cable with 2 cores and a shield (not a guitar cable with a XLR on the end).
Alan.