Well, I tried the interface with a laptop - and cut the mains power, so ran from the battery.
Magic - all bad noise disappeared!
So, how to resolve with my main PC. Well, I tried running the amp on a different circuit by using a 50+ foot extension cable. No bad noise...
So then I brought said...