Well, you do not "get away" from the wall wart, you just replace it with a better one. The stock one injected line harmonics in the convertors. So you have 100Hz, 200Hz up to 500Hz in your signal without anything (analog) conected. I replaced it with a stabilised one from a local electronics shop. All line related noise gone, a flat noise floor.