It was that, I was using mic input instead of 'Line In'. Using 'Line In' I get a really low background noise which can be eliminated, I'm guessing it's room tone. Thanks!
EDIT: Nevermind, the hissing just disappeared, I don't think it had to do with that. I'm trying to use the mic through a...