Get an interface. A USB interface might not be a long term device in your recording setup, but will be far far better sounding and longer lasting than a USB mic.
Then, get a good mic, recommendations I'll leave to 'budget mic' forum searches.
For example I use a Behringer B2 Pro ($150, large...