Eastale,
I'm an audio beginner like you. I recently bought
the Tascam Dp01fx, a couple of mics (MXL set: 603 and 2001),
a Joe Meek JM27, a few stands, pop filters and suspension mounts. I'm recording ukulele(s), electric bass, assorted percussion instruments, melodica, voice. If you're intention is to make some clean recordings, rough demos, flesh out song ideas and most importanly LEARN and have a lot of fun, this is a good way to go.
The biggest limitations to the Tascam outfit is its' inability to record more than two sources simultaneously, and its' 16-bit threshold -- 24 bit is the way to go for infinite mixdowns and rerecordings -- it's "cd" quality. If you are interested in making mp3s to share (and get feedback) on audio sites like soundclick, myspace, etc., this will work fine.
Read the forums here, take advice from many of the smart guys (Harvey Gerst) knows a lot, then piece-out the components that will suit you and buy online: zzounds.com music123.com, many others.
If you don't go the SIAB (studio in a box) route, there are many computer- based recording solutions that work spectacularly well. You're going to have to learn some of that anyway, as the Tascam really works best as a recorder, and mixdown seems easier on a computer: think Audacity and Kristal (good Freeware programs) or n-Track and Sonar (commercial programs).
If you've gotten this far, I suggest you also check out mic comparison sites like
http://testing.holmerup.biz/mic_pretest/MP3index_en.html and
http://www.thelisteningsessions.com/. The Dummie's Guide, Home Recording for Musicians, volume 2 is also a great way to get your feet wet.
Lastly, listen to as much music online as you can -- see what others are doing, either right or wrong; learn from their mistakes. Take your time and have fun.
Good luck.