Hi,
I'll give you what I can...for a mic, a Shure 58 will be just fine; it's a world-standard tool, it's about $100; get a cast-base tabletop stand, an XLR cable, and you have that covered.
You say you have a Linux-based PC, but how new is it, and with what kind of harddrive and RAM? If it is fairly new, you shouldn't have a problem just piping voice into a soundcard.
So, a 58, a cheap pre-amp (look up Audiobuddy or M-audio) and a decent sound card for your PC should allow you to record readings. You will need an adaptor from the cable from the pre-amp when it goes into the soundcard.
Get Audacity at audacity.com. Free, stone-simple audio editor that allows you to save projects in 3 different formats.
Your PC has a CD burner I assume? If it doesn't, get Lite-On; weird name, but the fact that I can burn at 52 times normal speed on my stone-age PC without hiccups tells me this thing is stable. Best Buy has them. It comes with Nero Express which, again, is good, simple burning software for making CDs. Check nero.com for compatibility with Linux.
If you are in the US, places to buy:
ZZounds,
American Musical Supply
123Music
Generally you can get free shipping, and no tax.
Good luck, I hope this is of use,
CC