I think, if I understand correctly, you're asking about Hard Drives verses removable media. I'll try to help...
I also read in the on-line manuals of some recorders where they say to leave your recorder in one place to prevent damage to the hard drive
Yes, the one advantage to most removable media (other than optical drives and floppies) is that there aren't moving parts, so they are not suseptable to damage from moving them (hell, they wouldn't make very good "removable" media if they were). Hard drives on the other hand, contain one or more spinning disks and a arm that reads them. Shake the disk enough and yes, you can jam or just break the little arm inside of the hard disk alltogether, so if you want to be really safe, the less you move your recorder, the better.
Just how fragile is a hard disk? Well, I've dropped quite a few on the solid ground (3 or 4 feet), and I've found about 3/4 of the time they're fine. I've never actually had a hard disk break by shaking it. I know that when I did work on computers and we'd purposely go to break hard disks (don't ask why), we'd usually just bang them against a solid surface three or four times on their side pretty hard, and that'd usually do the trick. But as far as moving your computer/recorder around, I've never broken a hard drive by moving or even dropping an entire machine with the drive in it. Not to say it can't be done, but honestly the risk of breaking the drive from just moving the recording unit around seems pretty slim at best.
Some of these recorders can still record at 16bit/44Hz so I would assume that the sound quality would be decent.
Keeping on the topic of Hard Disk/Removable Media, the media itself won't determine the quality; like Mac mentioned, it's about storage. Obviously better quality files are going to take up more space, but quality is quality regardless of media. So basically, if you're recording at CD quality (16/44) on removable media, you're audio is still going to be as great as it would be on HD recording at the same bitrate. However, 80 minutes of CD audio (one track) takes up 700 mb of space, so if you're going to do 4 tracks totalling 20 minutes of all your songs, you're going to need a 700 mb card, which comes at quite a hefty price tag (for that same price, you could probably get yourself a 120 GB hard disk).
So basically, the point is, HD recorders are pleanty safe (removable storage has it's own risks anyway), and much cheaper with tons more storage, so go with that.