Usually the cpu fan will make the most noise, single handedly.
If you've got a fan up front that's be 2nd most noticeable next to the CPU fan, usually.
Video Card fans as long as they are stock usually have no noticable change. Unless it's say like the new GeForce FX card that takes up two pci slots of it's own /:
I've got 6 fans in my case (one on the CPU, two on the power supply nice quite enermax whisper supply-that it truly does, one on the video card, and three 80 mm case fans) I've also got a drive-bay with knobs to let me control the case fans, and my cpu fan has a speed adjustment switch as well. I can stick my head in the case and barely hear the video card and power supply fans combined.
It all depends on what size your case fans are, and who makes them. They will vary, you can get one 40 mm fan from some place and it will make a noise of say 30db, while one from another company of the same size and style will make 40db.
It all adds up.
But in your situation from what you listed I'm gonna say it has to do with your case fans and cpu fan.
As enermax power supplys are pretty quite, as are MOST video card fans are as well.
You should have 4 (5 if you have a videocard that needs one) fans in your case minimum if you want a good condition airflow in your computer, if possible see what fans came with your case try to get some really quite ones.
You could also get a better fan for your cpu, one with optional speed switch, and get some nice thermal compound for the cpu so you can get even cooler cpu temps and be-able to run your cpu fan at a lower speed.
I wouldn't think your case noice would be that loud from what you have listed, but hey. You can go spend a few hundred if you want to go water cooling /: If the noise it that big an issue.
Well, good luck.