Yes, louder is not necesarilly better, but to my ears (and I'm talking about bass amps here, NOT GUITAR AMPS WHICH EVERYONE STILL SEEMS TO THINK I'M ACTUALLY LOOKING FOR, just thought I should point that out) higher wattage amps just seem to sound better. Even if the volume is only around 3 (which still gives up plenty of kick drum) it still sounds fuller then 100 watts at 5. But that's just my opinion.
Zed, what amp are you using?