You can change the preamp tubes (the little 9pin ones) without worrying about bias. Unplug the amp, let it cool, pull the tubes with a gentle circular rocking motion. Do 'em one at a time. If it's a Marshall head or any amp with the sockets facing up you'll probably need to blow the dust out first. Don't want that stuff getting in the sockets. Make sure the pins are lined up coreectly when you install the replacements. Check 'em first to make sure none are bent. If they are carefully straighten them first.
It's the big output tubes that could need a bias adj. Not a task for a tube newbie. You don't want to go poking around under the chassis of a tube amp without knowing what you're doing. Large stored voltages in there that can give you a serious jolt or even kill.
You could get lucky on the bias issue. If it were me I would go ahead & install the new power tubes, then watch the amp carefully for an under-biased condition. If there isn't enough bias voltage, the large plates inside will start to glow. If this happens shut it off, you need an adj. to run those tubes. It could take as long as 30min for that to happen, so keep an eye on those tubes for a while.
If the amp sounds weak, and has an unpleasant distortion even at low volume it's over biased. This really won't hurt anything, but you probably won't dig the tone.
There are a few books out there that describe the bias process and what tools you'll need. "The Tube Amp Book" by Aspen Pittmamn is the one I have. Lots of good stuff in that one. Cool pics of old amps & guitars, schematics for tons of amps, care & feeding tips. Even has a section on vintage tube mics. Every tube amp owner should have a copy.