A lot depends on the amp.
For some...you might not hear much difference from tube to tube...but for others, you will hear it. Good quality amps will react better to tube changes...crappier amps just sound crappy, no matter what the tubes.
I have a couple of cases of tubes - preamp, power and rectifiers in every type and all kinds of brands, old and new production…and I've spent a good deal of time testing the tubes with my tube tester and notating the results, and also trying out tubes in the amps.
It is very time consuming, but finding the right tube combination can make BIG difference.
One thing...if you just swap one preamp tube...you only change one thing. You have to try swapping the other tubes in the amp also.
Going through several 12xx7 types will give you a multitude of flavors.
I'll use 5751, 12AY7 and 12AU7 tubes in place of 12AX7 tubes in some positions.
Also...everyone usually leaves the phase inverter tube alone...but swapping that out could provide greater tone changes than when you swap the V1 preamp tube.
Also...don't just focus on the preamp tubes. Different power amp tubes can give dramatic changes...or none at all.
So...first you need a good assortment of preamp and power amp tubes...and then an afternoon to experiment.