No, not at all. Proper patchbays allow "normalling", which basically establishes a default configuration. When I do a room, I always configure the patchbays so that the default, normalled setup is ready for tracking. With that, you walk up to the patchbays, _pull out_ all the cables on the front (user) side, and you're ready to track. Then when you need an _exception_ to that default setup, you can plug in a patch cable or two- breaking the normal connection, and allowing you to reroute anything to anywhere.
Normalling is what makes the world work in any studio, which is why you need to think long and hard about what the default setup should be. For example: console direct outs to tape machine inputs, tape meachine outputs to console tape monitor inputs, console master outs to 2-track inputs, and so on. You take all the channel inserts and bring them to the patchbay, and use the normalling contacts to short the out to the in when there's no patch installed. That way, you can insert gear into a channel path with just a pair of patch cables. The list goes on.
The most important thing in any patching setup is to decide what the normal configuration will be, so that you can get the majority of your work done with no patch cables on the front of the bays at all. Patches are only for exceptions: but everything goes to the bays, so that any set of exceptions you might need would be possible.