You can make a relatively inexpensive "patch bay" for yourself with a 1-U rack panel and the connectors you want to use (RCA, phone etc). It won't be as "cool" as a store-bought model (no normalized inputs and so on) but if you have just a few devices to connect and your configuration won't be changing, it's pretty easy. I made one using phone jacks to connect my mixer-phone amp-power amp-BBE-computer breakout box setup and now I can switch one pair of cables on the front of my rack and get playback through headphones or through the apeakers or whatever. It did require both planning and redoing after I tried out the original layout. The cables that connect to the mixer, amp, etc, by the way, don't "patch" into the back but are hardwired to the front panel jacks. This is where a real patchbay is much better for a complex layout where you are going to be using many different devices in the course of a project.
A couple of tips: use a steel rack panel and mount the jacks near the outside edges to minimize flex when you pull and push on the plugs to make connections.
Also, if you don't have a rack, you can wire the connections into a desktop box that will sit better than a rack panel on a flat surface like a shelf.
John