OK, here we go. The good news is that the hum is gone. The bad news is that I still don't know what caused it. Moved cables as suggested, and moved some plugs. One odd thing is that the TotalMix software panel was definitely causing significant buzz if it was open. When closed, it was silent. Odd. Also, Guitar Rig and S-Gear were I think contributors as well as I was experimenting with them, but the cables were probably the biggest factor. Trouble is, I don't know.
Here is the important bit of the Jettenuator manual:
=== Controls and Connectors:
1. MicSim - this is a low-impedance, mic-level output. Connect directly to the mixing console at a live venue or recording environement.
2. OUT SPEAKER - connect to your speaker cabinet to hear your amplifier as normal. Jettenuator is a full-load device, so it is not necessary to use this connector in all applications. Note a reduction in output level of approximately -3dB even with the level set at 9 is inherent to the design of Jettenuator. If a speaker is not connected, set the Jettenuator control at 2 to provide the proper ohm load on your amplier's output.
3. OUT LINE - this output runs at LINE or Effects level. Unlike the Mic-Sim, the LINE LEVEL out is not speaker-compensated. You can send this output to your effects processors and/or power amp for monitoring.
4. INPUT FROM AMPLIFIER - connect the output of your amp to the input of Jettenuator here. Choose 4 ohm, 8 ohm, or 16 ohm amplifier outputs, but do NOT use more than one of these input simultaneously.
5. Jettenuator Control - this continuously variable control is labled 0~9 for your convenience. Please note as mentioned above, when this control is set to the maximum of 9 your output will still be attenuated by approximately -3dB. ALSO note, when set to 0 you probably won't hear anything from the SPEAKER (if connected) but it is possible with an extremely powerful amp - 100 watts or so - running very loud, there might be a small amount of leakage to the speaker. Set at 2~3 for nominal ohm load.
6. LINE LEVEL - Set the level of #3 OUT LINE. Approximately 0dB ~ -10dB, however as with the output to speaker, it is possible and ex-
tremely loud input maye result in some LINE output level even when this control is set to 0.
===
It may not make a difference, but the Line output of the Jettenuator is 'Line level'. The guitar input is high impedance and intended for the low level signal of a guitar. Try the Line inputs on the Babyface and see if that might make a difference.
According to the manual, the Mic-Sim out is at mic level. """MicSim - this is a low-impedance, mic-level output. Connect directly to the mixing console at a live venue or recording environement.""" It works going into either, with a change of cables of course, and the MicSim out sounds slightly different - better, to my year - than the instrument level.
Thanks for all the educational replies, everyone.