OK, so I took it out of the system, opened it up, re-soldered the rca output joints, and then put some high torque silicon around the rca assembly to help hold it better. It seemed to wiggle too much on the board, and I didn't have any jb weld handy, so I hope this rtv provides enough support to help hold it in place better. I also re-soldered the phono and CD rca inputs, since they are used on the unit. No reason not to, since it was already open. I'm testing it now, and the channels aren't cutting out yet. It was having one or both drop and I've have to wiggle the rca to bring it back. I tried several different cables, so my assumption was the unit and not bad luck of three or four bad cables in a row!
I guess to sum things up, if you are doing the balance knob fix, you mind as well check for cold solder joints on the RCA's while you're at it.