Ham - your suggestion to lower bias did the trick.
I dropped bias to 1.1v and the amp runs cool as cucumber. Output heat sinks ran about 80-82 degrees, which is cool to the touch. The drive boards get pretty warm, about 110 on the heat sinks and the big resistors in the bottom corners of the drive boards get up to about 140, but I have them mounted about 1/4" above the board and they are 3 watt rated.
I ran the amp for about 3 hours last night to dial in the adjustments, and running again today for about 3 hours so far, and it does not get hot at all. Heat sinks under 90F while running music at 1.5w steady.
I checked for distortion today and got the best distortion readings of about 0.07% THD at 1kHz @1W with bias tweaked to about 1.14v which is where I left it. So slightly above 1.1, but not much and still running cool.
One more odd thing, as if there have not been enough with this unit. When powering down, the relays cut out immediately as they should with the modification. There is no squeal from the caps discharging, except when I disconnect the input, then it squeals until the caps discharge. I am testing with a phone as the source, so I have unplugged it a few times right after power down. When in a more permanent set-up, it is unlikely I would disconnect the inputs so soon, so there is no problem. But thought it was strange since the relays are already disengaged when it starts.
Here are some photos of the completed unit.