It would be unusual to see glue under small caps, but it's possible. Try a Q-Tip and some warm water on the brown stuff. If it's insoluble it's probably glue, if it dissolves it's probably electrolyte. The risk with some glue is it's been reported to turn quite corrosive to leads and even boards. Only inspection can tell, and that's hard from here.
If you replace the caps, try to remove any glue around the lead area. Again, I can't diagnose things remotely, so anything is possible, but if the unit performs well and the schmutz really is glue, it's statistically unlikely there's a cap problem.
The paranoia about cap life is astounding. Because of the way most solid state audio components use caps, with minimal ripple currents and at low temperatures, they don't often fail unless the quality was bad to begin with. Even tube equipment does well, other than main filter caps and those in thermally "unfortunate" locations. The lifetime numbers most people bandy about from the manufacturers have nothing to do with how the caps are actually used in audio equipment. Still, if you can't sleep until you change them, do a careful job and it will probably go well. Just for fun, if you're not too far away, send me the old ones and I'll check them for condition and tell you how good or bad they really were.