When measuring offset voltage at the amplifier output, the sign ( + or - ) of the voltage isn't as important as it's magnitude, and it's difference from the ideal reading of zero.
When measuring bias current of the power output transistors across emitter resistors, the sign of the voltage will always be constant, as curent flows in a specific direction between the positive supply and the negative supply. Thus if you have an analog meter, you would know immediately to reverse the leads, because the needle would swing below zero, where it cannot be accurately read. With a modern DMM, that is not as important, as most meters will automatically compensate for the negative voltage. You could as a matter of good form, reverse the leads if the reading is a negative voltage. See if there is any change to the magnitude of the reading after the lead reversal. There shouldn't be...