Hum in the 4004 amps was a problem all during production, but mostly the original versions. They used transformers from several companies.
The later Mark II or Series II had a square of damping material glued to the cover.
My Mark II was silent, but the earlier one had a little hum. It didn't go through to the speakers, it was a mechanical hum in the transformer.
When I called Mondial in '92 or so about transformer hum, I was told that the hum was due to noise on the power supply from the wall outlet. The transformer was essentially "cleaning up" the dirty power.
They also suggested playing with the nut that secures the two transformers. Sometimes a little looser would reduce the hum. Rarely, tightening it would reduce the hum.
I have to assume that your 4004 was set up for 240 volt mains, I don't know how to convert a 120-volt unit to 240 volt operation--although I know it can be done. The later 8008 use a power inlet device that can be removed, turned, and reinstalled to change between 120-volt and 240 volt, as long as the proper fusing is also used.