As others have said, 5U4 is common, and you should be able to find something that works via a "shotgun" approach, if nothing else.
I have heard of tubes coming loose from their bases. This is not uncommon. I have heard several fixes for this condition, the one that I've heard a bunch of guys swear by is to use clear nail polish as an adhesive between the glass and base. I have not personally tired it, but if I had a tube of glass-to-plastic-base construction, one way I'd try to damp the physical vibration would be to ensure a good mechanical connection between the base and the glass.
If you'd like to experiment with solid state diodes, you need not have to mod your amp: mod a dead octal tube, instead. If you can get a bad octal tube, remove the base & pins from the glass. I think the pins often have solder in them, and you can remove it or soften it and re-use it for your own purposes. Put a pair of solid state diodes in the octal base with the same pinout as the vacuum ones, and you'll have a drop-in SS rectifier to play around with.
Good luck with the project!