Mark,
They both illuminate. Fuse lamps are typically used befind the display and meters where wide light dispersion is required. They snap into holders.
The other lamps are used to spot illuminate indicator printing, pointer, etc. They will either solder in or connect using wires.
DH